2023-06-02T15:14:09.684 INFO:root:teuthology version: 0.0.1.dev116+g62814ab 2023-06-02T15:14:09.685 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi --description fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} --archive /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361 --verbose -- /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/orig.config.yaml 2023-06-02T15:14:09.726 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-02T15:14:09.817 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361 branch: reef-release description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} email: null first_in_suite: false job_id: '7294361' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: reef-release ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 2870bf456d3115490c153abce9d47ac5c043b65e ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 2870bf456d3115490c153abce9d47ac5c043b65e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef-release sha1: 2870bf456d3115490c153abce9d47ac5c043b65e owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 - - client.1 seed: 3048 sha1: 2870bf456d3115490c153abce9d47ac5c043b65e sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: reef-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_2870bf456d3115490c153abce9d47ac5c043b65e/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 2870bf456d3115490c153abce9d47ac5c043b65e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi078.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAZR0uL9ylfTMCrHWJ2m9yZdwI7Zs0LYSXD8l/NhaQns smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObGrJhjSuegxyHezZeD992nLJv7Hn5SJHoi2yHJeEdDuey7WOBYRxui7li76nOCu/nlybVywM+zD+tvT5rBJn0= smithi150.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdJOZSiX3+K3xurw+9W23izImR/2D8F1yD/nSBGZfyx5WupTuX/8co3hwAW4CQD0ajhkff2cnpJ4Ib+BMVYdNk= smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA1/IRWm6AhkuqdkiWvx+BHPj6Kp6XrE4bGIu6bnFC6tAPc1BI/ngr5Frv6LIns5CFXMAL2CqqRhTeDemDZq25E= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - ceph-fuse: null - pexec: clients: - cd $TESTDIR - wget http://download.ceph.com/qa/mdtest-1.9.3.tgz - mkdir mdtest-1.9.3 - cd mdtest-1.9.3 - tar xvfz $TESTDIR/mdtest-1.9.3.tgz - rm $TESTDIR/mdtest-1.9.3.tgz - MPI_CC=mpicc make - ln -s $TESTDIR/mnt.* $TESTDIR/gmnt - ssh_keys: null - mpi: exec: $TESTDIR/mdtest-1.9.3/mdtest -d $TESTDIR/gmnt -I 20 -z 5 -b 2 -R - pexec: clients: - rm -f $TESTDIR/gmnt - rm -rf $TESTDIR/mdtest-1.9.3 - rm -rf $TESTDIR/._mdtest-1.9.3 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 62814aba234085f597115b9ba9bdc56af117de9e timestamp: 2023-06-02_15:02:25 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-06-02T15:14:09.817 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_2870bf456d3115490c153abce9d47ac5c043b65e/qa; will attempt to use it 2023-06-02T15:14:09.818 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_2870bf456d3115490c153abce9d47ac5c043b65e/qa/tasks 2023-06-02T15:14:09.818 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-06-02T15:14:09.820 INFO:teuthology.task.internal:Checking packages... 2023-06-02T15:14:09.849 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '2870bf456d3115490c153abce9d47ac5c043b65e' 2023-06-02T15:14:09.849 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-06-02T15:14:09.850 INFO:teuthology.packaging:ref: None 2023-06-02T15:14:09.850 INFO:teuthology.packaging:tag: None 2023-06-02T15:14:09.850 INFO:teuthology.packaging:branch: reef-release 2023-06-02T15:14:09.851 INFO:teuthology.packaging:sha1: 2870bf456d3115490c153abce9d47ac5c043b65e 2023-06-02T15:14:09.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=reef-release 2023-06-02T15:14:09.999 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:14:09.999 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-06-02T15:14:10.006 INFO:teuthology.task.internal:no buildpackages task found 2023-06-02T15:14:10.007 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-06-02T15:14:10.018 INFO:teuthology.task.internal:Saving configuration 2023-06-02T15:14:10.033 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-06-02T15:14:10.040 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-02T15:14:10.069 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-02 15:03:30.842257', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAZR0uL9ylfTMCrHWJ2m9yZdwI7Zs0LYSXD8l/NhaQns'} 2023-06-02T15:14:10.096 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-02 15:03:30.837689', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIA/Hm0pgRlHZrQWoRIfL4ozGGGjX90lveLJAYVYD7oa2'} 2023-06-02T15:14:10.121 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-02 15:03:30.841275', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIWToEHqJw5eLzrEIiA0IHpDRReDIZIzDaJgSo4O2Orb'} 2023-06-02T15:14:10.145 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-02 15:03:30.840253', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGiNgmUOhjSFJiF4Faj4vaA1DZjqXRKNrkV+kcLUt2xr'} 2023-06-02T15:14:10.146 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-06-02T15:14:10.152 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-06-02T15:14:10.152 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-06-02T15:14:10.153 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['client.0'] 2023-06-02T15:14:10.153 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['client.1'] 2023-06-02T15:14:10.153 INFO:teuthology.run_tasks:Running task console_log... 2023-06-02T15:14:10.297 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f109f6b4e50>, signals=[15]) 2023-06-02T15:14:10.298 INFO:teuthology.run_tasks:Running task internal.connect... 2023-06-02T15:14:10.305 INFO:teuthology.task.internal:Opening connections... 2023-06-02T15:14:10.306 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:14:10.308 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:14:10.384 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:14:10.386 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:14:10.461 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2023-06-02T15:14:10.461 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:14:10.532 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2023-06-02T15:14:10.533 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:14:10.609 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-06-02T15:14:10.617 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-06-02T15:14:10.624 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-06-02T15:14:10.624 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-06-02T15:14:10.670 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-02T15:14:10.670 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2023-06-02T15:14:10.670 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="22.04" 2023-06-02T15:14:10.671 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-02T15:14:10.671 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=jammy 2023-06-02T15:14:10.671 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2023-06-02T15:14:10.671 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2023-06-02T15:14:10.671 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-02T15:14:10.671 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-02T15:14:10.671 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-02T15:14:10.671 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-02T15:14:10.672 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=jammy 2023-06-02T15:14:10.672 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-06-02T15:14:10.706 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-06-02T15:14:10.712 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-06-02T15:14:10.712 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-06-02T15:14:10.759 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-02T15:14:10.759 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Ubuntu" 2023-06-02T15:14:10.759 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="22.04" 2023-06-02T15:14:10.759 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-02T15:14:10.759 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_CODENAME=jammy 2023-06-02T15:14:10.759 INFO:teuthology.orchestra.run.smithi132.stdout:ID=ubuntu 2023-06-02T15:14:10.760 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE=debian 2023-06-02T15:14:10.760 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-02T15:14:10.760 INFO:teuthology.orchestra.run.smithi132.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-02T15:14:10.760 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-02T15:14:10.760 INFO:teuthology.orchestra.run.smithi132.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-02T15:14:10.760 INFO:teuthology.orchestra.run.smithi132.stdout:UBUNTU_CODENAME=jammy 2023-06-02T15:14:10.761 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-06-02T15:14:10.781 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2023-06-02T15:14:10.786 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2023-06-02T15:14:10.787 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2023-06-02T15:14:10.832 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-02T15:14:10.832 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu" 2023-06-02T15:14:10.832 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="22.04" 2023-06-02T15:14:10.833 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-02T15:14:10.833 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=jammy 2023-06-02T15:14:10.833 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu 2023-06-02T15:14:10.833 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian 2023-06-02T15:14:10.833 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-02T15:14:10.833 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-02T15:14:10.833 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-02T15:14:10.834 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-02T15:14:10.834 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=jammy 2023-06-02T15:14:10.834 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2023-06-02T15:14:10.856 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2023-06-02T15:14:10.861 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2023-06-02T15:14:10.861 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2023-06-02T15:14:10.906 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-06-02T15:14:10.907 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="Ubuntu" 2023-06-02T15:14:10.907 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="22.04" 2023-06-02T15:14:10.907 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-06-02T15:14:10.907 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_CODENAME=jammy 2023-06-02T15:14:10.907 INFO:teuthology.orchestra.run.smithi159.stdout:ID=ubuntu 2023-06-02T15:14:10.907 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE=debian 2023-06-02T15:14:10.907 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://www.ubuntu.com/" 2023-06-02T15:14:10.908 INFO:teuthology.orchestra.run.smithi159.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-06-02T15:14:10.908 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-06-02T15:14:10.908 INFO:teuthology.orchestra.run.smithi159.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-06-02T15:14:10.908 INFO:teuthology.orchestra.run.smithi159.stdout:UBUNTU_CODENAME=jammy 2023-06-02T15:14:10.908 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2023-06-02T15:14:10.931 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-06-02T15:14:10.940 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-06-02T15:14:10.947 INFO:teuthology.task.internal:Checking for old test directory... 2023-06-02T15:14:10.947 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2023-06-02T15:14:10.950 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2023-06-02T15:14:10.952 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2023-06-02T15:14:10.954 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2023-06-02T15:14:10.959 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-06-02T15:14:10.968 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-06-02T15:14:10.968 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2023-06-02T15:14:10.995 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2023-06-02T15:14:11.000 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2023-06-02T15:14:11.005 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2023-06-02T15:14:11.178 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-06-02T15:14:11.282 INFO:teuthology.run_tasks:Running task kernel... 2023-06-02T15:14:11.302 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-06-02T15:14:11.303 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-06-02T15:14:11.304 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-02T15:14:11.304 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-02T15:14:11.305 DEBUG:teuthology.orchestra.run.smithi150:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-02T15:14:11.305 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2023-06-02T15:14:11.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:14:11.310 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2023-06-02T15:14:11.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:14:11.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:14:11.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:14:11.312 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-06-02T15:14:11.313 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2023-06-02T15:14:11.313 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-06-02T15:14:11.357 INFO:teuthology.orchestra.run.smithi150.stdout:5.15.0-56-generic 2023-06-02T15:14:11.357 INFO:teuthology.task.kernel:Running kernel on smithi150: 5.15.0-56-generic 2023-06-02T15:14:11.357 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2023-06-02T15:14:11.358 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-56-generic 2023-06-02T15:14:11.358 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.15.0-56-generic 2023-06-02T15:14:11.359 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get clean 2023-06-02T15:14:11.360 INFO:teuthology.orchestra.run.smithi132.stdout:5.15.0-56-generic 2023-06-02T15:14:11.360 INFO:teuthology.orchestra.run.smithi159.stdout:5.15.0-56-generic 2023-06-02T15:14:11.360 INFO:teuthology.task.kernel:Running kernel on smithi132: 5.15.0-56-generic 2023-06-02T15:14:11.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get clean 2023-06-02T15:14:11.361 INFO:teuthology.task.kernel:Running kernel on smithi159: 5.15.0-56-generic 2023-06-02T15:14:11.361 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get clean 2023-06-02T15:14:11.485 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2023-06-02T15:14:11.505 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get update 2023-06-02T15:14:11.512 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2023-06-02T15:14:11.528 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get update 2023-06-02T15:14:11.643 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-02T15:14:11.654 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:14:11.657 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-02T15:14:11.657 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-02T15:14:11.667 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:14:11.678 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-02T15:14:11.724 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-02T15:14:11.740 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-02T15:14:11.750 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:14:11.781 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-02T15:14:11.817 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:14:11.817 INFO:teuthology.orchestra.run.smithi159.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2023-06-02T15:14:11.831 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-02T15:14:11.839 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [449 kB] 2023-06-02T15:14:11.875 INFO:teuthology.orchestra.run.smithi159.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2023-06-02T15:14:11.888 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [449 kB] 2023-06-02T15:14:11.906 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [232 kB] 2023-06-02T15:14:11.912 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [121 kB] 2023-06-02T15:14:11.914 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.1 kB] 2023-06-02T15:14:11.915 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [345 kB] 2023-06-02T15:14:11.917 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [666 kB] 2023-06-02T15:14:11.926 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-02T15:14:11.927 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [51.8 kB] 2023-06-02T15:14:11.928 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-02T15:14:11.929 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [730 kB] 2023-06-02T15:14:11.942 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [533 kB] 2023-06-02T15:14:11.958 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [416 kB] 2023-06-02T15:14:11.959 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [232 kB] 2023-06-02T15:14:11.964 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [121 kB] 2023-06-02T15:14:11.967 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.1 kB] 2023-06-02T15:14:11.968 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [345 kB] 2023-06-02T15:14:11.979 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-02T15:14:11.984 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [128 kB] 2023-06-02T15:14:11.992 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [416 kB] 2023-06-02T15:14:11.994 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [51.8 kB] 2023-06-02T15:14:11.994 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-02T15:14:11.995 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [533 kB] 2023-06-02T15:14:11.999 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [730 kB] 2023-06-02T15:14:12.000 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [181 kB] 2023-06-02T15:14:12.002 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.0 kB] 2023-06-02T15:14:12.003 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-02T15:14:12.003 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [345 kB] 2023-06-02T15:14:12.012 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [666 kB] 2023-06-02T15:14:12.012 INFO:teuthology.orchestra.run.smithi132.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [52.2 kB] 2023-06-02T15:14:12.013 INFO:teuthology.orchestra.run.smithi132.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-02T15:14:12.032 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [181 kB] 2023-06-02T15:14:12.037 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.0 kB] 2023-06-02T15:14:12.038 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-02T15:14:12.039 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [345 kB] 2023-06-02T15:14:12.040 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [128 kB] 2023-06-02T15:14:12.046 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [52.2 kB] 2023-06-02T15:14:12.047 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-02T15:14:12.048 INFO:teuthology.orchestra.run.smithi132.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [909 kB] 2023-06-02T15:14:12.057 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.3 kB] 2023-06-02T15:14:12.058 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-02T15:14:12.061 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-02T15:14:12.061 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-02T15:14:12.082 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [909 kB] 2023-06-02T15:14:12.115 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.3 kB] 2023-06-02T15:14:12.116 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-02T15:14:12.119 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-02T15:14:12.120 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-02T15:14:12.175 INFO:teuthology.orchestra.run.smithi132.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [618 kB] 2023-06-02T15:14:12.183 INFO:teuthology.orchestra.run.smithi132.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [190 kB] 2023-06-02T15:14:12.184 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-02T15:14:12.186 INFO:teuthology.orchestra.run.smithi132.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [19.6 kB] 2023-06-02T15:14:12.186 INFO:teuthology.orchestra.run.smithi132.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-02T15:14:12.186 INFO:teuthology.orchestra.run.smithi132.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-02T15:14:12.187 INFO:teuthology.orchestra.run.smithi132.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-02T15:14:12.188 INFO:teuthology.orchestra.run.smithi132.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-02T15:14:12.188 INFO:teuthology.orchestra.run.smithi132.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-02T15:14:12.191 INFO:teuthology.orchestra.run.smithi132.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-02T15:14:12.192 INFO:teuthology.orchestra.run.smithi132.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-02T15:14:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [618 kB] 2023-06-02T15:14:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [190 kB] 2023-06-02T15:14:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [19.6 kB] 2023-06-02T15:14:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-02T15:14:12.220 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-02T15:14:12.220 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-02T15:14:12.220 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-02T15:14:12.221 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-02T15:14:12.223 INFO:teuthology.orchestra.run.smithi132.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [449 kB] 2023-06-02T15:14:12.224 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-02T15:14:12.225 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-02T15:14:12.229 INFO:teuthology.orchestra.run.smithi159.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [108 kB] 2023-06-02T15:14:12.229 INFO:teuthology.orchestra.run.smithi132.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-02T15:14:12.232 INFO:teuthology.orchestra.run.smithi159.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [449 kB] 2023-06-02T15:14:12.247 INFO:teuthology.orchestra.run.smithi132.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-06-02T15:14:12.259 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-02T15:14:12.263 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-06-02T15:14:12.273 INFO:teuthology.orchestra.run.smithi132.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-02T15:14:12.276 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-06-02T15:14:12.284 INFO:teuthology.orchestra.run.smithi132.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-06-02T15:14:12.293 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-06-02T15:14:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-02T15:14:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-06-02T15:14:12.327 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [666 kB] 2023-06-02T15:14:12.367 INFO:teuthology.orchestra.run.smithi159.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [666 kB] 2023-06-02T15:14:12.507 INFO:teuthology.orchestra.run.smithi132.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [232 kB] 2023-06-02T15:14:12.528 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [416 kB] 2023-06-02T15:14:12.532 INFO:teuthology.orchestra.run.smithi159.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [232 kB] 2023-06-02T15:14:12.534 INFO:teuthology.orchestra.run.smithi132.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [121 kB] 2023-06-02T15:14:12.547 INFO:teuthology.orchestra.run.smithi132.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.1 kB] 2023-06-02T15:14:12.548 INFO:teuthology.orchestra.run.smithi132.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-02T15:14:12.552 INFO:teuthology.orchestra.run.smithi132.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [345 kB] 2023-06-02T15:14:12.559 INFO:teuthology.orchestra.run.smithi159.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [121 kB] 2023-06-02T15:14:12.572 INFO:teuthology.orchestra.run.smithi159.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [10.1 kB] 2023-06-02T15:14:12.574 INFO:teuthology.orchestra.run.smithi159.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [28.0 kB] 2023-06-02T15:14:12.574 INFO:teuthology.orchestra.run.smithi159.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [416 kB] 2023-06-02T15:14:12.577 INFO:teuthology.orchestra.run.smithi159.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [345 kB] 2023-06-02T15:14:12.591 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [181 kB] 2023-06-02T15:14:12.607 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.0 kB] 2023-06-02T15:14:12.608 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-02T15:14:12.610 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [345 kB] 2023-06-02T15:14:12.612 INFO:teuthology.orchestra.run.smithi132.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [51.8 kB] 2023-06-02T15:14:12.618 INFO:teuthology.orchestra.run.smithi132.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-02T15:14:12.618 INFO:teuthology.orchestra.run.smithi132.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [730 kB] 2023-06-02T15:14:12.635 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [52.2 kB] 2023-06-02T15:14:12.636 INFO:teuthology.orchestra.run.smithi159.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [181 kB] 2023-06-02T15:14:12.636 INFO:teuthology.orchestra.run.smithi159.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [51.8 kB] 2023-06-02T15:14:12.637 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-02T15:14:12.642 INFO:teuthology.orchestra.run.smithi159.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [604 B] 2023-06-02T15:14:12.643 INFO:teuthology.orchestra.run.smithi159.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [533 kB] 2023-06-02T15:14:12.652 INFO:teuthology.orchestra.run.smithi159.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [15.0 kB] 2023-06-02T15:14:12.653 INFO:teuthology.orchestra.run.smithi159.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [28.3 kB] 2023-06-02T15:14:12.655 INFO:teuthology.orchestra.run.smithi159.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [345 kB] 2023-06-02T15:14:12.680 INFO:teuthology.orchestra.run.smithi159.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [52.2 kB] 2023-06-02T15:14:12.683 INFO:teuthology.orchestra.run.smithi132.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [533 kB] 2023-06-02T15:14:12.683 INFO:teuthology.orchestra.run.smithi159.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [604 B] 2023-06-02T15:14:12.696 INFO:teuthology.orchestra.run.smithi159.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [730 kB] 2023-06-02T15:14:12.801 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [618 kB] 2023-06-02T15:14:12.847 INFO:teuthology.orchestra.run.smithi159.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [618 kB] 2023-06-02T15:14:12.875 INFO:teuthology.orchestra.run.smithi132.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [128 kB] 2023-06-02T15:14:12.899 INFO:teuthology.orchestra.run.smithi159.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [128 kB] 2023-06-02T15:14:13.243 INFO:teuthology.orchestra.run.smithi132.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.3 kB] 2023-06-02T15:14:13.249 INFO:teuthology.orchestra.run.smithi132.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-02T15:14:13.264 INFO:teuthology.orchestra.run.smithi132.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-02T15:14:13.265 INFO:teuthology.orchestra.run.smithi159.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [15.3 kB] 2023-06-02T15:14:13.266 INFO:teuthology.orchestra.run.smithi132.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-02T15:14:13.272 INFO:teuthology.orchestra.run.smithi159.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [30.2 kB] 2023-06-02T15:14:13.287 INFO:teuthology.orchestra.run.smithi159.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [5,828 B] 2023-06-02T15:14:13.289 INFO:teuthology.orchestra.run.smithi159.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [252 B] 2023-06-02T15:14:13.363 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [909 kB] 2023-06-02T15:14:13.411 INFO:teuthology.orchestra.run.smithi159.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [909 kB] 2023-06-02T15:14:13.471 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [190 kB] 2023-06-02T15:14:13.489 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [19.6 kB] 2023-06-02T15:14:13.490 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-02T15:14:13.494 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-02T15:14:13.495 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-02T15:14:13.496 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-02T15:14:13.496 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-02T15:14:13.498 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-02T15:14:13.501 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-02T15:14:13.518 INFO:teuthology.orchestra.run.smithi159.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [190 kB] 2023-06-02T15:14:13.536 INFO:teuthology.orchestra.run.smithi159.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [19.6 kB] 2023-06-02T15:14:13.538 INFO:teuthology.orchestra.run.smithi159.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [35.3 kB] 2023-06-02T15:14:13.541 INFO:teuthology.orchestra.run.smithi159.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [3,884 B] 2023-06-02T15:14:13.542 INFO:teuthology.orchestra.run.smithi159.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [8,452 B] 2023-06-02T15:14:13.542 INFO:teuthology.orchestra.run.smithi159.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [468 B] 2023-06-02T15:14:13.543 INFO:teuthology.orchestra.run.smithi159.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [33.7 kB] 2023-06-02T15:14:13.545 INFO:teuthology.orchestra.run.smithi159.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [40.9 kB] 2023-06-02T15:14:13.548 INFO:teuthology.orchestra.run.smithi159.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [10.2 kB] 2023-06-02T15:14:13.666 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-02T15:14:13.713 INFO:teuthology.orchestra.run.smithi159.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2023-06-02T15:14:13.749 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-06-02T15:14:13.795 INFO:teuthology.orchestra.run.smithi159.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [23.4 kB] 2023-06-02T15:14:13.845 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-06-02T15:14:13.874 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-02T15:14:13.890 INFO:teuthology.orchestra.run.smithi159.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [13.9 kB] 2023-06-02T15:14:13.919 INFO:teuthology.orchestra.run.smithi159.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [15.0 kB] 2023-06-02T15:14:13.925 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-06-02T15:14:13.971 INFO:teuthology.orchestra.run.smithi159.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [548 B] 2023-06-02T15:14:16.931 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 6,644 kB in 1s (6,162 kB/s) 2023-06-02T15:14:17.418 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 6,644 kB in 2s (3,959 kB/s) 2023-06-02T15:14:18.021 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 6,644 kB in 2s (2,812 kB/s) 2023-06-02T15:14:18.036 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 6,644 kB in 2s (2,815 kB/s) 2023-06-02T15:14:18.207 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-02T15:14:18.224 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-02T15:14:18.284 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-02T15:14:18.460 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-06-02T15:14:18.460 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-06-02T15:14:18.611 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:14:18.611 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:14:18.611 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:14:18.612 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:14:18.612 INFO:teuthology.orchestra.run.smithi078.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-02T15:14:18.612 INFO:teuthology.orchestra.run.smithi078.stdout: python2.7-minimal 2023-06-02T15:14:18.612 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:14:18.613 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-06-02T15:14:18.613 INFO:teuthology.orchestra.run.smithi078.stdout: linux-generic linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-02T15:14:18.613 INFO:teuthology.orchestra.run.smithi078.stdout: linux-headers-generic linux-image-5.15.0-73-generic 2023-06-02T15:14:18.613 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-5.15.0-73-generic linux-modules-extra-5.15.0-73-generic 2023-06-02T15:14:18.614 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-06-02T15:14:18.614 INFO:teuthology.orchestra.run.smithi078.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-02T15:14:18.615 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2023-06-02T15:14:18.615 INFO:teuthology.orchestra.run.smithi078.stdout: thermald 2023-06-02T15:14:18.646 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2023-06-02T15:14:18.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-02T15:14:18.669 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-06-02T15:14:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-02T15:14:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.15.0-73-generic linux-modules-5.15.0-73-generic 2023-06-02T15:14:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-extra-5.15.0-73-generic 2023-06-02T15:14:18.670 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2023-06-02T15:14:18.670 INFO:teuthology.orchestra.run.smithi078.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-02T15:14:18.719 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2023-06-02T15:14:18.850 INFO:teuthology.orchestra.run.smithi078.stdout:3 upgraded, 5 newly installed, 0 to remove and 193 not upgraded. 2023-06-02T15:14:18.851 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 114 MB of archives. 2023-06-02T15:14:18.851 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-02T15:14:18.851 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-73-generic amd64 5.15.0-73.80 [23.2 MB] 2023-06-02T15:14:18.887 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2023-06-02T15:14:18.888 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2023-06-02T15:14:19.037 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:14:19.037 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:14:19.037 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:14:19.038 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:14:19.038 INFO:teuthology.orchestra.run.smithi132.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-02T15:14:19.038 INFO:teuthology.orchestra.run.smithi132.stdout: python2.7-minimal 2023-06-02T15:14:19.038 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:14:19.039 INFO:teuthology.orchestra.run.smithi132.stdout:The following additional packages will be installed: 2023-06-02T15:14:19.039 INFO:teuthology.orchestra.run.smithi132.stdout: linux-generic linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-02T15:14:19.039 INFO:teuthology.orchestra.run.smithi132.stdout: linux-headers-generic linux-image-5.15.0-73-generic 2023-06-02T15:14:19.040 INFO:teuthology.orchestra.run.smithi132.stdout: linux-modules-5.15.0-73-generic linux-modules-extra-5.15.0-73-generic 2023-06-02T15:14:19.040 INFO:teuthology.orchestra.run.smithi132.stdout:Suggested packages: 2023-06-02T15:14:19.040 INFO:teuthology.orchestra.run.smithi132.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-02T15:14:19.041 INFO:teuthology.orchestra.run.smithi132.stdout:Recommended packages: 2023-06-02T15:14:19.041 INFO:teuthology.orchestra.run.smithi132.stdout: thermald 2023-06-02T15:14:19.099 INFO:teuthology.orchestra.run.smithi132.stdout:The following NEW packages will be installed: 2023-06-02T15:14:19.100 INFO:teuthology.orchestra.run.smithi132.stdout: linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-02T15:14:19.100 INFO:teuthology.orchestra.run.smithi132.stdout: linux-image-5.15.0-73-generic linux-modules-5.15.0-73-generic 2023-06-02T15:14:19.100 INFO:teuthology.orchestra.run.smithi132.stdout: linux-modules-extra-5.15.0-73-generic 2023-06-02T15:14:19.100 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages will be upgraded: 2023-06-02T15:14:19.101 INFO:teuthology.orchestra.run.smithi132.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-02T15:14:19.230 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2023-06-02T15:14:19.247 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-02T15:14:19.257 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2023-06-02T15:14:19.274 DEBUG:teuthology.orchestra.run.smithi159:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-02T15:14:19.279 INFO:teuthology.orchestra.run.smithi132.stdout:3 upgraded, 5 newly installed, 0 to remove and 193 not upgraded. 2023-06-02T15:14:19.279 INFO:teuthology.orchestra.run.smithi132.stdout:Need to get 114 MB of archives. 2023-06-02T15:14:19.279 INFO:teuthology.orchestra.run.smithi132.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-02T15:14:19.279 INFO:teuthology.orchestra.run.smithi132.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-73-generic amd64 5.15.0-73.80 [23.2 MB] 2023-06-02T15:14:19.303 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2023-06-02T15:14:19.335 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2023-06-02T15:14:19.476 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2023-06-02T15:14:19.477 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2023-06-02T15:14:19.510 INFO:teuthology.orchestra.run.smithi159.stdout:Building dependency tree... 2023-06-02T15:14:19.511 INFO:teuthology.orchestra.run.smithi159.stdout:Reading state information... 2023-06-02T15:14:19.622 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:14:19.623 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:14:19.623 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:14:19.624 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:14:19.624 INFO:teuthology.orchestra.run.smithi150.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-02T15:14:19.624 INFO:teuthology.orchestra.run.smithi150.stdout: python2.7-minimal 2023-06-02T15:14:19.624 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:14:19.625 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2023-06-02T15:14:19.625 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-02T15:14:19.625 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-generic linux-image-5.15.0-73-generic 2023-06-02T15:14:19.625 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-5.15.0-73-generic linux-modules-extra-5.15.0-73-generic 2023-06-02T15:14:19.626 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2023-06-02T15:14:19.626 INFO:teuthology.orchestra.run.smithi150.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-02T15:14:19.626 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2023-06-02T15:14:19.626 INFO:teuthology.orchestra.run.smithi150.stdout: thermald 2023-06-02T15:14:19.659 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:14:19.659 INFO:teuthology.orchestra.run.smithi159.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:14:19.659 INFO:teuthology.orchestra.run.smithi159.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:14:19.660 INFO:teuthology.orchestra.run.smithi159.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:14:19.660 INFO:teuthology.orchestra.run.smithi159.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-06-02T15:14:19.660 INFO:teuthology.orchestra.run.smithi159.stdout: python2.7-minimal 2023-06-02T15:14:19.660 INFO:teuthology.orchestra.run.smithi159.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:14:19.661 INFO:teuthology.orchestra.run.smithi159.stdout:The following additional packages will be installed: 2023-06-02T15:14:19.661 INFO:teuthology.orchestra.run.smithi159.stdout: linux-generic linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-02T15:14:19.661 INFO:teuthology.orchestra.run.smithi159.stdout: linux-headers-generic linux-image-5.15.0-73-generic 2023-06-02T15:14:19.662 INFO:teuthology.orchestra.run.smithi159.stdout: linux-modules-5.15.0-73-generic linux-modules-extra-5.15.0-73-generic 2023-06-02T15:14:19.662 INFO:teuthology.orchestra.run.smithi159.stdout:Suggested packages: 2023-06-02T15:14:19.662 INFO:teuthology.orchestra.run.smithi159.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2023-06-02T15:14:19.662 INFO:teuthology.orchestra.run.smithi159.stdout:Recommended packages: 2023-06-02T15:14:19.663 INFO:teuthology.orchestra.run.smithi159.stdout: thermald 2023-06-02T15:14:19.676 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2023-06-02T15:14:19.676 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-02T15:14:19.676 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.15.0-73-generic linux-modules-5.15.0-73-generic 2023-06-02T15:14:19.676 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-extra-5.15.0-73-generic 2023-06-02T15:14:19.677 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2023-06-02T15:14:19.677 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-02T15:14:19.712 INFO:teuthology.orchestra.run.smithi159.stdout:The following NEW packages will be installed: 2023-06-02T15:14:19.712 INFO:teuthology.orchestra.run.smithi159.stdout: linux-headers-5.15.0-73 linux-headers-5.15.0-73-generic 2023-06-02T15:14:19.712 INFO:teuthology.orchestra.run.smithi159.stdout: linux-image-5.15.0-73-generic linux-modules-5.15.0-73-generic 2023-06-02T15:14:19.712 INFO:teuthology.orchestra.run.smithi159.stdout: linux-modules-extra-5.15.0-73-generic 2023-06-02T15:14:19.713 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages will be upgraded: 2023-06-02T15:14:19.713 INFO:teuthology.orchestra.run.smithi159.stdout: linux-generic linux-headers-generic linux-image-generic 2023-06-02T15:14:19.855 INFO:teuthology.orchestra.run.smithi150.stdout:3 upgraded, 5 newly installed, 0 to remove and 193 not upgraded. 2023-06-02T15:14:19.856 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 114 MB of archives. 2023-06-02T15:14:19.856 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-02T15:14:19.856 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-73-generic amd64 5.15.0-73.80 [23.2 MB] 2023-06-02T15:14:19.891 INFO:teuthology.orchestra.run.smithi159.stdout:3 upgraded, 5 newly installed, 0 to remove and 193 not upgraded. 2023-06-02T15:14:19.892 INFO:teuthology.orchestra.run.smithi159.stdout:Need to get 114 MB of archives. 2023-06-02T15:14:19.892 INFO:teuthology.orchestra.run.smithi159.stdout:After this operation, 596 MB of additional disk space will be used. 2023-06-02T15:14:19.892 INFO:teuthology.orchestra.run.smithi159.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-73-generic amd64 5.15.0-73.80 [23.2 MB] 2023-06-02T15:14:20.287 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-73-generic amd64 5.15.0-73.80 [11.4 MB] 2023-06-02T15:14:20.637 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-73-generic amd64 5.15.0-73.80 [64.2 MB] 2023-06-02T15:14:20.732 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-73-generic amd64 5.15.0-73.80 [11.4 MB] 2023-06-02T15:14:21.079 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-73-generic amd64 5.15.0-73.80 [64.2 MB] 2023-06-02T15:14:21.281 INFO:teuthology.orchestra.run.smithi159.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-73-generic amd64 5.15.0-73.80 [11.4 MB] 2023-06-02T15:14:21.369 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-73-generic amd64 5.15.0-73.80 [11.4 MB] 2023-06-02T15:14:21.626 INFO:teuthology.orchestra.run.smithi159.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-73-generic amd64 5.15.0-73.80 [64.2 MB] 2023-06-02T15:14:21.719 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-73-generic amd64 5.15.0-73.80 [64.2 MB] 2023-06-02T15:14:22.871 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.73.71 [1,698 B] 2023-06-02T15:14:22.872 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.73.71 [2,456 B] 2023-06-02T15:14:22.872 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73 all 5.15.0-73.80 [12.3 MB] 2023-06-02T15:14:23.317 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.73.71 [1,698 B] 2023-06-02T15:14:23.317 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.73.71 [2,456 B] 2023-06-02T15:14:23.318 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73 all 5.15.0-73.80 [12.3 MB] 2023-06-02T15:14:23.584 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73-generic amd64 5.15.0-73.80 [2,874 kB] 2023-06-02T15:14:23.705 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.73.71 [2,312 B] 2023-06-02T15:14:23.825 INFO:teuthology.orchestra.run.smithi159.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.73.71 [1,698 B] 2023-06-02T15:14:23.825 INFO:teuthology.orchestra.run.smithi159.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.73.71 [2,456 B] 2023-06-02T15:14:23.825 INFO:teuthology.orchestra.run.smithi159.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73 all 5.15.0-73.80 [12.3 MB] 2023-06-02T15:14:23.935 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.73.71 [1,698 B] 2023-06-02T15:14:23.986 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.73.71 [2,456 B] 2023-06-02T15:14:23.987 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73 all 5.15.0-73.80 [12.3 MB] 2023-06-02T15:14:24.077 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 114 MB in 5s (22.7 MB/s) 2023-06-02T15:14:24.195 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73-generic amd64 5.15.0-73.80 [2,874 kB] 2023-06-02T15:14:24.240 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-modules-5.15.0-73-generic. 2023-06-02T15:14:24.295 INFO:teuthology.orchestra.run.smithi159.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73-generic amd64 5.15.0-73.80 [2,874 kB] 2023-06-02T15:14:24.329 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.73.71 [2,312 B] 2023-06-02T15:14:24.352 INFO:teuthology.orchestra.run.smithi159.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.73.71 [2,312 B] 2023-06-02T15:14:24.707 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 114 MB in 5s (21.8 MB/s) 2023-06-02T15:14:24.730 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 114 MB in 5s (24.6 MB/s) 2023-06-02T15:14:24.748 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-73-generic amd64 5.15.0-73.80 [2,874 kB] 2023-06-02T15:14:24.872 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.73.71 [2,312 B] 2023-06-02T15:14:24.879 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-modules-5.15.0-73-generic. 2023-06-02T15:14:24.903 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-modules-5.15.0-73-generic. 2023-06-02T15:14:25.251 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 114 MB in 5s (22.0 MB/s) 2023-06-02T15:14:25.435 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-5.15.0-73-generic. 2023-06-02T15:14:26.358 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-02T15:14:26.362 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-linux-modules-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:26.462 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:26.911 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-02T15:14:26.913 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-02T15:14:26.913 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../0-linux-modules-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:26.917 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../0-linux-modules-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:26.984 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:27.026 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:27.454 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2023-06-02T15:14:27.459 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../0-linux-modules-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:27.524 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:29.144 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-image-5.15.0-73-generic. 2023-06-02T15:14:29.166 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../1-linux-image-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:29.263 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:29.312 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-image-5.15.0-73-generic. 2023-06-02T15:14:29.334 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-linux-image-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:29.425 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:29.668 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-image-5.15.0-73-generic. 2023-06-02T15:14:29.689 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../1-linux-image-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:29.714 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-73-generic. 2023-06-02T15:14:29.734 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:29.772 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:29.775 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:29.932 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-73-generic. 2023-06-02T15:14:29.953 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:30.011 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:30.050 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-image-5.15.0-73-generic. 2023-06-02T15:14:30.072 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../1-linux-image-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:30.166 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:30.273 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-73-generic. 2023-06-02T15:14:30.292 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:30.330 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:30.620 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-73-generic. 2023-06-02T15:14:30.641 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:30.678 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:35.935 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../3-linux-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:36.060 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:36.401 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:36.421 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../3-linux-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:36.522 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-image-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:36.531 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:36.586 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-linux-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:36.702 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:36.800 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-headers-5.15.0-73. 2023-06-02T15:14:36.811 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../5-linux-headers-5.15.0-73_5.15.0-73.80_all.deb ... 2023-06-02T15:14:36.850 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-02T15:14:36.882 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:37.010 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:37.050 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:37.149 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../3-linux-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:37.205 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:37.299 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:37.304 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.15.0-73. 2023-06-02T15:14:37.327 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../5-linux-headers-5.15.0-73_5.15.0-73.80_all.deb ... 2023-06-02T15:14:37.363 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-02T15:14:37.517 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-headers-5.15.0-73. 2023-06-02T15:14:37.540 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-linux-headers-5.15.0-73_5.15.0-73.80_all.deb ... 2023-06-02T15:14:37.600 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-02T15:14:37.615 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:37.744 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-image-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:38.022 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-headers-5.15.0-73. 2023-06-02T15:14:38.045 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../5-linux-headers-5.15.0-73_5.15.0-73.80_all.deb ... 2023-06-02T15:14:38.089 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-02T15:14:42.628 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package linux-headers-5.15.0-73-generic. 2023-06-02T15:14:42.665 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../6-linux-headers-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:42.703 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:43.225 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.15.0-73-generic. 2023-06-02T15:14:43.245 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../6-linux-headers-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:43.284 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:43.766 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-headers-5.15.0-73-generic. 2023-06-02T15:14:43.802 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../6-linux-headers-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:43.841 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:43.868 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package linux-headers-5.15.0-73-generic. 2023-06-02T15:14:43.905 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../6-linux-headers-5.15.0-73-generic_5.15.0-73.80_amd64.deb ... 2023-06-02T15:14:43.942 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:45.215 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:45.341 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking linux-headers-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:45.656 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-02T15:14:45.904 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:45.932 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:46.030 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-headers-generic (5.15.0.73.71) ... 2023-06-02T15:14:46.054 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:46.160 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:46.379 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-02T15:14:46.501 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:46.597 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:46.627 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-generic (5.15.0.73.71) ... 2023-06-02T15:14:46.728 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:46.756 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:47.479 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-02T15:14:47.491 INFO:teuthology.orchestra.run.smithi159.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:14:47.491 INFO:teuthology.orchestra.run.smithi159.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-02T15:14:47.492 INFO:teuthology.orchestra.run.smithi159.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:14:47.492 INFO:teuthology.orchestra.run.smithi159.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-73-generic 2023-06-02T15:14:47.505 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.73.71_amd64.deb ... 2023-06-02T15:14:47.625 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:47.646 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking linux-headers-generic (5.15.0.73.71) over (5.15.0.56.54) ... 2023-06-02T15:14:47.660 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:47.751 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-generic (5.15.0.73.71) ... 2023-06-02T15:14:47.881 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:48.021 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-headers-5.15.0-73 (5.15.0-73.80) ... 2023-06-02T15:14:48.143 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-headers-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:48.172 INFO:teuthology.orchestra.run.smithi150.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:14:48.173 INFO:teuthology.orchestra.run.smithi150.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-02T15:14:48.173 INFO:teuthology.orchestra.run.smithi150.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:14:48.173 INFO:teuthology.orchestra.run.smithi150.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-73-generic 2023-06-02T15:14:48.269 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-headers-generic (5.15.0.73.71) ... 2023-06-02T15:14:48.332 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:48.415 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:49.070 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:49.181 INFO:teuthology.orchestra.run.smithi078.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:14:49.181 INFO:teuthology.orchestra.run.smithi078.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-02T15:14:49.181 INFO:teuthology.orchestra.run.smithi078.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:14:49.182 INFO:teuthology.orchestra.run.smithi078.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-73-generic 2023-06-02T15:14:49.366 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:49.709 INFO:teuthology.orchestra.run.smithi132.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:14:49.710 INFO:teuthology.orchestra.run.smithi132.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2023-06-02T15:14:49.710 INFO:teuthology.orchestra.run.smithi132.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:14:49.710 INFO:teuthology.orchestra.run.smithi132.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-73-generic 2023-06-02T15:14:49.734 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:49.867 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-modules-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:50.488 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-image-generic (5.15.0.73.71) ... 2023-06-02T15:14:50.614 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up linux-generic (5.15.0.73.71) ... 2023-06-02T15:14:50.740 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:50.759 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:50.809 INFO:teuthology.orchestra.run.smithi159.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-02T15:14:50.809 INFO:teuthology.orchestra.run.smithi159.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:14:51.143 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-generic (5.15.0.73.71) ... 2023-06-02T15:14:51.269 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-generic (5.15.0.73.71) ... 2023-06-02T15:14:51.318 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-modules-extra-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:51.395 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:51.463 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-02T15:14:51.463 INFO:teuthology.orchestra.run.smithi150.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:14:52.151 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-generic (5.15.0.73.71) ... 2023-06-02T15:14:52.944 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-generic (5.15.0.73.71) ... 2023-06-02T15:14:53.036 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-image-generic (5.15.0.73.71) ... 2023-06-02T15:14:53.079 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:53.146 INFO:teuthology.orchestra.run.smithi078.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-02T15:14:53.147 INFO:teuthology.orchestra.run.smithi078.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:14:53.162 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up linux-generic (5.15.0.73.71) ... 2023-06-02T15:14:53.280 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for linux-image-5.15.0-73-generic (5.15.0-73.80) ... 2023-06-02T15:14:53.351 INFO:teuthology.orchestra.run.smithi132.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-06-02T15:14:53.351 INFO:teuthology.orchestra.run.smithi132.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:15:04.920 INFO:teuthology.orchestra.run.smithi159.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-02T15:15:04.921 INFO:teuthology.orchestra.run.smithi159.stdout:Sourcing file `/etc/default/grub' 2023-06-02T15:15:04.941 INFO:teuthology.orchestra.run.smithi159.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-02T15:15:04.954 INFO:teuthology.orchestra.run.smithi159.stdout:Generating grub configuration file ... 2023-06-02T15:15:05.190 INFO:teuthology.orchestra.run.smithi159.stdout:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:15:05.209 INFO:teuthology.orchestra.run.smithi159.stdout:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:15:05.210 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-02T15:15:05.211 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub' 2023-06-02T15:15:05.227 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-02T15:15:05.250 INFO:teuthology.orchestra.run.smithi150.stdout:Generating grub configuration file ... 2023-06-02T15:15:05.526 INFO:teuthology.orchestra.run.smithi159.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:15:05.530 INFO:teuthology.orchestra.run.smithi159.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-02T15:15:05.555 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:15:05.582 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:15:05.605 INFO:teuthology.orchestra.run.smithi159.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-02T15:15:05.610 INFO:teuthology.orchestra.run.smithi159.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-02T15:15:05.769 INFO:teuthology.orchestra.run.smithi159.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-02T15:15:05.769 INFO:teuthology.orchestra.run.smithi159.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-02T15:15:05.769 INFO:teuthology.orchestra.run.smithi159.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-02T15:15:05.819 INFO:teuthology.orchestra.run.smithi159.stdout:done 2023-06-02T15:15:05.903 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:15:05.909 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-02T15:15:05.978 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-02T15:15:05.983 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-02T15:15:06.140 INFO:teuthology.orchestra.run.smithi150.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-02T15:15:06.141 INFO:teuthology.orchestra.run.smithi150.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-02T15:15:06.141 INFO:teuthology.orchestra.run.smithi150.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-02T15:15:06.188 INFO:teuthology.orchestra.run.smithi150.stdout:done 2023-06-02T15:15:06.284 DEBUG:teuthology.orchestra.run.smithi159:> dpkg -s linux-image-generic 2023-06-02T15:15:06.348 INFO:teuthology.orchestra.run.smithi159.stdout:Package: linux-image-generic 2023-06-02T15:15:06.349 INFO:teuthology.orchestra.run.smithi159.stdout:Status: install ok installed 2023-06-02T15:15:06.349 INFO:teuthology.orchestra.run.smithi159.stdout:Priority: optional 2023-06-02T15:15:06.349 INFO:teuthology.orchestra.run.smithi159.stdout:Section: kernel 2023-06-02T15:15:06.349 INFO:teuthology.orchestra.run.smithi159.stdout:Installed-Size: 20 2023-06-02T15:15:06.349 INFO:teuthology.orchestra.run.smithi159.stdout:Maintainer: Ubuntu Kernel Team 2023-06-02T15:15:06.349 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: amd64 2023-06-02T15:15:06.349 INFO:teuthology.orchestra.run.smithi159.stdout:Source: linux-meta 2023-06-02T15:15:06.350 INFO:teuthology.orchestra.run.smithi159.stdout:Version: 5.15.0.73.71 2023-06-02T15:15:06.350 INFO:teuthology.orchestra.run.smithi159.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-02T15:15:06.350 INFO:teuthology.orchestra.run.smithi159.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-02T15:15:06.350 INFO:teuthology.orchestra.run.smithi159.stdout:Recommends: thermald 2023-06-02T15:15:06.350 INFO:teuthology.orchestra.run.smithi159.stdout:Description: Generic Linux kernel image 2023-06-02T15:15:06.350 INFO:teuthology.orchestra.run.smithi159.stdout: This package will always depend on the latest generic kernel image 2023-06-02T15:15:06.350 INFO:teuthology.orchestra.run.smithi159.stdout: available. 2023-06-02T15:15:06.351 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-73-generic 2023-06-02T15:15:06.351 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-02T15:15:06.351 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-02T15:15:06.351 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-06-02T15:15:06.351 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=None, version=distro) 2023-06-02T15:15:06.351 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get clean 2023-06-02T15:15:06.513 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get update 2023-06-02T15:15:06.624 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:15:06.629 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2023-06-02T15:15:06.634 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-02T15:15:06.651 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-02T15:15:06.653 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2023-06-02T15:15:06.653 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2023-06-02T15:15:06.653 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2023-06-02T15:15:06.654 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2023-06-02T15:15:06.654 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 20 2023-06-02T15:15:06.654 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2023-06-02T15:15:06.654 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2023-06-02T15:15:06.654 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2023-06-02T15:15:06.654 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.15.0.73.71 2023-06-02T15:15:06.654 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-02T15:15:06.654 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-02T15:15:06.655 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2023-06-02T15:15:06.655 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2023-06-02T15:15:06.655 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2023-06-02T15:15:06.655 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2023-06-02T15:15:06.655 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-73-generic 2023-06-02T15:15:06.655 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-02T15:15:06.656 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-02T15:15:06.656 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-06-02T15:15:06.656 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2023-06-02T15:15:06.656 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2023-06-02T15:15:06.746 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-02T15:15:06.804 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2023-06-02T15:15:07.059 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:15:07.060 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-02T15:15:07.130 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-02T15:15:07.212 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-02T15:15:07.325 INFO:teuthology.orchestra.run.smithi078.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-02T15:15:07.325 INFO:teuthology.orchestra.run.smithi078.stdout:Sourcing file `/etc/default/grub' 2023-06-02T15:15:07.340 INFO:teuthology.orchestra.run.smithi078.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-02T15:15:07.365 INFO:teuthology.orchestra.run.smithi078.stdout:Generating grub configuration file ... 2023-06-02T15:15:07.434 INFO:teuthology.orchestra.run.smithi132.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-06-02T15:15:07.434 INFO:teuthology.orchestra.run.smithi132.stdout:Sourcing file `/etc/default/grub' 2023-06-02T15:15:07.450 INFO:teuthology.orchestra.run.smithi132.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-02T15:15:07.465 INFO:teuthology.orchestra.run.smithi132.stdout:Generating grub configuration file ... 2023-06-02T15:15:07.686 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:15:07.713 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:15:07.799 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2023-06-02T15:15:07.813 INFO:teuthology.orchestra.run.smithi132.stdout:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:15:07.815 DEBUG:teuthology.orchestra.run.smithi159:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-02T15:15:07.827 INFO:teuthology.orchestra.run.smithi132.stdout:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:15:07.866 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2023-06-02T15:15:08.029 INFO:teuthology.orchestra.run.smithi159.stdout:Building dependency tree... 2023-06-02T15:15:08.030 INFO:teuthology.orchestra.run.smithi159.stdout:Reading state information... 2023-06-02T15:15:08.040 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:15:08.046 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-02T15:15:08.118 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-02T15:15:08.123 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-02T15:15:08.148 INFO:teuthology.orchestra.run.smithi132.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:15:08.154 INFO:teuthology.orchestra.run.smithi132.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-02T15:15:08.162 INFO:teuthology.orchestra.run.smithi159.stdout:linux-image-generic is already the newest version (5.15.0.73.71). 2023-06-02T15:15:08.162 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:15:08.162 INFO:teuthology.orchestra.run.smithi159.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:15:08.162 INFO:teuthology.orchestra.run.smithi159.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:15:08.162 INFO:teuthology.orchestra.run.smithi159.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:15:08.163 INFO:teuthology.orchestra.run.smithi159.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:15:08.163 INFO:teuthology.orchestra.run.smithi159.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:15:08.163 INFO:teuthology.orchestra.run.smithi159.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:15:08.199 INFO:teuthology.orchestra.run.smithi159.stdout:0 upgraded, 0 newly installed, 0 to remove and 193 not upgraded. 2023-06-02T15:15:08.201 DEBUG:teuthology.orchestra.run.smithi159:> dpkg -s linux-image-generic 2023-06-02T15:15:08.214 INFO:teuthology.orchestra.run.smithi132.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-02T15:15:08.220 INFO:teuthology.orchestra.run.smithi132.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-02T15:15:08.254 INFO:teuthology.orchestra.run.smithi159.stdout:Package: linux-image-generic 2023-06-02T15:15:08.254 INFO:teuthology.orchestra.run.smithi159.stdout:Status: install ok installed 2023-06-02T15:15:08.254 INFO:teuthology.orchestra.run.smithi159.stdout:Priority: optional 2023-06-02T15:15:08.254 INFO:teuthology.orchestra.run.smithi159.stdout:Section: kernel 2023-06-02T15:15:08.254 INFO:teuthology.orchestra.run.smithi159.stdout:Installed-Size: 20 2023-06-02T15:15:08.254 INFO:teuthology.orchestra.run.smithi159.stdout:Maintainer: Ubuntu Kernel Team 2023-06-02T15:15:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: amd64 2023-06-02T15:15:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:Source: linux-meta 2023-06-02T15:15:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:Version: 5.15.0.73.71 2023-06-02T15:15:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-02T15:15:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-02T15:15:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:Recommends: thermald 2023-06-02T15:15:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:Description: Generic Linux kernel image 2023-06-02T15:15:08.256 INFO:teuthology.orchestra.run.smithi159.stdout: This package will always depend on the latest generic kernel image 2023-06-02T15:15:08.256 INFO:teuthology.orchestra.run.smithi159.stdout: available. 2023-06-02T15:15:08.256 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2023-06-02T15:15:08.302 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.F4sngAOqwm 2023-06-02T15:15:08.302 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub/grub.cfg /tmp/tmp.F4sngAOqwm 2023-06-02T15:15:08.303 INFO:teuthology.orchestra.run.smithi078.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-02T15:15:08.304 INFO:teuthology.orchestra.run.smithi078.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-02T15:15:08.304 INFO:teuthology.orchestra.run.smithi078.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-02T15:15:08.309 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2023-06-02T15:15:08.326 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-02T15:15:08.347 INFO:teuthology.orchestra.run.smithi078.stdout:done 2023-06-02T15:15:08.358 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.F4sngAOqwm 2023-06-02T15:15:08.374 INFO:teuthology.orchestra.run.smithi132.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-02T15:15:08.374 INFO:teuthology.orchestra.run.smithi132.stdout:Systems on them will not be added to the GRUB boot configuration. 2023-06-02T15:15:08.374 INFO:teuthology.orchestra.run.smithi132.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-02T15:15:08.385 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2023-06-02T15:15:08.422 INFO:teuthology.orchestra.run.smithi132.stdout:done 2023-06-02T15:15:08.473 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.F4sngAOqwm is 10KB 2023-06-02T15:15:08.485 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.F4sngAOqwm 2023-06-02T15:15:08.490 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-02T15:15:08.540 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:15:08.541 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-02T15:15:08.541 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-02T15:15:08.560 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2023-06-02T15:15:08.560 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2023-06-02T15:15:08.617 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-73-generic 2023-06-02T15:15:08.617 DEBUG:teuthology.orchestra.run.smithi159:> sudo update-grub 2023-06-02T15:15:08.712 INFO:teuthology.orchestra.run.smithi150.stdout:linux-image-generic is already the newest version (5.15.0.73.71). 2023-06-02T15:15:08.712 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:15:08.712 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:15:08.713 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:15:08.713 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:15:08.713 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:15:08.713 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:15:08.713 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:15:08.749 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 0 newly installed, 0 to remove and 193 not upgraded. 2023-06-02T15:15:08.750 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2023-06-02T15:15:08.805 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2023-06-02T15:15:08.806 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2023-06-02T15:15:08.806 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2023-06-02T15:15:08.806 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2023-06-02T15:15:08.806 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 20 2023-06-02T15:15:08.806 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2023-06-02T15:15:08.806 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2023-06-02T15:15:08.806 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2023-06-02T15:15:08.807 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.15.0.73.71 2023-06-02T15:15:08.807 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-02T15:15:08.807 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-02T15:15:08.807 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2023-06-02T15:15:08.807 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2023-06-02T15:15:08.807 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2023-06-02T15:15:08.807 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2023-06-02T15:15:08.808 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2023-06-02T15:15:08.809 DEBUG:teuthology.orchestra.run.smithi078:> dpkg -s linux-image-generic 2023-06-02T15:15:08.832 INFO:teuthology.orchestra.run.smithi078.stdout:Package: linux-image-generic 2023-06-02T15:15:08.832 INFO:teuthology.orchestra.run.smithi078.stdout:Status: install ok installed 2023-06-02T15:15:08.832 INFO:teuthology.orchestra.run.smithi078.stdout:Priority: optional 2023-06-02T15:15:08.832 INFO:teuthology.orchestra.run.smithi078.stdout:Section: kernel 2023-06-02T15:15:08.832 INFO:teuthology.orchestra.run.smithi078.stdout:Installed-Size: 20 2023-06-02T15:15:08.833 INFO:teuthology.orchestra.run.smithi078.stdout:Maintainer: Ubuntu Kernel Team 2023-06-02T15:15:08.833 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: amd64 2023-06-02T15:15:08.833 INFO:teuthology.orchestra.run.smithi078.stdout:Source: linux-meta 2023-06-02T15:15:08.833 INFO:teuthology.orchestra.run.smithi078.stdout:Version: 5.15.0.73.71 2023-06-02T15:15:08.833 INFO:teuthology.orchestra.run.smithi078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-02T15:15:08.833 INFO:teuthology.orchestra.run.smithi078.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-02T15:15:08.833 INFO:teuthology.orchestra.run.smithi078.stdout:Recommends: thermald 2023-06-02T15:15:08.834 INFO:teuthology.orchestra.run.smithi078.stdout:Description: Generic Linux kernel image 2023-06-02T15:15:08.834 INFO:teuthology.orchestra.run.smithi078.stdout: This package will always depend on the latest generic kernel image 2023-06-02T15:15:08.834 INFO:teuthology.orchestra.run.smithi078.stdout: available. 2023-06-02T15:15:08.834 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-73-generic 2023-06-02T15:15:08.834 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-02T15:15:08.834 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-02T15:15:08.835 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-06-02T15:15:08.835 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2023-06-02T15:15:08.835 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get clean 2023-06-02T15:15:08.851 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.6fTcWcZUZH 2023-06-02T15:15:08.852 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub/grub.cfg /tmp/tmp.6fTcWcZUZH 2023-06-02T15:15:08.872 DEBUG:teuthology.orchestra.run.smithi132:> dpkg -s linux-image-generic 2023-06-02T15:15:08.892 INFO:teuthology.orchestra.run.smithi132.stdout:Package: linux-image-generic 2023-06-02T15:15:08.893 INFO:teuthology.orchestra.run.smithi132.stdout:Status: install ok installed 2023-06-02T15:15:08.893 INFO:teuthology.orchestra.run.smithi132.stdout:Priority: optional 2023-06-02T15:15:08.893 INFO:teuthology.orchestra.run.smithi132.stdout:Section: kernel 2023-06-02T15:15:08.893 INFO:teuthology.orchestra.run.smithi132.stdout:Installed-Size: 20 2023-06-02T15:15:08.894 INFO:teuthology.orchestra.run.smithi132.stdout:Maintainer: Ubuntu Kernel Team 2023-06-02T15:15:08.894 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: amd64 2023-06-02T15:15:08.894 INFO:teuthology.orchestra.run.smithi132.stdout:Source: linux-meta 2023-06-02T15:15:08.894 INFO:teuthology.orchestra.run.smithi132.stdout:Version: 5.15.0.73.71 2023-06-02T15:15:08.894 INFO:teuthology.orchestra.run.smithi132.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-02T15:15:08.894 INFO:teuthology.orchestra.run.smithi132.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-02T15:15:08.894 INFO:teuthology.orchestra.run.smithi132.stdout:Recommends: thermald 2023-06-02T15:15:08.894 INFO:teuthology.orchestra.run.smithi132.stdout:Description: Generic Linux kernel image 2023-06-02T15:15:08.895 INFO:teuthology.orchestra.run.smithi132.stdout: This package will always depend on the latest generic kernel image 2023-06-02T15:15:08.895 INFO:teuthology.orchestra.run.smithi132.stdout: available. 2023-06-02T15:15:08.895 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-73-generic 2023-06-02T15:15:08.895 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-06-02T15:15:08.895 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-06-02T15:15:08.896 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-06-02T15:15:08.896 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=None, version=distro) 2023-06-02T15:15:08.896 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get clean 2023-06-02T15:15:08.908 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.6fTcWcZUZH 2023-06-02T15:15:09.018 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.6fTcWcZUZH is 10KB 2023-06-02T15:15:09.021 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2023-06-02T15:15:09.030 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.6fTcWcZUZH 2023-06-02T15:15:09.035 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-02T15:15:09.052 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get update 2023-06-02T15:15:09.091 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:15:09.091 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-02T15:15:09.091 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-02T15:15:09.159 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-73-generic 2023-06-02T15:15:09.159 DEBUG:teuthology.orchestra.run.smithi150:> sudo update-grub 2023-06-02T15:15:09.273 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-02T15:15:09.274 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:15:09.301 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:15:09.301 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-02T15:15:09.346 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-02T15:15:09.372 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-02T15:15:09.428 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-02T15:15:09.454 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-02T15:15:09.640 INFO:teuthology.orchestra.run.smithi159.stderr:Sourcing file `/etc/default/grub' 2023-06-02T15:15:09.641 INFO:teuthology.orchestra.run.smithi159.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-02T15:15:09.644 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2023-06-02T15:15:09.827 INFO:teuthology.orchestra.run.smithi159.stderr:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:15:09.833 INFO:teuthology.orchestra.run.smithi159.stderr:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:15:10.065 INFO:teuthology.orchestra.run.smithi159.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:15:10.071 INFO:teuthology.orchestra.run.smithi159.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-02T15:15:10.109 INFO:teuthology.orchestra.run.smithi159.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-02T15:15:10.113 INFO:teuthology.orchestra.run.smithi159.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-02T15:15:10.175 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub' 2023-06-02T15:15:10.177 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-02T15:15:10.180 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2023-06-02T15:15:10.227 INFO:teuthology.orchestra.run.smithi159.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-02T15:15:10.227 INFO:teuthology.orchestra.run.smithi159.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-02T15:15:10.228 INFO:teuthology.orchestra.run.smithi159.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-02T15:15:10.241 INFO:teuthology.orchestra.run.smithi159.stderr:done 2023-06-02T15:15:10.260 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2023-06-02T15:15:10.344 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:15:10.351 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:15:10.504 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-02T15:15:10.520 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-02T15:15:10.561 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2023-06-02T15:15:10.579 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-06-02T15:15:10.582 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-02T15:15:10.636 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:15:10.640 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2023-06-02T15:15:10.641 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-02T15:15:10.685 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-02T15:15:10.690 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-02T15:15:10.757 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-06-02T15:15:10.758 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-06-02T15:15:10.825 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2023-06-02T15:15:10.825 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2023-06-02T15:15:10.826 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-02T15:15:10.826 INFO:teuthology.orchestra.run.smithi150.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-02T15:15:10.826 INFO:teuthology.orchestra.run.smithi150.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-02T15:15:10.843 INFO:teuthology.orchestra.run.smithi150.stderr:done 2023-06-02T15:15:10.846 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2023-06-02T15:15:10.908 INFO:teuthology.orchestra.run.smithi078.stdout:linux-image-generic is already the newest version (5.15.0.73.71). 2023-06-02T15:15:10.909 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:15:10.909 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:15:10.909 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:15:10.909 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:15:10.909 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:15:10.910 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:15:10.910 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:15:10.943 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 0 newly installed, 0 to remove and 193 not upgraded. 2023-06-02T15:15:10.945 DEBUG:teuthology.orchestra.run.smithi078:> dpkg -s linux-image-generic 2023-06-02T15:15:10.960 INFO:teuthology.orchestra.run.smithi078.stdout:Package: linux-image-generic 2023-06-02T15:15:10.960 INFO:teuthology.orchestra.run.smithi078.stdout:Status: install ok installed 2023-06-02T15:15:10.961 INFO:teuthology.orchestra.run.smithi078.stdout:Priority: optional 2023-06-02T15:15:10.961 INFO:teuthology.orchestra.run.smithi078.stdout:Section: kernel 2023-06-02T15:15:10.961 INFO:teuthology.orchestra.run.smithi078.stdout:Installed-Size: 20 2023-06-02T15:15:10.961 INFO:teuthology.orchestra.run.smithi078.stdout:Maintainer: Ubuntu Kernel Team 2023-06-02T15:15:10.961 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: amd64 2023-06-02T15:15:10.961 INFO:teuthology.orchestra.run.smithi078.stdout:Source: linux-meta 2023-06-02T15:15:10.961 INFO:teuthology.orchestra.run.smithi078.stdout:Version: 5.15.0.73.71 2023-06-02T15:15:10.962 INFO:teuthology.orchestra.run.smithi078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-02T15:15:10.962 INFO:teuthology.orchestra.run.smithi078.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-02T15:15:10.962 INFO:teuthology.orchestra.run.smithi078.stdout:Recommends: thermald 2023-06-02T15:15:10.962 INFO:teuthology.orchestra.run.smithi078.stdout:Description: Generic Linux kernel image 2023-06-02T15:15:10.962 INFO:teuthology.orchestra.run.smithi078.stdout: This package will always depend on the latest generic kernel image 2023-06-02T15:15:10.962 INFO:teuthology.orchestra.run.smithi078.stdout: available. 2023-06-02T15:15:10.963 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-06-02T15:15:10.976 INFO:teuthology.orchestra.run.smithi132.stdout:linux-image-generic is already the newest version (5.15.0.73.71). 2023-06-02T15:15:10.977 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:15:10.977 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:15:10.977 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:15:10.977 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:15:10.977 INFO:teuthology.orchestra.run.smithi132.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:15:10.978 INFO:teuthology.orchestra.run.smithi132.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:15:10.978 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:15:11.005 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.UzA08ldgh4 2023-06-02T15:15:11.006 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub/grub.cfg /tmp/tmp.UzA08ldgh4 2023-06-02T15:15:11.011 INFO:teuthology.orchestra.run.smithi132.stdout:0 upgraded, 0 newly installed, 0 to remove and 193 not upgraded. 2023-06-02T15:15:11.013 DEBUG:teuthology.orchestra.run.smithi132:> dpkg -s linux-image-generic 2023-06-02T15:15:11.030 INFO:teuthology.orchestra.run.smithi132.stdout:Package: linux-image-generic 2023-06-02T15:15:11.031 INFO:teuthology.orchestra.run.smithi132.stdout:Status: install ok installed 2023-06-02T15:15:11.031 INFO:teuthology.orchestra.run.smithi132.stdout:Priority: optional 2023-06-02T15:15:11.031 INFO:teuthology.orchestra.run.smithi132.stdout:Section: kernel 2023-06-02T15:15:11.031 INFO:teuthology.orchestra.run.smithi132.stdout:Installed-Size: 20 2023-06-02T15:15:11.031 INFO:teuthology.orchestra.run.smithi132.stdout:Maintainer: Ubuntu Kernel Team 2023-06-02T15:15:11.032 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: amd64 2023-06-02T15:15:11.032 INFO:teuthology.orchestra.run.smithi132.stdout:Source: linux-meta 2023-06-02T15:15:11.032 INFO:teuthology.orchestra.run.smithi132.stdout:Version: 5.15.0.73.71 2023-06-02T15:15:11.032 INFO:teuthology.orchestra.run.smithi132.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.1), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-73), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.1) 2023-06-02T15:15:11.032 INFO:teuthology.orchestra.run.smithi132.stdout:Depends: linux-image-5.15.0-73-generic, linux-modules-extra-5.15.0-73-generic, linux-firmware, intel-microcode, amd64-microcode 2023-06-02T15:15:11.032 INFO:teuthology.orchestra.run.smithi132.stdout:Recommends: thermald 2023-06-02T15:15:11.032 INFO:teuthology.orchestra.run.smithi132.stdout:Description: Generic Linux kernel image 2023-06-02T15:15:11.033 INFO:teuthology.orchestra.run.smithi132.stdout: This package will always depend on the latest generic kernel image 2023-06-02T15:15:11.033 INFO:teuthology.orchestra.run.smithi132.stdout: available. 2023-06-02T15:15:11.033 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-06-02T15:15:11.061 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.UzA08ldgh4 2023-06-02T15:15:11.082 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.KMyPfidefI 2023-06-02T15:15:11.082 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KMyPfidefI 2023-06-02T15:15:11.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.KMyPfidefI 2023-06-02T15:15:11.187 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.UzA08ldgh4 is 10KB 2023-06-02T15:15:11.199 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.UzA08ldgh4 2023-06-02T15:15:11.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-02T15:15:11.251 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.KMyPfidefI is 10KB 2023-06-02T15:15:11.257 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:15:11.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-02T15:15:11.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-02T15:15:11.265 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.KMyPfidefI 2023-06-02T15:15:11.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-06-02T15:15:11.321 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-73-generic 2023-06-02T15:15:11.321 DEBUG:teuthology.orchestra.run.smithi078:> sudo update-grub 2023-06-02T15:15:11.325 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:15:11.325 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-06-02T15:15:11.325 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-06-02T15:15:11.388 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-73-generic 2023-06-02T15:15:11.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo update-grub 2023-06-02T15:15:12.498 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2023-06-02T15:15:12.500 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-02T15:15:12.503 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2023-06-02T15:15:12.524 INFO:teuthology.orchestra.run.smithi132.stderr:Sourcing file `/etc/default/grub' 2023-06-02T15:15:12.526 INFO:teuthology.orchestra.run.smithi132.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-06-02T15:15:12.528 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2023-06-02T15:15:12.723 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:15:12.729 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:15:12.741 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-73-generic 2023-06-02T15:15:12.747 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-73-generic 2023-06-02T15:15:12.959 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:15:12.964 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-02T15:15:12.983 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-06-02T15:15:12.988 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-06-02T15:15:13.007 INFO:teuthology.orchestra.run.smithi132.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-02T15:15:13.012 INFO:teuthology.orchestra.run.smithi132.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-02T15:15:13.029 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-06-02T15:15:13.035 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-06-02T15:15:13.157 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-02T15:15:13.158 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-02T15:15:13.158 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-02T15:15:13.179 INFO:teuthology.orchestra.run.smithi132.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-06-02T15:15:13.179 INFO:teuthology.orchestra.run.smithi132.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-06-02T15:15:13.180 INFO:teuthology.orchestra.run.smithi132.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-06-02T15:15:13.190 INFO:teuthology.orchestra.run.smithi078.stderr:done 2023-06-02T15:15:13.192 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2023-06-02T15:15:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:done 2023-06-02T15:15:13.200 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2023-06-02T15:15:40.288 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-06-02T15:15:40.288 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-06-02T15:15:40.289 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:15:40.849 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-06-02T15:15:40.850 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-06-02T15:15:40.850 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:15:43.196 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-06-02T15:15:43.197 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-02T15:15:43.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:15:43.202 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-06-02T15:15:43.203 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-06-02T15:15:43.203 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:15:58.704 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.159 2023-06-02T15:15:59.220 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-06-02T15:16:01.520 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-02T15:16:01.521 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-06-02T15:16:28.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-06-02T15:16:28.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:16:29.221 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-06-02T15:16:29.222 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:16:31.523 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-02T15:16:31.524 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:16:31.525 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-06-02T15:16:31.526 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:16:34.580 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-06-02T15:16:34.581 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.132 2023-06-02T15:17:00.492 DEBUG:teuthology.orchestra.remote:No existing session 2023-06-02T15:17:00.657 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2023-06-02T15:17:04.586 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-02T15:17:04.587 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:17:04.588 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-06-02T15:17:04.588 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:17:04.721 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-06-02T15:17:04.747 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-06-02T15:17:05.266 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-06-02T15:17:05.266 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-73-generic"... 2023-06-02T15:17:05.267 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-06-02T15:17:05.311 INFO:teuthology.orchestra.run.smithi132.stdout:5.15.0-73-generic 2023-06-02T15:17:05.311 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-73-generic vs 5.15.0-73-generic 2023-06-02T15:17:05.311 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-02T15:17:05.312 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-02T15:17:05.374 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-02T15:17:05.375 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-73-generic"... 2023-06-02T15:17:05.375 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-06-02T15:17:05.420 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-73-generic 2023-06-02T15:17:05.420 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-73-generic vs 5.15.0-73-generic 2023-06-02T15:17:05.420 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-02T15:17:05.421 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-02T15:17:06.313 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-06-02T15:17:06.313 DEBUG:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-02T15:17:06.421 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-06-02T15:17:06.422 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-02T15:17:06.478 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2023-06-02T15:17:06.511 DEBUG:teuthology.parallel:result is None 2023-06-02T15:17:06.693 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2023-06-02T15:17:06.717 DEBUG:teuthology.parallel:result is None 2023-06-02T15:17:30.501 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-06-02T15:17:30.501 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:17:30.587 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-06-02T15:17:30.658 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-06-02T15:17:30.659 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:17:31.040 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-06-02T15:17:31.175 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-06-02T15:17:31.175 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.15.0-73-generic"... 2023-06-02T15:17:31.175 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2023-06-02T15:17:31.221 INFO:teuthology.orchestra.run.smithi159.stdout:5.15.0-73-generic 2023-06-02T15:17:31.221 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-73-generic vs 5.15.0-73-generic 2023-06-02T15:17:31.221 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-02T15:17:31.222 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-02T15:17:31.600 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-06-02T15:17:31.600 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.15.0-73-generic"... 2023-06-02T15:17:31.600 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2023-06-02T15:17:31.647 INFO:teuthology.orchestra.run.smithi150.stdout:5.15.0-73-generic 2023-06-02T15:17:31.647 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-73-generic vs 5.15.0-73-generic 2023-06-02T15:17:31.648 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-06-02T15:17:31.648 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-06-02T15:17:32.223 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2023-06-02T15:17:32.223 DEBUG:teuthology.orchestra.run.smithi159:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-02T15:17:32.303 INFO:teuthology.orchestra.run.smithi159.stdout:ttyS1 2023-06-02T15:17:32.331 DEBUG:teuthology.parallel:result is None 2023-06-02T15:17:32.650 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2023-06-02T15:17:32.651 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-06-02T15:17:32.746 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2023-06-02T15:17:32.776 DEBUG:teuthology.parallel:result is None 2023-06-02T15:17:32.777 INFO:teuthology.run_tasks:Running task internal.base... 2023-06-02T15:17:32.788 INFO:teuthology.task.internal:Creating test directory... 2023-06-02T15:17:32.789 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-02T15:17:32.792 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-02T15:17:32.795 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-02T15:17:32.798 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-06-02T15:17:32.804 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-06-02T15:17:32.820 INFO:teuthology.run_tasks:Running task internal.archive... 2023-06-02T15:17:32.831 INFO:teuthology.task.internal:Creating archive directory... 2023-06-02T15:17:32.831 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-02T15:17:32.842 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-02T15:17:32.845 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-02T15:17:32.847 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-06-02T15:17:32.922 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-06-02T15:17:32.930 INFO:teuthology.task.internal:Enabling coredump saving... 2023-06-02T15:17:32.931 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-02T15:17:32.933 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-02T15:17:32.937 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-02T15:17:32.940 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-06-02T15:17:32.949 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-02T15:17:32.956 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-02T15:17:32.958 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-02T15:17:32.959 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-02T15:17:32.963 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-02T15:17:32.966 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-02T15:17:32.967 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-02T15:17:32.970 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-06-02T15:17:32.972 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-06-02T15:17:32.978 INFO:teuthology.task.internal:Configuring sudo... 2023-06-02T15:17:32.979 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-02T15:17:33.002 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-02T15:17:33.020 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-02T15:17:33.022 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-06-02T15:17:33.042 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-06-02T15:17:33.050 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-06-02T15:17:33.051 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-02T15:17:33.057 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-02T15:17:33.076 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-02T15:17:33.083 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-06-02T15:17:33.090 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-02T15:17:33.108 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-02T15:17:33.157 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:17:33.157 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-02T15:17:33.221 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-02T15:17:33.227 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-02T15:17:33.277 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:17:33.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-02T15:17:33.339 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-02T15:17:33.346 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-02T15:17:33.398 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:17:33.398 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-02T15:17:33.463 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-06-02T15:17:33.470 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-06-02T15:17:33.518 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:17:33.519 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-06-02T15:17:33.585 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2023-06-02T15:17:33.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2023-06-02T15:17:33.591 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2023-06-02T15:17:33.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2023-06-02T15:17:33.704 INFO:teuthology.run_tasks:Running task internal.timer... 2023-06-02T15:17:33.716 INFO:teuthology.task.internal:Starting timer... 2023-06-02T15:17:33.717 INFO:teuthology.run_tasks:Running task pcp... 2023-06-02T15:17:33.731 INFO:teuthology.run_tasks:Running task selinux... 2023-06-02T15:17:33.746 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2023-06-02T15:17:33.747 DEBUG:teuthology.task.selinux:Excluding smithi132: OS 'ubuntu' does not support SELinux 2023-06-02T15:17:33.747 DEBUG:teuthology.task.selinux:Excluding smithi150: OS 'ubuntu' does not support SELinux 2023-06-02T15:17:33.747 DEBUG:teuthology.task.selinux:Excluding smithi159: OS 'ubuntu' does not support SELinux 2023-06-02T15:17:33.748 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-06-02T15:17:33.748 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-06-02T15:17:33.748 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-06-02T15:17:33.748 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-06-02T15:17:33.760 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-06-02T15:17:33.760 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-06-02T15:17:33.785 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-06-02T15:17:33.788 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi132.front.sepia.ceph.com,smithi150.front.sepia.ceph.com,smithi159.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-06-02T15:25:39.756 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com'), Remote(name='ubuntu@smithi150.front.sepia.ceph.com'), Remote(name='ubuntu@smithi159.front.sepia.ceph.com')] 2023-06-02T15:25:39.758 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-06-02T15:25:39.759 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:25:39.834 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-06-02T15:25:39.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-06-02T15:25:39.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:25:40.026 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-06-02T15:25:40.145 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi150.front.sepia.ceph.com' 2023-06-02T15:25:40.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:25:40.222 DEBUG:teuthology.orchestra.run.smithi150:> true 2023-06-02T15:25:40.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2023-06-02T15:25:40.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-06-02T15:25:40.416 DEBUG:teuthology.orchestra.run.smithi159:> true 2023-06-02T15:25:40.513 INFO:teuthology.run_tasks:Running task clock... 2023-06-02T15:25:40.523 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-06-02T15:25:40.524 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-02T15:25:40.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-02T15:25:40.527 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-02T15:25:40.527 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-02T15:25:40.529 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-02T15:25:40.529 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-02T15:25:40.532 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-06-02T15:25:40.532 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-02T15:25:40.554 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-02T15:25:40.555 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: Command line: ntpd -gq 2023-06-02T15:25:40.555 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: ---------------------------------------------------- 2023-06-02T15:25:40.555 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: ntp-4 is maintained by Network Time Foundation, 2023-06-02T15:25:40.555 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-02T15:25:40.555 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: corporation. Support and training for ntp-4 are 2023-06-02T15:25:40.556 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: available at https://www.nwtime.org/support 2023-06-02T15:25:40.556 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: ---------------------------------------------------- 2023-06-02T15:25:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-02T15:25:40.557 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: Command line: ntpd -gq 2023-06-02T15:25:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: ---------------------------------------------------- 2023-06-02T15:25:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: ntp-4 is maintained by Network Time Foundation, 2023-06-02T15:25:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-02T15:25:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: corporation. Support and training for ntp-4 are 2023-06-02T15:25:40.558 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: available at https://www.nwtime.org/support 2023-06-02T15:25:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: ---------------------------------------------------- 2023-06-02T15:25:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: proto: precision = 0.045 usec (-24) 2023-06-02T15:25:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: basedate set to 2022-02-04 2023-06-02T15:25:40.559 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: gps base set to 2022-02-06 (week 2196) 2023-06-02T15:25:40.559 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: proto: precision = 0.058 usec (-24) 2023-06-02T15:25:40.559 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: basedate set to 2022-02-04 2023-06-02T15:25:40.560 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: gps base set to 2022-02-06 (week 2196) 2023-06-02T15:25:40.560 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-02T15:25:40.560 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: Command line: ntpd -gq 2023-06-02T15:25:40.560 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: ---------------------------------------------------- 2023-06-02T15:25:40.560 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: ntp-4 is maintained by Network Time Foundation, 2023-06-02T15:25:40.560 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-02T15:25:40.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: corporation. Support and training for ntp-4 are 2023-06-02T15:25:40.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: available at https://www.nwtime.org/support 2023-06-02T15:25:40.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: ---------------------------------------------------- 2023-06-02T15:25:40.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: proto: precision = 0.044 usec (-24) 2023-06-02T15:25:40.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: basedate set to 2022-02-04 2023-06-02T15:25:40.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: gps base set to 2022-02-06 (week 2196) 2023-06-02T15:25:40.562 INFO:teuthology.orchestra.run.smithi150.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-02T15:25:40.562 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-02T15:25:40.562 INFO:teuthology.orchestra.run.smithi132.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-02T15:25:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-02T15:25:40.563 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: restrict ::: KOD does nothing without LIMITED. 2023-06-02T15:25:40.563 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-02T15:25:40.563 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: restrict ::: KOD does nothing without LIMITED. 2023-06-02T15:25:40.564 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-02T15:25:40.564 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: restrict ::: KOD does nothing without LIMITED. 2023-06-02T15:25:40.564 INFO:teuthology.orchestra.run.smithi150.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-02T15:25:40.564 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-02T15:25:40.565 INFO:teuthology.orchestra.run.smithi132.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-02T15:25:40.566 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: Listen and drop on 0 v6wildcard [::]:123 2023-06-02T15:25:40.566 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-02T15:25:40.566 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: Listen normally on 2 lo 127.0.0.1:123 2023-06-02T15:25:40.567 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2023-06-02T15:25:40.567 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: Listen normally on 4 lo [::1]:123 2023-06-02T15:25:40.567 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2023-06-02T15:25:40.567 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:40 ntpd[27021]: Listening on routing socket on fd #22 for interface updates 2023-06-02T15:25:40.567 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: Listen and drop on 0 v6wildcard [::]:123 2023-06-02T15:25:40.567 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-02T15:25:40.567 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: Listen normally on 2 lo 127.0.0.1:123 2023-06-02T15:25:40.567 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: Listen normally on 3 enp3s0f1 172.21.15.132:123 2023-06-02T15:25:40.568 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: Listen normally on 4 lo [::1]:123 2023-06-02T15:25:40.568 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:773f%5]:123 2023-06-02T15:25:40.568 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:40 ntpd[27055]: Listening on routing socket on fd #22 for interface updates 2023-06-02T15:25:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: Listen and drop on 0 v6wildcard [::]:123 2023-06-02T15:25:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-02T15:25:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: Listen normally on 2 lo 127.0.0.1:123 2023-06-02T15:25:40.568 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: Listen normally on 3 enp3s0f1 172.21.15.150:123 2023-06-02T15:25:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: Listen normally on 4 lo [::1]:123 2023-06-02T15:25:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e35%5]:123 2023-06-02T15:25:40.569 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:40 ntpd[27050]: Listening on routing socket on fd #22 for interface updates 2023-06-02T15:25:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-06-02T15:25:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: Command line: ntpd -gq 2023-06-02T15:25:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: ---------------------------------------------------- 2023-06-02T15:25:40.579 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: ntp-4 is maintained by Network Time Foundation, 2023-06-02T15:25:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-06-02T15:25:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: corporation. Support and training for ntp-4 are 2023-06-02T15:25:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: available at https://www.nwtime.org/support 2023-06-02T15:25:40.580 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: ---------------------------------------------------- 2023-06-02T15:25:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: proto: precision = 0.058 usec (-24) 2023-06-02T15:25:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: basedate set to 2022-02-04 2023-06-02T15:25:40.581 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: gps base set to 2022-02-06 (week 2196) 2023-06-02T15:25:40.581 INFO:teuthology.orchestra.run.smithi159.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-02T15:25:40.582 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-06-02T15:25:40.582 INFO:teuthology.orchestra.run.smithi159.stderr:restrict ::: KOD does nothing without LIMITED. 2023-06-02T15:25:40.584 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: restrict ::: KOD does nothing without LIMITED. 2023-06-02T15:25:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: Listen and drop on 0 v6wildcard [::]:123 2023-06-02T15:25:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-06-02T15:25:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: Listen normally on 2 lo 127.0.0.1:123 2023-06-02T15:25:40.585 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: Listen normally on 3 enp3s0f1 172.21.15.159:123 2023-06-02T15:25:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: Listen normally on 4 lo [::1]:123 2023-06-02T15:25:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:724f%5]:123 2023-06-02T15:25:40.586 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:40 ntpd[27008]: Listening on routing socket on fd #22 for interface updates 2023-06-02T15:25:41.555 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:41 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:41.555 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:41 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:41.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:41 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:41.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:41 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:41.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:41 ntpd[27021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:41.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:41 ntpd[27021]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:41.557 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:41 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:41.557 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:41 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:41.579 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:41 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:41.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:41 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:41.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:41 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:41.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:41 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:41.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:41 ntpd[27008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:41.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:41 ntpd[27008]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:42.555 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:42 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.555 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:42 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:42 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:42 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:42 ntpd[27021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:42.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:42 ntpd[27021]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:42.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.559 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:42.559 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:42.559 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.559 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.559 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:42.559 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:42 ntpd[27050]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:42.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.561 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.561 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:42.561 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:42.561 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.561 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.561 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:42.561 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:42 ntpd[27055]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:42.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:42 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:42 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:42 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:42.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:42 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:42.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:42 ntpd[27008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:42.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:42 ntpd[27008]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:43.555 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:43 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:43.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:43 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:43.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:43 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:43.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:43 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:43.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:43 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:43.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:43 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:43.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:43 ntpd[27021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:43.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:43 ntpd[27021]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:43.579 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:43 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:43 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:43 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:43 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:43 ntpd[27008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:43.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:43 ntpd[27008]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:44.555 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:44.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:44.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:44.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:44 ntpd[27021]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:44.559 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.559 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.559 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.559 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:44.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:44.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:44.561 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:44 ntpd[27055]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:44.561 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:44.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:44.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:44.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:44.564 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.564 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.564 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:44.564 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:44 ntpd[27050]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:44.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:44 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:44 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:44 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:44 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:44 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:44.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:44 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:44.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:44 ntpd[27008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:44.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:44 ntpd[27008]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:45.555 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:45 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:45.555 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:45 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:45.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:45 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:45.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:45 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:45.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:45 ntpd[27021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:45.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:45 ntpd[27021]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:45.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:45 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:45.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:45 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:45.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:45 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:45.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:45 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:45.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:45 ntpd[27055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:45.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:45 ntpd[27055]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:45.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:45.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:45.582 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:45.582 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:45.582 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:45.583 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:45.583 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:45.583 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:45.583 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:45.584 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:45.584 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:45.584 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:45 ntpd[27008]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:46.555 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:46.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:46.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:46.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:46 ntpd[27021]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:46.559 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.559 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:46.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:46.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.561 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:46.561 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:46 ntpd[27055]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:46.561 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.561 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.561 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.561 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:46.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:46.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.562 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:46.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:46.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:46.563 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:46 ntpd[27050]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:46.579 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:46 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:46 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:46 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:46.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:46 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:46.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:46 ntpd[27008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:46.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:46 ntpd[27008]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:47.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:47 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:47.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:47 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:47.556 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:47 ntpd[27021]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:47.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:47 ntpd[27021]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:47.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:47 ntpd[27021]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:47.557 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:47 ntpd[27021]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:47.558 INFO:teuthology.orchestra.run.smithi078.stdout: 2 Jun 15:25:47 ntpd[27021]: ntpd: time slew -0.000263 s 2023-06-02T15:25:47.558 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew -0.000263s 2023-06-02T15:25:47.558 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:47 ntpd[27021]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-02T15:25:47.559 INFO:teuthology.orchestra.run.smithi078.stderr: 2 Jun 15:25:47 ntpd[27021]: can't open /var/log/ntpstats/loopstats.20230602: Permission denied 2023-06-02T15:25:47.559 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:47 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:47.559 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:47 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:47.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:47 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:47.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:47 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:47.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:47 ntpd[27055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:47.560 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:47 ntpd[27055]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:47.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:47 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:47.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:47 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:47.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:47 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:47.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:47 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:47.580 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:47 ntpd[27008]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:47.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:47 ntpd[27008]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:47.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:47 ntpd[27008]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:47.581 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:47 ntpd[27008]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:47.581 INFO:teuthology.orchestra.run.smithi159.stdout: 2 Jun 15:25:47 ntpd[27008]: ntpd: time slew +0.001154 s 2023-06-02T15:25:47.581 INFO:teuthology.orchestra.run.smithi159.stdout:ntpd: time slew +0.001154s 2023-06-02T15:25:47.582 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:47 ntpd[27008]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-02T15:25:47.582 INFO:teuthology.orchestra.run.smithi159.stderr: 2 Jun 15:25:47 ntpd[27008]: can't open /var/log/ntpstats/loopstats.20230602: Permission denied 2023-06-02T15:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2023-06-02T15:25:47.639 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2023-06-02T15:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:47.640 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:47.672 INFO:teuthology.orchestra.run.smithi159.stdout: remote refid st t when poll reach delay offset jitter 2023-06-02T15:25:47.672 INFO:teuthology.orchestra.run.smithi159.stdout:============================================================================== 2023-06-02T15:25:47.672 INFO:teuthology.orchestra.run.smithi159.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:47.673 INFO:teuthology.orchestra.run.smithi159.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:47.673 INFO:teuthology.orchestra.run.smithi159.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:47.673 INFO:teuthology.orchestra.run.smithi159.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:48.556 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:48.557 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:48.557 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:48.557 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:48.557 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:48.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:48.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:48.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:48.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:48.558 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:48.559 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:48.560 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:48.560 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:48.560 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:48.560 INFO:teuthology.orchestra.run.smithi150.stdout: 2 Jun 15:25:48 ntpd[27050]: ntpd: time slew -0.000360 s 2023-06-02T15:25:48.561 INFO:teuthology.orchestra.run.smithi150.stdout:ntpd: time slew -0.000360s 2023-06-02T15:25:48.561 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-02T15:25:48.561 INFO:teuthology.orchestra.run.smithi150.stderr: 2 Jun 15:25:48 ntpd[27050]: can't open /var/log/ntpstats/loopstats.20230602: Permission denied 2023-06-02T15:25:48.562 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:48 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:48.563 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:48 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:48.563 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:48 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:48.563 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:48 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:48.563 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:48 ntpd[27055]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-06-02T15:25:48.563 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:48 ntpd[27055]: can't open /var/log/ntpstats/rawstats.20230602: Permission denied 2023-06-02T15:25:48.563 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:48 ntpd[27055]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-06-02T15:25:48.563 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:48 ntpd[27055]: can't open /var/log/ntpstats/peerstats.20230602: Permission denied 2023-06-02T15:25:48.564 INFO:teuthology.orchestra.run.smithi132.stdout: 2 Jun 15:25:48 ntpd[27055]: ntpd: time slew -0.003104 s 2023-06-02T15:25:48.564 INFO:teuthology.orchestra.run.smithi132.stdout:ntpd: time slew -0.003104s 2023-06-02T15:25:48.565 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:48 ntpd[27055]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-06-02T15:25:48.565 INFO:teuthology.orchestra.run.smithi132.stderr: 2 Jun 15:25:48 ntpd[27055]: can't open /var/log/ntpstats/loopstats.20230602: Permission denied 2023-06-02T15:25:48.625 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2023-06-02T15:25:48.625 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2023-06-02T15:25:48.626 INFO:teuthology.orchestra.run.smithi150.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:48.626 INFO:teuthology.orchestra.run.smithi150.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:48.626 INFO:teuthology.orchestra.run.smithi150.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:48.626 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:48.628 INFO:teuthology.orchestra.run.smithi132.stdout: remote refid st t when poll reach delay offset jitter 2023-06-02T15:25:48.628 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================== 2023-06-02T15:25:48.628 INFO:teuthology.orchestra.run.smithi132.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:48.628 INFO:teuthology.orchestra.run.smithi132.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:48.628 INFO:teuthology.orchestra.run.smithi132.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:48.628 INFO:teuthology.orchestra.run.smithi132.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:25:48.629 INFO:teuthology.run_tasks:Running task install... 2023-06-02T15:25:48.638 DEBUG:teuthology.task.install:project ceph 2023-06-02T15:25:48.638 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2870bf456d3115490c153abce9d47ac5c043b65e'}} 2023-06-02T15:25:48.639 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2870bf456d3115490c153abce9d47ac5c043b65e'} 2023-06-02T15:25:48.639 INFO:teuthology.task.install:Using flavor: default 2023-06-02T15:25:48.645 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-06-02T15:25:48.645 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-06-02T15:25:48.646 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2023-06-02T15:25:48.647 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-key list | grep Ceph 2023-06-02T15:25:48.647 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-key list | grep Ceph 2023-06-02T15:25:48.648 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-key list | grep Ceph 2023-06-02T15:25:48.708 INFO:teuthology.orchestra.run.smithi159.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-02T15:25:48.712 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-02T15:25:48.729 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-02T15:25:48.732 INFO:teuthology.orchestra.run.smithi132.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-06-02T15:25:48.736 INFO:teuthology.orchestra.run.smithi159.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-02T15:25:48.737 INFO:teuthology.orchestra.run.smithi159.stdout:uid [ unknown] Ceph.com (release key) 2023-06-02T15:25:48.737 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-02T15:25:48.738 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-02T15:25:48.738 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2870bf456d3115490c153abce9d47ac5c043b65e 2023-06-02T15:25:48.741 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-02T15:25:48.742 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2023-06-02T15:25:48.742 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-02T15:25:48.742 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-02T15:25:48.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2870bf456d3115490c153abce9d47ac5c043b65e 2023-06-02T15:25:48.758 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-02T15:25:48.759 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph.com (release key) 2023-06-02T15:25:48.759 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-02T15:25:48.760 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-02T15:25:48.760 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2870bf456d3115490c153abce9d47ac5c043b65e 2023-06-02T15:25:48.770 INFO:teuthology.orchestra.run.smithi132.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-06-02T15:25:48.770 INFO:teuthology.orchestra.run.smithi132.stdout:uid [ unknown] Ceph.com (release key) 2023-06-02T15:25:48.770 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-06-02T15:25:48.771 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-06-02T15:25:48.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2870bf456d3115490c153abce9d47ac5c043b65e 2023-06-02T15:25:48.878 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default/ 2023-06-02T15:25:48.879 INFO:teuthology.task.install.deb:Package version is 18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:25:48.914 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default/ 2023-06-02T15:25:48.915 INFO:teuthology.task.install.deb:Package version is 18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:25:49.018 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:25:49.018 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-02T15:25:49.032 DEBUG:teuthology.orchestra.run.smithi159:> sudo apt-get update 2023-06-02T15:25:49.056 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default/ 2023-06-02T15:25:49.057 INFO:teuthology.task.install.deb:Package version is 18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:25:49.067 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default/ 2023-06-02T15:25:49.067 INFO:teuthology.task.install.deb:Package version is 18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:25:49.198 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:25:49.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-02T15:25:49.201 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-02T15:25:49.211 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:25:49.212 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2023-06-02T15:25:49.228 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-02T15:25:49.245 INFO:teuthology.orchestra.run.smithi159.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-02T15:25:49.252 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:25:49.252 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-02T15:25:49.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo apt-get update 2023-06-02T15:25:49.325 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:25:49.325 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-06-02T15:25:49.340 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2023-06-02T15:25:49.376 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-02T15:25:49.454 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy InRelease 2023-06-02T15:25:49.482 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-02T15:25:49.499 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:25:49.503 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-02T15:25:49.511 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-02T15:25:49.540 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,433 B] 2023-06-02T15:25:49.563 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:25:49.563 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-06-02T15:25:49.572 INFO:teuthology.orchestra.run.smithi159.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy InRelease 2023-06-02T15:25:49.575 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-06-02T15:25:49.580 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-02T15:25:49.584 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy InRelease 2023-06-02T15:25:49.614 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-02T15:25:49.625 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-06-02T15:25:49.636 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-02T15:25:49.638 INFO:teuthology.orchestra.run.smithi159.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-02T15:25:49.641 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-02T15:25:49.642 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy InRelease 2023-06-02T15:25:49.663 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-02T15:25:49.669 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,433 B] 2023-06-02T15:25:49.703 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-06-02T15:25:49.706 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-06-02T15:25:49.706 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-06-02T15:25:49.717 INFO:teuthology.orchestra.run.smithi132.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-02T15:25:49.717 INFO:teuthology.orchestra.run.smithi159.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-02T15:25:49.763 INFO:teuthology.orchestra.run.smithi132.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy Release.gpg 2023-06-02T15:25:49.782 INFO:teuthology.orchestra.run.smithi159.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,433 B] 2023-06-02T15:25:49.788 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-06-02T15:25:49.803 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 28.5 kB in 0s (69.1 kB/s) 2023-06-02T15:25:49.823 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-06-02T15:25:49.898 INFO:teuthology.orchestra.run.smithi159.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-06-02T15:25:49.931 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 28.5 kB in 0s (69.5 kB/s) 2023-06-02T15:25:49.944 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,433 B] 2023-06-02T15:25:50.032 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 28.5 kB in 1s (50.0 kB/s) 2023-06-02T15:25:50.040 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 28.5 kB in 1s (34.8 kB/s) 2023-06-02T15:25:50.614 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-02T15:25:50.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3488-g2870bf45-1jammy cephadm=18.0.0-3488-g2870bf45-1jammy ceph-mds=18.0.0-3488-g2870bf45-1jammy ceph-mgr=18.0.0-3488-g2870bf45-1jammy ceph-common=18.0.0-3488-g2870bf45-1jammy ceph-fuse=18.0.0-3488-g2870bf45-1jammy ceph-test=18.0.0-3488-g2870bf45-1jammy ceph-volume=18.0.0-3488-g2870bf45-1jammy radosgw=18.0.0-3488-g2870bf45-1jammy python3-rados=18.0.0-3488-g2870bf45-1jammy python3-rgw=18.0.0-3488-g2870bf45-1jammy python3-cephfs=18.0.0-3488-g2870bf45-1jammy python3-rbd=18.0.0-3488-g2870bf45-1jammy libcephfs2=18.0.0-3488-g2870bf45-1jammy libcephfs-dev=18.0.0-3488-g2870bf45-1jammy librados2=18.0.0-3488-g2870bf45-1jammy librbd1=18.0.0-3488-g2870bf45-1jammy rbd-fuse=18.0.0-3488-g2870bf45-1jammy python3-cephfs=18.0.0-3488-g2870bf45-1jammy cephfs-shell=18.0.0-3488-g2870bf45-1jammy cephfs-top=18.0.0-3488-g2870bf45-1jammy cephfs-mirror=18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:25:50.681 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-02T15:25:50.723 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2023-06-02T15:25:50.739 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3488-g2870bf45-1jammy cephadm=18.0.0-3488-g2870bf45-1jammy ceph-mds=18.0.0-3488-g2870bf45-1jammy ceph-mgr=18.0.0-3488-g2870bf45-1jammy ceph-common=18.0.0-3488-g2870bf45-1jammy ceph-fuse=18.0.0-3488-g2870bf45-1jammy ceph-test=18.0.0-3488-g2870bf45-1jammy ceph-volume=18.0.0-3488-g2870bf45-1jammy radosgw=18.0.0-3488-g2870bf45-1jammy python3-rados=18.0.0-3488-g2870bf45-1jammy python3-rgw=18.0.0-3488-g2870bf45-1jammy python3-cephfs=18.0.0-3488-g2870bf45-1jammy python3-rbd=18.0.0-3488-g2870bf45-1jammy libcephfs2=18.0.0-3488-g2870bf45-1jammy libcephfs-dev=18.0.0-3488-g2870bf45-1jammy librados2=18.0.0-3488-g2870bf45-1jammy librbd1=18.0.0-3488-g2870bf45-1jammy rbd-fuse=18.0.0-3488-g2870bf45-1jammy python3-cephfs=18.0.0-3488-g2870bf45-1jammy cephfs-shell=18.0.0-3488-g2870bf45-1jammy cephfs-top=18.0.0-3488-g2870bf45-1jammy cephfs-mirror=18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:25:50.789 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2023-06-02T15:25:50.827 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2023-06-02T15:25:50.829 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2023-06-02T15:25:50.834 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-06-02T15:25:50.835 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-06-02T15:25:50.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3488-g2870bf45-1jammy cephadm=18.0.0-3488-g2870bf45-1jammy ceph-mds=18.0.0-3488-g2870bf45-1jammy ceph-mgr=18.0.0-3488-g2870bf45-1jammy ceph-common=18.0.0-3488-g2870bf45-1jammy ceph-fuse=18.0.0-3488-g2870bf45-1jammy ceph-test=18.0.0-3488-g2870bf45-1jammy ceph-volume=18.0.0-3488-g2870bf45-1jammy radosgw=18.0.0-3488-g2870bf45-1jammy python3-rados=18.0.0-3488-g2870bf45-1jammy python3-rgw=18.0.0-3488-g2870bf45-1jammy python3-cephfs=18.0.0-3488-g2870bf45-1jammy python3-rbd=18.0.0-3488-g2870bf45-1jammy libcephfs2=18.0.0-3488-g2870bf45-1jammy libcephfs-dev=18.0.0-3488-g2870bf45-1jammy librados2=18.0.0-3488-g2870bf45-1jammy librbd1=18.0.0-3488-g2870bf45-1jammy rbd-fuse=18.0.0-3488-g2870bf45-1jammy python3-cephfs=18.0.0-3488-g2870bf45-1jammy cephfs-shell=18.0.0-3488-g2870bf45-1jammy cephfs-top=18.0.0-3488-g2870bf45-1jammy cephfs-mirror=18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:25:50.844 DEBUG:teuthology.orchestra.run.smithi159:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3488-g2870bf45-1jammy cephadm=18.0.0-3488-g2870bf45-1jammy ceph-mds=18.0.0-3488-g2870bf45-1jammy ceph-mgr=18.0.0-3488-g2870bf45-1jammy ceph-common=18.0.0-3488-g2870bf45-1jammy ceph-fuse=18.0.0-3488-g2870bf45-1jammy ceph-test=18.0.0-3488-g2870bf45-1jammy ceph-volume=18.0.0-3488-g2870bf45-1jammy radosgw=18.0.0-3488-g2870bf45-1jammy python3-rados=18.0.0-3488-g2870bf45-1jammy python3-rgw=18.0.0-3488-g2870bf45-1jammy python3-cephfs=18.0.0-3488-g2870bf45-1jammy python3-rbd=18.0.0-3488-g2870bf45-1jammy libcephfs2=18.0.0-3488-g2870bf45-1jammy libcephfs-dev=18.0.0-3488-g2870bf45-1jammy librados2=18.0.0-3488-g2870bf45-1jammy librbd1=18.0.0-3488-g2870bf45-1jammy rbd-fuse=18.0.0-3488-g2870bf45-1jammy python3-cephfs=18.0.0-3488-g2870bf45-1jammy cephfs-shell=18.0.0-3488-g2870bf45-1jammy cephfs-top=18.0.0-3488-g2870bf45-1jammy cephfs-mirror=18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:25:50.894 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2023-06-02T15:25:50.905 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2023-06-02T15:25:50.942 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2023-06-02T15:25:50.943 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2023-06-02T15:25:50.974 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:25:50.975 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:25:50.975 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:25:50.975 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:25:50.975 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:25:50.977 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:25:50.977 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:25:50.977 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-06-02T15:25:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-02T15:25:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-02T15:25:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-02T15:25:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-02T15:25:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-02T15:25:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-02T15:25:50.978 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-02T15:25:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-02T15:25:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-02T15:25:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-02T15:25:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-02T15:25:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-02T15:25:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-02T15:25:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-02T15:25:50.979 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-02T15:25:50.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-02T15:25:50.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-02T15:25:50.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-02T15:25:50.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-02T15:25:50.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-02T15:25:50.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-02T15:25:50.980 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-02T15:25:50.981 INFO:teuthology.orchestra.run.smithi078.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-02T15:25:50.981 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-06-02T15:25:50.981 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-02T15:25:50.981 INFO:teuthology.orchestra.run.smithi078.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-02T15:25:50.981 INFO:teuthology.orchestra.run.smithi078.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-02T15:25:50.981 INFO:teuthology.orchestra.run.smithi078.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-02T15:25:50.981 INFO:teuthology.orchestra.run.smithi078.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-02T15:25:50.981 INFO:teuthology.orchestra.run.smithi078.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-02T15:25:50.982 INFO:teuthology.orchestra.run.smithi078.stdout: python3-watchdog 2023-06-02T15:25:50.982 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2023-06-02T15:25:50.982 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2023-06-02T15:25:51.049 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2023-06-02T15:25:51.049 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2023-06-02T15:25:51.073 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-06-02T15:25:51.073 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-02T15:25:51.074 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-02T15:25:51.074 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-02T15:25:51.074 INFO:teuthology.orchestra.run.smithi159.stdout:Building dependency tree... 2023-06-02T15:25:51.075 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-02T15:25:51.076 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-02T15:25:51.076 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-02T15:25:51.076 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-02T15:25:51.076 INFO:teuthology.orchestra.run.smithi078.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-02T15:25:51.076 INFO:teuthology.orchestra.run.smithi078.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-02T15:25:51.076 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-02T15:25:51.076 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-02T15:25:51.077 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-02T15:25:51.077 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-02T15:25:51.077 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-02T15:25:51.077 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-02T15:25:51.077 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-02T15:25:51.077 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-02T15:25:51.077 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-02T15:25:51.078 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-02T15:25:51.078 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-02T15:25:51.078 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-02T15:25:51.078 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-02T15:25:51.079 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-02T15:25:51.079 INFO:teuthology.orchestra.run.smithi078.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-02T15:25:51.079 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-02T15:25:51.079 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-02T15:25:51.079 INFO:teuthology.orchestra.run.smithi078.stdout: socat xmlstarlet 2023-06-02T15:25:51.079 INFO:teuthology.orchestra.run.smithi159.stdout:Reading state information... 2023-06-02T15:25:51.082 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:25:51.082 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:25:51.082 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:25:51.082 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:25:51.083 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:25:51.083 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:25:51.083 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:25:51.083 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2023-06-02T15:25:51.083 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-02T15:25:51.084 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-02T15:25:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-02T15:25:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-02T15:25:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-02T15:25:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-02T15:25:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-02T15:25:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-02T15:25:51.085 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-02T15:25:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-02T15:25:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-02T15:25:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-02T15:25:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-02T15:25:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-02T15:25:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-02T15:25:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-02T15:25:51.086 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-02T15:25:51.087 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-02T15:25:51.087 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-02T15:25:51.087 INFO:teuthology.orchestra.run.smithi150.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-02T15:25:51.087 INFO:teuthology.orchestra.run.smithi150.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-02T15:25:51.087 INFO:teuthology.orchestra.run.smithi150.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-02T15:25:51.087 INFO:teuthology.orchestra.run.smithi150.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-02T15:25:51.088 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2023-06-02T15:25:51.088 INFO:teuthology.orchestra.run.smithi150.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-02T15:25:51.088 INFO:teuthology.orchestra.run.smithi150.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-02T15:25:51.088 INFO:teuthology.orchestra.run.smithi150.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-02T15:25:51.088 INFO:teuthology.orchestra.run.smithi150.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-02T15:25:51.088 INFO:teuthology.orchestra.run.smithi150.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-02T15:25:51.088 INFO:teuthology.orchestra.run.smithi150.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-02T15:25:51.089 INFO:teuthology.orchestra.run.smithi150.stdout: python3-watchdog 2023-06-02T15:25:51.089 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2023-06-02T15:25:51.089 INFO:teuthology.orchestra.run.smithi150.stdout: btrfs-tools 2023-06-02T15:25:51.133 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 115 newly installed, 0 to remove and 181 not upgraded. 2023-06-02T15:25:51.134 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 180 MB of archives. 2023-06-02T15:25:51.134 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 808 MB of additional disk space will be used. 2023-06-02T15:25:51.134 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-02T15:25:51.151 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-02T15:25:51.160 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-02T15:25:51.182 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2023-06-02T15:25:51.183 INFO:teuthology.orchestra.run.smithi150.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-02T15:25:51.183 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-02T15:25:51.183 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-02T15:25:51.183 INFO:teuthology.orchestra.run.smithi150.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-02T15:25:51.184 INFO:teuthology.orchestra.run.smithi150.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-02T15:25:51.184 INFO:teuthology.orchestra.run.smithi150.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-02T15:25:51.184 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-02T15:25:51.184 INFO:teuthology.orchestra.run.smithi150.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-02T15:25:51.185 INFO:teuthology.orchestra.run.smithi150.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-02T15:25:51.185 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-02T15:25:51.185 INFO:teuthology.orchestra.run.smithi150.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-02T15:25:51.185 INFO:teuthology.orchestra.run.smithi150.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-02T15:25:51.185 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-02T15:25:51.185 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-02T15:25:51.185 INFO:teuthology.orchestra.run.smithi150.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-02T15:25:51.186 INFO:teuthology.orchestra.run.smithi150.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-02T15:25:51.186 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-02T15:25:51.186 INFO:teuthology.orchestra.run.smithi150.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-02T15:25:51.186 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-02T15:25:51.186 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-02T15:25:51.186 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-02T15:25:51.186 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-02T15:25:51.186 INFO:teuthology.orchestra.run.smithi150.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-02T15:25:51.187 INFO:teuthology.orchestra.run.smithi150.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-02T15:25:51.187 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-02T15:25:51.187 INFO:teuthology.orchestra.run.smithi150.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-02T15:25:51.187 INFO:teuthology.orchestra.run.smithi150.stdout: socat xmlstarlet 2023-06-02T15:25:51.190 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:25:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:25:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:25:51.190 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:25:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:25:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:25:51.191 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:25:51.191 INFO:teuthology.orchestra.run.smithi132.stdout:The following additional packages will be installed: 2023-06-02T15:25:51.191 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-02T15:25:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-02T15:25:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-02T15:25:51.192 INFO:teuthology.orchestra.run.smithi132.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-02T15:25:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-02T15:25:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-02T15:25:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-02T15:25:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-02T15:25:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-02T15:25:51.193 INFO:teuthology.orchestra.run.smithi132.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-02T15:25:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-02T15:25:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-02T15:25:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-02T15:25:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-02T15:25:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-02T15:25:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-02T15:25:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-02T15:25:51.194 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-02T15:25:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-02T15:25:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-02T15:25:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-02T15:25:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-02T15:25:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-02T15:25:51.195 INFO:teuthology.orchestra.run.smithi132.stdout:Suggested packages: 2023-06-02T15:25:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-02T15:25:51.195 INFO:teuthology.orchestra.run.smithi132.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-02T15:25:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-02T15:25:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-02T15:25:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-02T15:25:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-02T15:25:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: python3-watchdog 2023-06-02T15:25:51.196 INFO:teuthology.orchestra.run.smithi132.stdout:Recommended packages: 2023-06-02T15:25:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: btrfs-tools 2023-06-02T15:25:51.201 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-02T15:25:51.210 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-02T15:25:51.226 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-02T15:25:51.228 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-02T15:25:51.232 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:25:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:25:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:25:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:25:51.233 INFO:teuthology.orchestra.run.smithi159.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:25:51.234 INFO:teuthology.orchestra.run.smithi159.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:25:51.234 INFO:teuthology.orchestra.run.smithi159.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:25:51.235 INFO:teuthology.orchestra.run.smithi159.stdout:The following additional packages will be installed: 2023-06-02T15:25:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-06-02T15:25:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-06-02T15:25:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-02T15:25:51.235 INFO:teuthology.orchestra.run.smithi159.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-06-02T15:25:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-06-02T15:25:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-06-02T15:25:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-06-02T15:25:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-06-02T15:25:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-06-02T15:25:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-06-02T15:25:51.236 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-06-02T15:25:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-06-02T15:25:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-06-02T15:25:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-06-02T15:25:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-06-02T15:25:51.237 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-06-02T15:25:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-06-02T15:25:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-06-02T15:25:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-06-02T15:25:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-06-02T15:25:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-06-02T15:25:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-06-02T15:25:51.238 INFO:teuthology.orchestra.run.smithi159.stdout: qttranslations5-l10n socat xmlstarlet 2023-06-02T15:25:51.239 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-02T15:25:51.239 INFO:teuthology.orchestra.run.smithi159.stdout:Suggested packages: 2023-06-02T15:25:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-06-02T15:25:51.239 INFO:teuthology.orchestra.run.smithi159.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-06-02T15:25:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-06-02T15:25:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-06-02T15:25:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-06-02T15:25:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-06-02T15:25:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: python3-watchdog 2023-06-02T15:25:51.240 INFO:teuthology.orchestra.run.smithi159.stdout:Recommended packages: 2023-06-02T15:25:51.240 INFO:teuthology.orchestra.run.smithi159.stdout: btrfs-tools 2023-06-02T15:25:51.283 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-02T15:25:51.285 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3488-g2870bf45-1jammy [3,400 kB] 2023-06-02T15:25:51.287 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-02T15:25:51.289 INFO:teuthology.orchestra.run.smithi132.stdout:The following NEW packages will be installed: 2023-06-02T15:25:51.289 INFO:teuthology.orchestra.run.smithi132.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-02T15:25:51.289 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-02T15:25:51.289 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-02T15:25:51.290 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-02T15:25:51.291 INFO:teuthology.orchestra.run.smithi132.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-02T15:25:51.291 INFO:teuthology.orchestra.run.smithi132.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-02T15:25:51.291 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-02T15:25:51.291 INFO:teuthology.orchestra.run.smithi132.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-02T15:25:51.291 INFO:teuthology.orchestra.run.smithi132.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-02T15:25:51.291 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-02T15:25:51.291 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-02T15:25:51.292 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-02T15:25:51.292 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-02T15:25:51.292 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-02T15:25:51.292 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-02T15:25:51.292 INFO:teuthology.orchestra.run.smithi132.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-02T15:25:51.292 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-02T15:25:51.292 INFO:teuthology.orchestra.run.smithi132.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-02T15:25:51.292 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-02T15:25:51.293 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-02T15:25:51.293 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-02T15:25:51.293 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-02T15:25:51.293 INFO:teuthology.orchestra.run.smithi132.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-02T15:25:51.293 INFO:teuthology.orchestra.run.smithi132.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-02T15:25:51.293 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-02T15:25:51.293 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-02T15:25:51.293 INFO:teuthology.orchestra.run.smithi132.stdout: socat xmlstarlet 2023-06-02T15:25:51.298 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-02T15:25:51.336 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-02T15:25:51.338 INFO:teuthology.orchestra.run.smithi159.stdout:The following NEW packages will be installed: 2023-06-02T15:25:51.338 INFO:teuthology.orchestra.run.smithi159.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-06-02T15:25:51.338 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-06-02T15:25:51.338 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-06-02T15:25:51.339 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-06-02T15:25:51.340 INFO:teuthology.orchestra.run.smithi159.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-06-02T15:25:51.340 INFO:teuthology.orchestra.run.smithi159.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-06-02T15:25:51.340 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-06-02T15:25:51.340 INFO:teuthology.orchestra.run.smithi159.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-06-02T15:25:51.340 INFO:teuthology.orchestra.run.smithi159.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-06-02T15:25:51.340 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-06-02T15:25:51.340 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-06-02T15:25:51.341 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-06-02T15:25:51.341 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-06-02T15:25:51.341 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-06-02T15:25:51.341 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-06-02T15:25:51.341 INFO:teuthology.orchestra.run.smithi159.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-06-02T15:25:51.341 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-06-02T15:25:51.341 INFO:teuthology.orchestra.run.smithi159.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-06-02T15:25:51.341 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-06-02T15:25:51.342 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-06-02T15:25:51.342 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-06-02T15:25:51.342 INFO:teuthology.orchestra.run.smithi159.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-06-02T15:25:51.342 INFO:teuthology.orchestra.run.smithi159.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-06-02T15:25:51.342 INFO:teuthology.orchestra.run.smithi159.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-06-02T15:25:51.342 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-06-02T15:25:51.342 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-06-02T15:25:51.342 INFO:teuthology.orchestra.run.smithi159.stdout: socat xmlstarlet 2023-06-02T15:25:51.347 INFO:teuthology.orchestra.run.smithi132.stdout:0 upgraded, 115 newly installed, 0 to remove and 181 not upgraded. 2023-06-02T15:25:51.348 INFO:teuthology.orchestra.run.smithi132.stdout:Need to get 180 MB of archives. 2023-06-02T15:25:51.348 INFO:teuthology.orchestra.run.smithi132.stdout:After this operation, 808 MB of additional disk space will be used. 2023-06-02T15:25:51.348 INFO:teuthology.orchestra.run.smithi132.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-02T15:25:51.365 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-02T15:25:51.369 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 115 newly installed, 0 to remove and 181 not upgraded. 2023-06-02T15:25:51.369 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 180 MB of archives. 2023-06-02T15:25:51.369 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 808 MB of additional disk space will be used. 2023-06-02T15:25:51.370 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-02T15:25:51.374 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-02T15:25:51.377 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-02T15:25:51.415 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-02T15:25:51.424 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-02T15:25:51.440 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-02T15:25:51.442 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-02T15:25:51.452 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-02T15:25:51.452 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-02T15:25:51.453 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-02T15:25:51.454 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-02T15:25:51.455 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-02T15:25:51.457 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-02T15:25:51.457 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-02T15:25:51.458 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-02T15:25:51.459 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-02T15:25:51.495 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-02T15:25:51.496 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-02T15:25:51.497 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-02T15:25:51.498 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-02T15:25:51.502 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-02T15:25:51.512 INFO:teuthology.orchestra.run.smithi132.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-02T15:25:51.513 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-02T15:25:51.526 INFO:teuthology.orchestra.run.smithi132.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3488-g2870bf45-1jammy [3,400 kB] 2023-06-02T15:25:51.528 INFO:teuthology.orchestra.run.smithi159.stdout:0 upgraded, 115 newly installed, 0 to remove and 181 not upgraded. 2023-06-02T15:25:51.528 INFO:teuthology.orchestra.run.smithi159.stdout:Need to get 180 MB of archives. 2023-06-02T15:25:51.528 INFO:teuthology.orchestra.run.smithi159.stdout:After this operation, 808 MB of additional disk space will be used. 2023-06-02T15:25:51.528 INFO:teuthology.orchestra.run.smithi159.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-06-02T15:25:51.550 INFO:teuthology.orchestra.run.smithi132.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-02T15:25:51.561 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3488-g2870bf45-1jammy [3,400 kB] 2023-06-02T15:25:51.568 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-02T15:25:51.572 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-02T15:25:51.574 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-02T15:25:51.575 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-02T15:25:51.579 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-02T15:25:51.580 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-02T15:25:51.581 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-02T15:25:51.586 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-02T15:25:51.591 INFO:teuthology.orchestra.run.smithi132.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-02T15:25:51.610 INFO:teuthology.orchestra.run.smithi159.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-06-02T15:25:51.623 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-02T15:25:51.656 INFO:teuthology.orchestra.run.smithi159.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-06-02T15:25:51.657 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-02T15:25:51.666 INFO:teuthology.orchestra.run.smithi132.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-02T15:25:51.667 INFO:teuthology.orchestra.run.smithi132.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-02T15:25:51.668 INFO:teuthology.orchestra.run.smithi132.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-02T15:25:51.670 INFO:teuthology.orchestra.run.smithi132.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-02T15:25:51.670 INFO:teuthology.orchestra.run.smithi132.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-02T15:25:51.671 INFO:teuthology.orchestra.run.smithi132.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-02T15:25:51.672 INFO:teuthology.orchestra.run.smithi132.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-02T15:25:51.693 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-02T15:25:51.708 INFO:teuthology.orchestra.run.smithi132.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-02T15:25:51.708 INFO:teuthology.orchestra.run.smithi132.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-02T15:25:51.726 INFO:teuthology.orchestra.run.smithi132.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-02T15:25:51.733 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-02T15:25:51.733 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-02T15:25:51.734 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-02T15:25:51.735 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-02T15:25:51.736 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-02T15:25:51.739 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-02T15:25:51.745 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-02T15:25:51.746 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-02T15:25:51.749 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-06-02T15:25:51.751 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-02T15:25:51.767 INFO:teuthology.orchestra.run.smithi159.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3488-g2870bf45-1jammy [3,400 kB] 2023-06-02T15:25:51.781 INFO:teuthology.orchestra.run.smithi132.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-02T15:25:51.785 INFO:teuthology.orchestra.run.smithi132.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-02T15:25:51.787 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-02T15:25:51.788 INFO:teuthology.orchestra.run.smithi132.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-02T15:25:51.790 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-02T15:25:51.793 INFO:teuthology.orchestra.run.smithi132.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-02T15:25:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-02T15:25:51.794 INFO:teuthology.orchestra.run.smithi132.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-02T15:25:51.799 INFO:teuthology.orchestra.run.smithi132.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-02T15:25:51.811 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-02T15:25:51.822 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-02T15:25:51.837 INFO:teuthology.orchestra.run.smithi132.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-02T15:25:51.841 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-02T15:25:51.852 INFO:teuthology.orchestra.run.smithi159.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-06-02T15:25:51.868 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-02T15:25:51.871 INFO:teuthology.orchestra.run.smithi132.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-02T15:25:51.879 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-02T15:25:51.894 INFO:teuthology.orchestra.run.smithi159.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-06-02T15:25:51.948 INFO:teuthology.orchestra.run.smithi132.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-02T15:25:51.948 INFO:teuthology.orchestra.run.smithi132.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-02T15:25:51.949 INFO:teuthology.orchestra.run.smithi132.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-02T15:25:51.950 INFO:teuthology.orchestra.run.smithi132.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-02T15:25:51.955 INFO:teuthology.orchestra.run.smithi132.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-02T15:25:51.960 INFO:teuthology.orchestra.run.smithi132.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-02T15:25:51.962 INFO:teuthology.orchestra.run.smithi132.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-02T15:25:51.965 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3488-g2870bf45-1jammy [3,096 kB] 2023-06-02T15:25:51.966 INFO:teuthology.orchestra.run.smithi132.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-06-02T15:25:51.966 INFO:teuthology.orchestra.run.smithi132.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-02T15:25:51.969 INFO:teuthology.orchestra.run.smithi159.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-06-02T15:25:51.980 INFO:teuthology.orchestra.run.smithi159.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-06-02T15:25:51.990 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-02T15:25:51.991 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-02T15:25:51.992 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-02T15:25:51.993 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-02T15:25:51.993 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-02T15:25:51.994 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-02T15:25:51.994 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-02T15:25:51.995 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-02T15:25:52.006 INFO:teuthology.orchestra.run.smithi132.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-02T15:25:52.026 INFO:teuthology.orchestra.run.smithi159.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-06-02T15:25:52.032 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-02T15:25:52.033 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-02T15:25:52.042 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-02T15:25:52.049 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-02T15:25:52.057 INFO:teuthology.orchestra.run.smithi132.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-02T15:25:52.069 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-02T15:25:52.088 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-02T15:25:52.095 INFO:teuthology.orchestra.run.smithi132.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-02T15:25:52.160 INFO:teuthology.orchestra.run.smithi132.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3488-g2870bf45-1jammy [3,096 kB] 2023-06-02T15:25:52.174 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-02T15:25:52.178 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-02T15:25:52.179 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-02T15:25:52.195 INFO:teuthology.orchestra.run.smithi159.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-06-02T15:25:52.204 INFO:teuthology.orchestra.run.smithi159.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-06-02T15:25:52.207 INFO:teuthology.orchestra.run.smithi132.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-02T15:25:52.208 INFO:teuthology.orchestra.run.smithi132.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-02T15:25:52.208 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-02T15:25:52.208 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-02T15:25:52.209 INFO:teuthology.orchestra.run.smithi132.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-02T15:25:52.209 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-02T15:25:52.210 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-02T15:25:52.210 INFO:teuthology.orchestra.run.smithi132.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-02T15:25:52.210 INFO:teuthology.orchestra.run.smithi132.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-02T15:25:52.211 INFO:teuthology.orchestra.run.smithi132.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-02T15:25:52.230 INFO:teuthology.orchestra.run.smithi132.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-02T15:25:52.231 INFO:teuthology.orchestra.run.smithi132.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-02T15:25:52.231 INFO:teuthology.orchestra.run.smithi159.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-06-02T15:25:52.241 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-02T15:25:52.245 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-02T15:25:52.267 INFO:teuthology.orchestra.run.smithi132.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-02T15:25:52.273 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-02T15:25:52.283 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-02T15:25:52.285 INFO:teuthology.orchestra.run.smithi132.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-02T15:25:52.295 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-02T15:25:52.324 INFO:teuthology.orchestra.run.smithi132.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-02T15:25:52.335 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-02T15:25:52.344 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-02T15:25:52.349 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-02T15:25:52.351 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-02T15:25:52.360 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-02T15:25:52.366 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-02T15:25:52.367 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-02T15:25:52.402 INFO:teuthology.orchestra.run.smithi159.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-06-02T15:25:52.404 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3488-g2870bf45-1jammy [652 kB] 2023-06-02T15:25:52.409 INFO:teuthology.orchestra.run.smithi132.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-02T15:25:52.412 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-02T15:25:52.414 INFO:teuthology.orchestra.run.smithi132.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-02T15:25:52.414 INFO:teuthology.orchestra.run.smithi132.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-02T15:25:52.437 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-02T15:25:52.443 INFO:teuthology.orchestra.run.smithi132.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-02T15:25:52.443 INFO:teuthology.orchestra.run.smithi132.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-02T15:25:52.444 INFO:teuthology.orchestra.run.smithi132.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-02T15:25:52.445 INFO:teuthology.orchestra.run.smithi132.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-02T15:25:52.480 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3488-g2870bf45-1jammy [344 kB] 2023-06-02T15:25:52.481 INFO:teuthology.orchestra.run.smithi132.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-02T15:25:52.507 INFO:teuthology.orchestra.run.smithi132.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-02T15:25:52.512 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-02T15:25:52.512 INFO:teuthology.orchestra.run.smithi132.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3488-g2870bf45-1jammy [652 kB] 2023-06-02T15:25:52.513 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-02T15:25:52.518 INFO:teuthology.orchestra.run.smithi132.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-02T15:25:52.520 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-02T15:25:52.531 INFO:teuthology.orchestra.run.smithi132.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-02T15:25:52.548 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3488-g2870bf45-1jammy [22.9 kB] 2023-06-02T15:25:52.548 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3488-g2870bf45-1jammy [164 kB] 2023-06-02T15:25:52.550 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-02T15:25:52.551 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-02T15:25:52.553 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-02T15:25:52.553 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3488-g2870bf45-1jammy [48.9 kB] 2023-06-02T15:25:52.572 INFO:teuthology.orchestra.run.smithi132.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-02T15:25:52.581 INFO:teuthology.orchestra.run.smithi132.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-02T15:25:52.586 INFO:teuthology.orchestra.run.smithi132.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-02T15:25:52.586 INFO:teuthology.orchestra.run.smithi132.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3488-g2870bf45-1jammy [344 kB] 2023-06-02T15:25:52.587 INFO:teuthology.orchestra.run.smithi132.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-02T15:25:52.596 INFO:teuthology.orchestra.run.smithi132.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-02T15:25:52.597 INFO:teuthology.orchestra.run.smithi159.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-06-02T15:25:52.603 INFO:teuthology.orchestra.run.smithi132.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-02T15:25:52.604 INFO:teuthology.orchestra.run.smithi132.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-02T15:25:52.609 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3488-g2870bf45-1jammy [319 kB] 2023-06-02T15:25:52.622 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3488-g2870bf45-1jammy [5,841 kB] 2023-06-02T15:25:52.649 INFO:teuthology.orchestra.run.smithi132.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-02T15:25:52.649 INFO:teuthology.orchestra.run.smithi132.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3488-g2870bf45-1jammy [22.9 kB] 2023-06-02T15:25:52.651 INFO:teuthology.orchestra.run.smithi132.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3488-g2870bf45-1jammy [164 kB] 2023-06-02T15:25:52.656 INFO:teuthology.orchestra.run.smithi132.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3488-g2870bf45-1jammy [48.9 kB] 2023-06-02T15:25:52.658 INFO:teuthology.orchestra.run.smithi132.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3488-g2870bf45-1jammy [319 kB] 2023-06-02T15:25:52.722 INFO:teuthology.orchestra.run.smithi132.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3488-g2870bf45-1jammy [5,841 kB] 2023-06-02T15:25:52.749 INFO:teuthology.orchestra.run.smithi132.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-02T15:25:52.751 INFO:teuthology.orchestra.run.smithi132.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-02T15:25:52.758 INFO:teuthology.orchestra.run.smithi132.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-02T15:25:52.788 INFO:teuthology.orchestra.run.smithi132.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-02T15:25:52.790 INFO:teuthology.orchestra.run.smithi132.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-02T15:25:52.790 INFO:teuthology.orchestra.run.smithi132.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-02T15:25:52.805 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-02T15:25:52.812 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-02T15:25:52.814 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-02T15:25:52.826 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-02T15:25:52.827 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-02T15:25:52.829 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-02T15:25:52.830 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-02T15:25:52.832 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-02T15:25:52.834 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-02T15:25:52.964 INFO:teuthology.orchestra.run.smithi159.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-06-02T15:25:52.972 INFO:teuthology.orchestra.run.smithi159.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-06-02T15:25:52.973 INFO:teuthology.orchestra.run.smithi159.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-06-02T15:25:52.985 INFO:teuthology.orchestra.run.smithi159.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-06-02T15:25:52.986 INFO:teuthology.orchestra.run.smithi159.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-06-02T15:25:52.988 INFO:teuthology.orchestra.run.smithi159.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-06-02T15:25:52.990 INFO:teuthology.orchestra.run.smithi159.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-06-02T15:25:52.991 INFO:teuthology.orchestra.run.smithi159.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-06-02T15:25:52.993 INFO:teuthology.orchestra.run.smithi159.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-06-02T15:25:52.998 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-02T15:25:53.158 INFO:teuthology.orchestra.run.smithi159.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-06-02T15:25:53.314 INFO:teuthology.orchestra.run.smithi132.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3488-g2870bf45-1jammy [102 kB] 2023-06-02T15:25:53.317 INFO:teuthology.orchestra.run.smithi132.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3488-g2870bf45-1jammy [431 kB] 2023-06-02T15:25:53.365 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3488-g2870bf45-1jammy [102 kB] 2023-06-02T15:25:53.371 INFO:teuthology.orchestra.run.smithi132.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3488-g2870bf45-1jammy [21.8 MB] 2023-06-02T15:25:53.411 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3488-g2870bf45-1jammy [431 kB] 2023-06-02T15:25:53.429 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-02T15:25:53.439 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-02T15:25:53.444 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-02T15:25:53.448 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-02T15:25:53.466 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-02T15:25:53.469 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-02T15:25:53.471 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-02T15:25:53.471 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3488-g2870bf45-1jammy [21.8 MB] 2023-06-02T15:25:53.513 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-02T15:25:53.528 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-02T15:25:53.532 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-02T15:25:53.588 INFO:teuthology.orchestra.run.smithi159.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-06-02T15:25:53.598 INFO:teuthology.orchestra.run.smithi159.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-06-02T15:25:53.604 INFO:teuthology.orchestra.run.smithi159.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-06-02T15:25:53.608 INFO:teuthology.orchestra.run.smithi159.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-06-02T15:25:53.626 INFO:teuthology.orchestra.run.smithi159.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-06-02T15:25:53.629 INFO:teuthology.orchestra.run.smithi159.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-06-02T15:25:53.631 INFO:teuthology.orchestra.run.smithi159.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-06-02T15:25:53.673 INFO:teuthology.orchestra.run.smithi159.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-06-02T15:25:53.687 INFO:teuthology.orchestra.run.smithi159.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-06-02T15:25:53.692 INFO:teuthology.orchestra.run.smithi159.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-06-02T15:25:53.785 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-02T15:25:53.868 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-02T15:25:53.944 INFO:teuthology.orchestra.run.smithi159.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-06-02T15:25:53.959 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-02T15:25:54.016 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-02T15:25:54.027 INFO:teuthology.orchestra.run.smithi159.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-06-02T15:25:54.117 INFO:teuthology.orchestra.run.smithi159.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-06-02T15:25:54.138 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-02T15:25:54.174 INFO:teuthology.orchestra.run.smithi159.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-06-02T15:25:54.225 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-02T15:25:54.244 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-02T15:25:54.272 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-06-02T15:25:54.284 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-02T15:25:54.294 INFO:teuthology.orchestra.run.smithi159.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-06-02T15:25:54.322 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-02T15:25:54.331 INFO:teuthology.orchestra.run.smithi150.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-02T15:25:54.380 INFO:teuthology.orchestra.run.smithi159.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-06-02T15:25:54.398 INFO:teuthology.orchestra.run.smithi159.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-06-02T15:25:54.427 INFO:teuthology.orchestra.run.smithi159.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-06-02T15:25:54.439 INFO:teuthology.orchestra.run.smithi159.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-06-02T15:25:54.466 INFO:teuthology.orchestra.run.smithi159.stdout:Get:44 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3488-g2870bf45-1jammy [3,096 kB] 2023-06-02T15:25:54.477 INFO:teuthology.orchestra.run.smithi159.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-06-02T15:25:54.484 INFO:teuthology.orchestra.run.smithi159.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-06-02T15:25:54.522 INFO:teuthology.orchestra.run.smithi150.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-02T15:25:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-06-02T15:25:55.336 INFO:teuthology.orchestra.run.smithi150.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-02T15:25:55.338 INFO:teuthology.orchestra.run.smithi150.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-02T15:25:55.341 INFO:teuthology.orchestra.run.smithi150.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-02T15:25:55.342 INFO:teuthology.orchestra.run.smithi150.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-02T15:25:55.343 INFO:teuthology.orchestra.run.smithi150.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-02T15:25:55.345 INFO:teuthology.orchestra.run.smithi150.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-02T15:25:55.346 INFO:teuthology.orchestra.run.smithi150.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-02T15:25:55.347 INFO:teuthology.orchestra.run.smithi150.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-02T15:25:55.352 INFO:teuthology.orchestra.run.smithi150.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-02T15:25:55.417 INFO:teuthology.orchestra.run.smithi150.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-02T15:25:55.488 INFO:teuthology.orchestra.run.smithi159.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-06-02T15:25:55.490 INFO:teuthology.orchestra.run.smithi159.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-06-02T15:25:55.492 INFO:teuthology.orchestra.run.smithi159.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-06-02T15:25:55.493 INFO:teuthology.orchestra.run.smithi159.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-06-02T15:25:55.495 INFO:teuthology.orchestra.run.smithi159.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-06-02T15:25:55.496 INFO:teuthology.orchestra.run.smithi159.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-06-02T15:25:55.497 INFO:teuthology.orchestra.run.smithi159.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-06-02T15:25:55.498 INFO:teuthology.orchestra.run.smithi159.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-06-02T15:25:55.503 INFO:teuthology.orchestra.run.smithi159.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-06-02T15:25:55.569 INFO:teuthology.orchestra.run.smithi159.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-06-02T15:25:55.584 INFO:teuthology.orchestra.run.smithi150.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-02T15:25:55.735 INFO:teuthology.orchestra.run.smithi159.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-06-02T15:25:56.288 INFO:teuthology.orchestra.run.smithi150.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-02T15:25:56.294 INFO:teuthology.orchestra.run.smithi150.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-02T15:25:56.294 INFO:teuthology.orchestra.run.smithi150.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-02T15:25:56.345 INFO:teuthology.orchestra.run.smithi150.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-02T15:25:56.370 INFO:teuthology.orchestra.run.smithi150.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-02T15:25:56.371 INFO:teuthology.orchestra.run.smithi150.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-02T15:25:56.372 INFO:teuthology.orchestra.run.smithi150.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-02T15:25:56.374 INFO:teuthology.orchestra.run.smithi150.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-02T15:25:56.375 INFO:teuthology.orchestra.run.smithi150.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-02T15:25:56.446 INFO:teuthology.orchestra.run.smithi159.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-06-02T15:25:56.452 INFO:teuthology.orchestra.run.smithi159.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-06-02T15:25:56.453 INFO:teuthology.orchestra.run.smithi159.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-06-02T15:25:56.504 INFO:teuthology.orchestra.run.smithi159.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-06-02T15:25:56.528 INFO:teuthology.orchestra.run.smithi159.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-06-02T15:25:56.529 INFO:teuthology.orchestra.run.smithi159.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-06-02T15:25:56.531 INFO:teuthology.orchestra.run.smithi159.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-06-02T15:25:56.532 INFO:teuthology.orchestra.run.smithi159.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-06-02T15:25:56.533 INFO:teuthology.orchestra.run.smithi159.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-06-02T15:25:56.540 INFO:teuthology.orchestra.run.smithi150.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-02T15:25:56.621 INFO:teuthology.orchestra.run.smithi132.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3488-g2870bf45-1jammy [6,823 kB] 2023-06-02T15:25:56.662 INFO:teuthology.orchestra.run.smithi150.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-02T15:25:56.699 INFO:teuthology.orchestra.run.smithi159.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-06-02T15:25:56.788 INFO:teuthology.orchestra.run.smithi159.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3488-g2870bf45-1jammy [652 kB] 2023-06-02T15:25:56.820 INFO:teuthology.orchestra.run.smithi159.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-06-02T15:25:56.963 INFO:teuthology.orchestra.run.smithi150.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-02T15:25:57.002 INFO:teuthology.orchestra.run.smithi159.stdout:Get:71 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3488-g2870bf45-1jammy [344 kB] 2023-06-02T15:25:57.011 INFO:teuthology.orchestra.run.smithi150.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-02T15:25:57.034 INFO:teuthology.orchestra.run.smithi150.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-02T15:25:57.042 INFO:teuthology.orchestra.run.smithi150.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-02T15:25:57.088 INFO:teuthology.orchestra.run.smithi150.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-02T15:25:57.106 INFO:teuthology.orchestra.run.smithi159.stdout:Get:72 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3488-g2870bf45-1jammy [22.9 kB] 2023-06-02T15:25:57.110 INFO:teuthology.orchestra.run.smithi159.stdout:Get:73 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3488-g2870bf45-1jammy [164 kB] 2023-06-02T15:25:57.115 INFO:teuthology.orchestra.run.smithi150.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-02T15:25:57.117 INFO:teuthology.orchestra.run.smithi150.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-02T15:25:57.121 INFO:teuthology.orchestra.run.smithi159.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-06-02T15:25:57.151 INFO:teuthology.orchestra.run.smithi150.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-02T15:25:57.166 INFO:teuthology.orchestra.run.smithi159.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-06-02T15:25:57.169 INFO:teuthology.orchestra.run.smithi150.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-02T15:25:57.191 INFO:teuthology.orchestra.run.smithi159.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3488-g2870bf45-1jammy [48.9 kB] 2023-06-02T15:25:57.192 INFO:teuthology.orchestra.run.smithi159.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-06-02T15:25:57.195 INFO:teuthology.orchestra.run.smithi159.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3488-g2870bf45-1jammy [319 kB] 2023-06-02T15:25:57.201 INFO:teuthology.orchestra.run.smithi159.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-06-02T15:25:57.211 INFO:teuthology.orchestra.run.smithi132.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3488-g2870bf45-1jammy [225 kB] 2023-06-02T15:25:57.218 INFO:teuthology.orchestra.run.smithi132.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3488-g2870bf45-1jammy [114 kB] 2023-06-02T15:25:57.222 INFO:teuthology.orchestra.run.smithi132.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3488-g2870bf45-1jammy [1,464 kB] 2023-06-02T15:25:57.246 INFO:teuthology.orchestra.run.smithi159.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-06-02T15:25:57.271 INFO:teuthology.orchestra.run.smithi159.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-06-02T15:25:57.273 INFO:teuthology.orchestra.run.smithi159.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-06-02T15:25:57.294 INFO:teuthology.orchestra.run.smithi159.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3488-g2870bf45-1jammy [5,841 kB] 2023-06-02T15:25:57.308 INFO:teuthology.orchestra.run.smithi159.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-06-02T15:25:57.326 INFO:teuthology.orchestra.run.smithi159.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-06-02T15:25:57.337 INFO:teuthology.orchestra.run.smithi150.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-02T15:25:57.377 INFO:teuthology.orchestra.run.smithi132.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3488-g2870bf45-1jammy [9,864 kB] 2023-06-02T15:25:57.493 INFO:teuthology.orchestra.run.smithi159.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-06-02T15:25:57.517 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3488-g2870bf45-1jammy [6,823 kB] 2023-06-02T15:25:57.732 INFO:teuthology.orchestra.run.smithi150.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-02T15:25:57.886 INFO:teuthology.orchestra.run.smithi159.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-06-02T15:25:57.952 INFO:teuthology.orchestra.run.smithi150.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-02T15:25:57.954 INFO:teuthology.orchestra.run.smithi150.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3488-g2870bf45-1jammy [3,096 kB] 2023-06-02T15:25:57.956 INFO:teuthology.orchestra.run.smithi150.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-02T15:25:57.964 INFO:teuthology.orchestra.run.smithi150.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-02T15:25:58.107 INFO:teuthology.orchestra.run.smithi159.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-06-02T15:25:58.110 INFO:teuthology.orchestra.run.smithi159.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-06-02T15:25:58.118 INFO:teuthology.orchestra.run.smithi159.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-06-02T15:25:58.503 INFO:teuthology.orchestra.run.smithi132.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3488-g2870bf45-1jammy [31.5 MB] 2023-06-02T15:25:58.518 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3488-g2870bf45-1jammy [225 kB] 2023-06-02T15:25:58.560 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3488-g2870bf45-1jammy [114 kB] 2023-06-02T15:25:58.578 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3488-g2870bf45-1jammy [1,464 kB] 2023-06-02T15:25:58.819 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3488-g2870bf45-1jammy [9,864 kB] 2023-06-02T15:25:58.882 INFO:teuthology.orchestra.run.smithi159.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3488-g2870bf45-1jammy [102 kB] 2023-06-02T15:25:58.891 INFO:teuthology.orchestra.run.smithi159.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3488-g2870bf45-1jammy [431 kB] 2023-06-02T15:25:59.006 INFO:teuthology.orchestra.run.smithi159.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3488-g2870bf45-1jammy [21.8 MB] 2023-06-02T15:26:00.552 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3488-g2870bf45-1jammy [31.5 MB] 2023-06-02T15:26:03.572 INFO:teuthology.orchestra.run.smithi150.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3488-g2870bf45-1jammy [652 kB] 2023-06-02T15:26:03.875 INFO:teuthology.orchestra.run.smithi132.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3488-g2870bf45-1jammy [3,594 B] 2023-06-02T15:26:03.876 INFO:teuthology.orchestra.run.smithi132.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3488-g2870bf45-1jammy [806 kB] 2023-06-02T15:26:03.891 INFO:teuthology.orchestra.run.smithi132.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3488-g2870bf45-1jammy [2,144 kB] 2023-06-02T15:26:04.233 INFO:teuthology.orchestra.run.smithi132.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3488-g2870bf45-1jammy [211 kB] 2023-06-02T15:26:04.240 INFO:teuthology.orchestra.run.smithi132.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3488-g2870bf45-1jammy [124 kB] 2023-06-02T15:26:04.246 INFO:teuthology.orchestra.run.smithi132.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3488-g2870bf45-1jammy [1,821 kB] 2023-06-02T15:26:04.397 INFO:teuthology.orchestra.run.smithi150.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3488-g2870bf45-1jammy [344 kB] 2023-06-02T15:26:04.531 INFO:teuthology.orchestra.run.smithi132.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3488-g2870bf45-1jammy [8,615 kB] 2023-06-02T15:26:04.778 INFO:teuthology.orchestra.run.smithi150.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3488-g2870bf45-1jammy [22.9 kB] 2023-06-02T15:26:04.782 INFO:teuthology.orchestra.run.smithi150.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3488-g2870bf45-1jammy [164 kB] 2023-06-02T15:26:04.974 INFO:teuthology.orchestra.run.smithi150.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3488-g2870bf45-1jammy [48.9 kB] 2023-06-02T15:26:05.063 INFO:teuthology.orchestra.run.smithi150.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3488-g2870bf45-1jammy [319 kB] 2023-06-02T15:26:05.452 INFO:teuthology.orchestra.run.smithi150.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3488-g2870bf45-1jammy [5,841 kB] 2023-06-02T15:26:05.736 INFO:teuthology.orchestra.run.smithi132.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3488-g2870bf45-1jammy [3,720 B] 2023-06-02T15:26:05.736 INFO:teuthology.orchestra.run.smithi132.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3488-g2870bf45-1jammy [46.2 MB] 2023-06-02T15:26:07.504 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3488-g2870bf45-1jammy [3,594 B] 2023-06-02T15:26:07.505 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3488-g2870bf45-1jammy [806 kB] 2023-06-02T15:26:07.663 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3488-g2870bf45-1jammy [2,144 kB] 2023-06-02T15:26:08.032 INFO:teuthology.orchestra.run.smithi078.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3488-g2870bf45-1jammy [211 kB] 2023-06-02T15:26:08.083 INFO:teuthology.orchestra.run.smithi078.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3488-g2870bf45-1jammy [124 kB] 2023-06-02T15:26:08.100 INFO:teuthology.orchestra.run.smithi078.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3488-g2870bf45-1jammy [1,821 kB] 2023-06-02T15:26:08.247 INFO:teuthology.orchestra.run.smithi159.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3488-g2870bf45-1jammy [6,823 kB] 2023-06-02T15:26:08.493 INFO:teuthology.orchestra.run.smithi078.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3488-g2870bf45-1jammy [8,615 kB] 2023-06-02T15:26:10.287 INFO:teuthology.orchestra.run.smithi159.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3488-g2870bf45-1jammy [225 kB] 2023-06-02T15:26:10.292 INFO:teuthology.orchestra.run.smithi159.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3488-g2870bf45-1jammy [114 kB] 2023-06-02T15:26:10.344 INFO:teuthology.orchestra.run.smithi159.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3488-g2870bf45-1jammy [1,464 kB] 2023-06-02T15:26:10.401 INFO:teuthology.orchestra.run.smithi078.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3488-g2870bf45-1jammy [3,720 B] 2023-06-02T15:26:10.402 INFO:teuthology.orchestra.run.smithi078.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3488-g2870bf45-1jammy [46.2 MB] 2023-06-02T15:26:10.412 INFO:teuthology.orchestra.run.smithi150.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3488-g2870bf45-1jammy [102 kB] 2023-06-02T15:26:10.472 INFO:teuthology.orchestra.run.smithi150.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3488-g2870bf45-1jammy [431 kB] 2023-06-02T15:26:10.718 INFO:teuthology.orchestra.run.smithi159.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3488-g2870bf45-1jammy [9,864 kB] 2023-06-02T15:26:10.733 INFO:teuthology.orchestra.run.smithi150.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3488-g2870bf45-1jammy [21.8 MB] 2023-06-02T15:26:13.436 INFO:teuthology.orchestra.run.smithi159.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3488-g2870bf45-1jammy [31.5 MB] 2023-06-02T15:26:14.261 INFO:teuthology.orchestra.run.smithi132.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3488-g2870bf45-1jammy [237 kB] 2023-06-02T15:26:14.266 INFO:teuthology.orchestra.run.smithi132.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3488-g2870bf45-1jammy [214 kB] 2023-06-02T15:26:14.271 INFO:teuthology.orchestra.run.smithi132.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3488-g2870bf45-1jammy [23.8 kB] 2023-06-02T15:26:14.271 INFO:teuthology.orchestra.run.smithi132.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3488-g2870bf45-1jammy [13.2 kB] 2023-06-02T15:26:14.272 INFO:teuthology.orchestra.run.smithi132.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3488-g2870bf45-1jammy [27.7 kB] 2023-06-02T15:26:14.273 INFO:teuthology.orchestra.run.smithi132.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3488-g2870bf45-1jammy [11.5 MB] 2023-06-02T15:26:16.605 INFO:teuthology.orchestra.run.smithi150.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3488-g2870bf45-1jammy [6,823 kB] 2023-06-02T15:26:17.138 INFO:teuthology.orchestra.run.smithi132.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3488-g2870bf45-1jammy [82.2 kB] 2023-06-02T15:26:17.657 INFO:teuthology.orchestra.run.smithi150.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3488-g2870bf45-1jammy [225 kB] 2023-06-02T15:26:17.688 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 180 MB in 26s (6,965 kB/s) 2023-06-02T15:26:17.694 INFO:teuthology.orchestra.run.smithi150.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3488-g2870bf45-1jammy [114 kB] 2023-06-02T15:26:17.717 INFO:teuthology.orchestra.run.smithi150.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3488-g2870bf45-1jammy [1,464 kB] 2023-06-02T15:26:17.825 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-02T15:26:17.918 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-06-02T15:26:17.923 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-02T15:26:17.960 INFO:teuthology.orchestra.run.smithi150.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3488-g2870bf45-1jammy [9,864 kB] 2023-06-02T15:26:17.965 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-02T15:26:18.227 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-02T15:26:18.252 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-02T15:26:18.286 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-02T15:26:18.588 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cmd2. 2023-06-02T15:26:18.614 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-02T15:26:18.654 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-02T15:26:18.982 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-02T15:26:19.008 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-02T15:26:19.091 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-02T15:26:19.436 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-02T15:26:19.462 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-02T15:26:19.504 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-02T15:26:19.710 INFO:teuthology.orchestra.run.smithi150.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3488-g2870bf45-1jammy [31.5 MB] 2023-06-02T15:26:19.823 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-02T15:26:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-02T15:26:19.889 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-02T15:26:20.218 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-02T15:26:20.244 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-02T15:26:20.285 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-02T15:26:20.738 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-02T15:26:20.764 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:26:20.813 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:26:21.217 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-02T15:26:21.243 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:26:21.283 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:26:21.628 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-02T15:26:21.654 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:26:21.695 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:26:21.879 INFO:teuthology.orchestra.run.smithi159.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3488-g2870bf45-1jammy [3,594 B] 2023-06-02T15:26:21.880 INFO:teuthology.orchestra.run.smithi159.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3488-g2870bf45-1jammy [806 kB] 2023-06-02T15:26:21.929 INFO:teuthology.orchestra.run.smithi159.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3488-g2870bf45-1jammy [2,144 kB] 2023-06-02T15:26:22.048 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-02T15:26:22.074 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-02T15:26:22.114 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-02T15:26:22.401 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librados2. 2023-06-02T15:26:22.427 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../011-librados2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:22.468 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librados2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:22.607 INFO:teuthology.orchestra.run.smithi159.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3488-g2870bf45-1jammy [211 kB] 2023-06-02T15:26:22.691 INFO:teuthology.orchestra.run.smithi159.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3488-g2870bf45-1jammy [124 kB] 2023-06-02T15:26:22.738 INFO:teuthology.orchestra.run.smithi159.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3488-g2870bf45-1jammy [1,821 kB] 2023-06-02T15:26:22.912 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librbd1. 2023-06-02T15:26:22.938 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../012-librbd1_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:22.979 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librbd1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:23.275 INFO:teuthology.orchestra.run.smithi078.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3488-g2870bf45-1jammy [237 kB] 2023-06-02T15:26:23.280 INFO:teuthology.orchestra.run.smithi078.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3488-g2870bf45-1jammy [214 kB] 2023-06-02T15:26:23.284 INFO:teuthology.orchestra.run.smithi078.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3488-g2870bf45-1jammy [23.8 kB] 2023-06-02T15:26:23.343 INFO:teuthology.orchestra.run.smithi078.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3488-g2870bf45-1jammy [13.2 kB] 2023-06-02T15:26:23.343 INFO:teuthology.orchestra.run.smithi078.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3488-g2870bf45-1jammy [27.7 kB] 2023-06-02T15:26:23.344 INFO:teuthology.orchestra.run.smithi078.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3488-g2870bf45-1jammy [11.5 MB] 2023-06-02T15:26:23.423 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libcephfs2. 2023-06-02T15:26:23.449 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:23.450 INFO:teuthology.orchestra.run.smithi159.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3488-g2870bf45-1jammy [8,615 kB] 2023-06-02T15:26:23.490 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libcephfs2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:23.734 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rados. 2023-06-02T15:26:23.749 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:23.784 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rados (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:24.104 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-02T15:26:24.130 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:26:24.170 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-ceph-argparse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:25.059 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cephfs. 2023-06-02T15:26:25.084 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:25.123 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cephfs (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:25.435 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-02T15:26:25.461 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:26:25.493 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:25.502 INFO:teuthology.orchestra.run.smithi078.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3488-g2870bf45-1jammy [82.2 kB] 2023-06-02T15:26:25.788 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-prettytable. 2023-06-02T15:26:25.814 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-02T15:26:25.855 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-02T15:26:26.055 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 180 MB in 34s (5,229 kB/s) 2023-06-02T15:26:26.124 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rbd. 2023-06-02T15:26:26.139 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:26.164 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-02T15:26:26.182 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rbd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:26.252 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-06-02T15:26:26.257 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-02T15:26:26.296 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-02T15:26:26.494 INFO:teuthology.orchestra.run.smithi159.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3488-g2870bf45-1jammy [3,720 B] 2023-06-02T15:26:26.495 INFO:teuthology.orchestra.run.smithi159.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3488-g2870bf45-1jammy [46.2 MB] 2023-06-02T15:26:26.496 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-02T15:26:26.522 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-02T15:26:26.554 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-02T15:26:26.599 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-02T15:26:26.625 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-02T15:26:26.666 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-02T15:26:26.882 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package librgw2. 2023-06-02T15:26:26.908 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../021-librgw2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:26.949 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking librgw2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:26.960 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cmd2. 2023-06-02T15:26:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-02T15:26:27.026 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-02T15:26:27.337 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-02T15:26:27.363 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-02T15:26:27.446 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-02T15:26:27.451 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rgw. 2023-06-02T15:26:27.466 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:27.518 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:27.716 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-02T15:26:27.742 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-02T15:26:27.782 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-02T15:26:27.838 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-02T15:26:27.864 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-02T15:26:27.896 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-02T15:26:28.127 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-02T15:26:28.153 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-02T15:26:28.191 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libradosstriper1. 2023-06-02T15:26:28.193 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-02T15:26:28.217 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:28.259 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libradosstriper1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:28.555 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-02T15:26:28.581 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-02T15:26:28.621 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-02T15:26:28.678 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-common. 2023-06-02T15:26:28.704 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:28.744 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:29.000 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-02T15:26:29.027 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:26:29.066 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:26:29.332 INFO:teuthology.orchestra.run.smithi150.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3488-g2870bf45-1jammy [3,594 B] 2023-06-02T15:26:29.403 INFO:teuthology.orchestra.run.smithi150.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3488-g2870bf45-1jammy [806 kB] 2023-06-02T15:26:29.453 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-02T15:26:29.479 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:26:29.519 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:26:29.765 INFO:teuthology.orchestra.run.smithi150.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3488-g2870bf45-1jammy [2,144 kB] 2023-06-02T15:26:29.847 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-02T15:26:29.873 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:26:29.914 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:26:30.009 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-base. 2023-06-02T15:26:30.036 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:30.110 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-base (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:30.209 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-02T15:26:30.224 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-02T15:26:30.258 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-02T15:26:30.536 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librados2. 2023-06-02T15:26:30.562 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-librados2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:30.602 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:30.813 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-02T15:26:30.839 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-02T15:26:30.879 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-02T15:26:31.072 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librbd1. 2023-06-02T15:26:31.098 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-librbd1_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:31.127 INFO:teuthology.orchestra.run.smithi150.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3488-g2870bf45-1jammy [211 kB] 2023-06-02T15:26:31.157 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cheroot. 2023-06-02T15:26:31.183 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-02T15:26:31.224 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-02T15:26:31.248 INFO:teuthology.orchestra.run.smithi150.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3488-g2870bf45-1jammy [124 kB] 2023-06-02T15:26:31.272 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:31.318 INFO:teuthology.orchestra.run.smithi150.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3488-g2870bf45-1jammy [1,821 kB] 2023-06-02T15:26:31.519 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-02T15:26:31.545 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-02T15:26:31.577 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-02T15:26:31.674 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2023-06-02T15:26:31.701 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:31.741 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:31.880 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-02T15:26:31.906 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-02T15:26:31.947 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-02T15:26:32.010 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2023-06-02T15:26:32.036 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:32.076 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:32.250 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-02T15:26:32.276 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-02T15:26:32.316 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-02T15:26:32.328 INFO:teuthology.orchestra.run.smithi150.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3488-g2870bf45-1jammy [8,615 kB] 2023-06-02T15:26:32.413 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-02T15:26:32.439 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:26:32.479 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:32.611 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-tempora. 2023-06-02T15:26:32.637 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-02T15:26:32.669 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-02T15:26:32.715 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2023-06-02T15:26:32.741 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:32.782 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:32.956 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-portend. 2023-06-02T15:26:32.982 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-02T15:26:33.022 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-02T15:26:33.076 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-02T15:26:33.102 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:26:33.142 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:33.309 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-02T15:26:33.335 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-02T15:26:33.383 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-02T15:26:33.487 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2023-06-02T15:26:33.513 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-02T15:26:33.553 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-02T15:26:33.679 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-02T15:26:33.705 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-02T15:26:33.745 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-02T15:26:33.797 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2023-06-02T15:26:33.824 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:33.865 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:34.065 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-natsort. 2023-06-02T15:26:34.081 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-02T15:26:34.115 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-02T15:26:34.167 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-02T15:26:34.193 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-02T15:26:34.225 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-02T15:26:34.377 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-logutils. 2023-06-02T15:26:34.404 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-02T15:26:34.444 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-02T15:26:34.486 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2023-06-02T15:26:34.512 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-librgw2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:34.553 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:34.764 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-02T15:26:34.790 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-02T15:26:34.830 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-02T15:26:35.047 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2023-06-02T15:26:35.062 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:35.105 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:35.133 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-mako. 2023-06-02T15:26:35.159 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-02T15:26:35.199 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-02T15:26:35.450 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-02T15:26:35.476 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-02T15:26:35.516 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-02T15:26:35.528 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-02T15:26:35.554 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-02T15:26:35.595 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-02T15:26:35.760 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2023-06-02T15:26:35.775 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:35.810 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:35.872 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-02T15:26:35.899 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-02T15:26:35.939 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-02T15:26:36.205 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2023-06-02T15:26:36.209 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-webob. 2023-06-02T15:26:36.231 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:36.235 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-02T15:26:36.271 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:36.275 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-02T15:26:36.603 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-waitress. 2023-06-02T15:26:36.630 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-02T15:26:36.673 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-02T15:26:36.948 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-tempita. 2023-06-02T15:26:36.975 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-02T15:26:37.015 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-02T15:26:37.318 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-paste. 2023-06-02T15:26:37.344 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-02T15:26:37.384 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-02T15:26:37.527 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2023-06-02T15:26:37.553 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:37.603 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:37.713 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-02T15:26:37.728 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-02T15:26:37.763 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-02T15:26:38.057 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-02T15:26:38.084 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-02T15:26:38.124 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-02T15:26:38.356 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-02T15:26:38.382 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-02T15:26:38.410 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-webtest. 2023-06-02T15:26:38.424 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-02T15:26:38.437 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-02T15:26:38.477 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-02T15:26:38.701 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cheroot. 2023-06-02T15:26:38.727 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-02T15:26:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-02T15:26:38.780 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pecan. 2023-06-02T15:26:38.806 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-02T15:26:38.846 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-02T15:26:39.028 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-02T15:26:39.044 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-02T15:26:39.080 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-02T15:26:39.185 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-certifi. 2023-06-02T15:26:39.212 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-02T15:26:39.251 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-02T15:26:39.365 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-02T15:26:39.381 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-02T15:26:39.423 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-02T15:26:39.455 INFO:teuthology.orchestra.run.smithi150.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3488-g2870bf45-1jammy [3,720 B] 2023-06-02T15:26:39.464 INFO:teuthology.orchestra.run.smithi150.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3488-g2870bf45-1jammy [46.2 MB] 2023-06-02T15:26:39.555 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-idna. 2023-06-02T15:26:39.581 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-02T15:26:39.621 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-02T15:26:39.684 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-02T15:26:39.699 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-02T15:26:39.734 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-02T15:26:39.933 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-urllib3. 2023-06-02T15:26:39.959 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-02T15:26:39.999 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-02T15:26:40.028 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempora. 2023-06-02T15:26:40.055 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-02T15:26:40.095 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-02T15:26:40.328 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-requests. 2023-06-02T15:26:40.355 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-06-02T15:26:40.397 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-portend. 2023-06-02T15:26:40.403 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-06-02T15:26:40.424 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-02T15:26:40.464 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-02T15:26:40.714 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-02T15:26:40.741 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-02T15:26:40.750 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-02T15:26:40.766 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-02T15:26:40.780 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-02T15:26:40.800 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-02T15:26:41.061 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-02T15:26:41.075 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-02T15:26:41.086 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-02T15:26:41.091 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:26:41.128 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-02T15:26:41.133 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:41.473 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-natsort. 2023-06-02T15:26:41.481 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-02T15:26:41.500 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-02T15:26:41.507 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-02T15:26:41.572 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:41.809 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2023-06-02T15:26:41.825 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-02T15:26:41.859 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-02T15:26:41.892 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-openssl. 2023-06-02T15:26:41.919 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-02T15:26:41.958 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-02T15:26:42.146 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-02T15:26:42.172 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-02T15:26:42.211 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-02T15:26:42.312 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr. 2023-06-02T15:26:42.339 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:42.378 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:42.497 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2023-06-02T15:26:42.524 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-02T15:26:42.564 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-02T15:26:42.732 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mon. 2023-06-02T15:26:42.758 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:42.790 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mon (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:42.884 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-02T15:26:42.911 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-02T15:26:42.950 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-02T15:26:43.236 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-02T15:26:43.263 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-02T15:26:43.303 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-02T15:26:43.706 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2023-06-02T15:26:43.732 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-02T15:26:43.772 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-02T15:26:43.919 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-osd. 2023-06-02T15:26:43.945 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:43.985 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-osd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:44.125 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2023-06-02T15:26:44.152 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-02T15:26:44.195 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-02T15:26:44.503 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2023-06-02T15:26:44.530 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-02T15:26:44.569 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-02T15:26:44.856 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2023-06-02T15:26:44.882 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-02T15:26:44.922 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-02T15:26:45.267 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-02T15:26:45.294 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-02T15:26:45.333 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-02T15:26:45.636 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-02T15:26:45.663 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-02T15:26:45.703 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-02T15:26:45.847 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph. 2023-06-02T15:26:45.862 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../061-ceph_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:45.897 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:45.972 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2023-06-02T15:26:45.999 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-02T15:26:46.030 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-02T15:26:46.183 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-fuse. 2023-06-02T15:26:46.209 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:46.250 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:46.292 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2023-06-02T15:26:46.318 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-02T15:26:46.358 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-02T15:26:46.620 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mds. 2023-06-02T15:26:46.646 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:46.687 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mds (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:46.688 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-certifi. 2023-06-02T15:26:46.715 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-02T15:26:46.746 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-02T15:26:47.032 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-idna. 2023-06-02T15:26:47.057 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephadm. 2023-06-02T15:26:47.058 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-02T15:26:47.083 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../064-cephadm_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:47.098 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-02T15:26:47.115 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:47.409 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-02T15:26:47.418 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-urllib3. 2023-06-02T15:26:47.436 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-02T15:26:47.444 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-02T15:26:47.476 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-02T15:26:47.485 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-02T15:26:47.771 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-02T15:26:47.797 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-02T15:26:47.813 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests. 2023-06-02T15:26:47.829 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-02T15:26:47.839 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-06-02T15:26:47.879 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-06-02T15:26:48.215 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-02T15:26:48.242 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-02T15:26:48.283 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-02T15:26:48.577 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-02T15:26:48.603 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:26:48.643 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:48.851 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-babel. 2023-06-02T15:26:48.878 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-02T15:26:48.918 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-02T15:26:48.981 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-02T15:26:49.008 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:49.039 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:49.238 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-jinja2. 2023-06-02T15:26:49.264 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-02T15:26:49.304 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-02T15:26:49.351 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2023-06-02T15:26:49.377 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-02T15:26:49.417 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-02T15:26:49.658 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-02T15:26:49.684 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:26:49.749 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:49.753 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2023-06-02T15:26:49.779 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:49.820 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:50.086 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-02T15:26:50.113 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-02T15:26:50.148 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2023-06-02T15:26:50.153 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-02T15:26:50.174 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:50.206 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:50.465 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pluggy. 2023-06-02T15:26:50.491 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-02T15:26:50.535 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-02T15:26:50.801 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-py. 2023-06-02T15:26:50.827 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-06-02T15:26:50.867 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-02T15:26:51.151 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2023-06-02T15:26:51.154 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-02T15:26:51.170 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-02T15:26:51.177 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:51.204 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-02T15:26:51.217 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:51.313 INFO:teuthology.orchestra.run.smithi159.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3488-g2870bf45-1jammy [237 kB] 2023-06-02T15:26:51.428 INFO:teuthology.orchestra.run.smithi159.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3488-g2870bf45-1jammy [214 kB] 2023-06-02T15:26:51.432 INFO:teuthology.orchestra.run.smithi159.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3488-g2870bf45-1jammy [23.8 kB] 2023-06-02T15:26:51.433 INFO:teuthology.orchestra.run.smithi159.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3488-g2870bf45-1jammy [13.2 kB] 2023-06-02T15:26:51.433 INFO:teuthology.orchestra.run.smithi159.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3488-g2870bf45-1jammy [27.7 kB] 2023-06-02T15:26:51.451 INFO:teuthology.orchestra.run.smithi159.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3488-g2870bf45-1jammy [11.5 MB] 2023-06-02T15:26:51.507 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-toml. 2023-06-02T15:26:51.534 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-06-02T15:26:51.574 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-02T15:26:51.877 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pytest. 2023-06-02T15:26:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-02T15:26:51.943 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-02T15:26:52.289 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-02T15:26:52.316 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-06-02T15:26:52.355 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-02T15:26:52.942 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-routes. 2023-06-02T15:26:52.969 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-02T15:26:53.009 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-02T15:26:53.037 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2023-06-02T15:26:53.063 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-ceph_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:53.104 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:53.346 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-02T15:26:53.372 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:26:53.381 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2023-06-02T15:26:53.397 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:53.412 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:53.431 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:53.787 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2023-06-02T15:26:53.813 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:53.849 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-02T15:26:53.853 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:53.876 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-02T15:26:53.916 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-02T15:26:54.223 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2023-06-02T15:26:54.238 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-cephadm_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:26:54.273 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:54.436 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-joblib. 2023-06-02T15:26:54.463 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-02T15:26:54.502 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-02T15:26:54.551 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-02T15:26:54.577 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-02T15:26:54.617 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-02T15:26:54.840 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-02T15:26:54.867 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-02T15:26:54.898 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-02T15:26:54.912 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-02T15:26:54.929 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-02T15:26:54.970 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-02T15:26:55.168 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-sklearn. 2023-06-02T15:26:55.194 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-02T15:26:55.234 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-02T15:26:55.901 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-babel. 2023-06-02T15:26:55.928 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-02T15:26:55.967 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-02T15:26:55.995 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-02T15:26:56.022 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:26:56.062 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:56.287 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2023-06-02T15:26:56.314 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-02T15:26:56.354 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-02T15:26:56.699 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-02T15:26:56.726 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:26:56.765 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:26:57.040 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-cachetools. 2023-06-02T15:26:57.068 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-06-02T15:26:57.106 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-02T15:26:57.119 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-02T15:26:57.146 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-02T15:26:57.186 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-02T15:26:57.385 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-02T15:26:57.411 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-02T15:26:57.430 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2023-06-02T15:26:57.451 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-02T15:26:57.457 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-02T15:26:57.497 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-02T15:26:57.640 INFO:teuthology.orchestra.run.smithi159.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3488-g2870bf45-1jammy [82.2 kB] 2023-06-02T15:26:57.788 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-02T15:26:57.808 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2023-06-02T15:26:57.816 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-02T15:26:57.835 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-06-02T15:26:57.855 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-02T15:26:57.875 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-02T15:26:58.181 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 180 MB in 1min 6s (2,715 kB/s) 2023-06-02T15:26:58.187 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-02T15:26:58.192 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-rsa. 2023-06-02T15:26:58.202 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-02T15:26:58.218 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-06-02T15:26:58.237 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-02T15:26:58.258 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-02T15:26:58.294 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-02T15:26:58.385 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-06-02T15:26:58.390 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-02T15:26:58.426 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-02T15:26:58.507 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-toml. 2023-06-02T15:26:58.533 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-06-02T15:26:58.570 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-google-auth. 2023-06-02T15:26:58.573 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-02T15:26:58.597 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-06-02T15:26:58.636 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-02T15:26:58.729 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-02T15:26:58.756 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-02T15:26:58.796 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-02T15:26:58.876 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2023-06-02T15:26:58.903 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-02T15:26:58.943 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-02T15:26:58.948 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-02T15:26:58.975 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-02T15:26:59.015 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-02T15:26:59.115 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-cmd2. 2023-06-02T15:26:59.141 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-02T15:26:59.182 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-02T15:26:59.276 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-websocket. 2023-06-02T15:26:59.280 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-02T15:26:59.292 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-06-02T15:26:59.307 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-06-02T15:26:59.326 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-02T15:26:59.346 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-02T15:26:59.518 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-02T15:26:59.544 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-02T15:26:59.626 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-02T15:26:59.647 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-02T15:26:59.649 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2023-06-02T15:26:59.674 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-02T15:26:59.676 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-02T15:26:59.713 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-02T15:26:59.716 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-02T15:26:59.905 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-02T15:26:59.930 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-02T15:26:59.963 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-02T15:27:00.070 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-02T15:27:00.096 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:00.136 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:00.283 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-02T15:27:00.309 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-02T15:27:00.336 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-02T15:27:00.349 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-02T15:27:00.363 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:00.402 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:00.531 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-02T15:27:00.547 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-02T15:27:00.589 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-02T15:27:00.694 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-02T15:27:00.697 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-02T15:27:00.720 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-02T15:27:00.724 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-02T15:27:00.760 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-02T15:27:00.763 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-02T15:27:01.035 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2023-06-02T15:27:01.058 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-02T15:27:01.062 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-02T15:27:01.085 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-02T15:27:01.093 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-02T15:27:01.124 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-02T15:27:01.147 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-02T15:27:01.174 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:27:01.222 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:01.394 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package jq. 2023-06-02T15:27:01.410 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-02T15:27:01.447 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-02T15:27:01.452 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-02T15:27:01.473 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-02T15:27:01.513 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-02T15:27:01.592 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-02T15:27:01.618 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:27:01.714 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package socat. 2023-06-02T15:27:01.729 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-02T15:27:01.772 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-02T15:27:01.817 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:02.000 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2023-06-02T15:27:02.026 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-02T15:27:02.084 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package xmlstarlet. 2023-06-02T15:27:02.099 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-02T15:27:02.133 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-02T15:27:02.141 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-02T15:27:02.161 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-02T15:27:02.188 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:27:02.237 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:02.480 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-test. 2023-06-02T15:27:02.507 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../098-ceph-test_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:02.538 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-test (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:02.590 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-02T15:27:02.616 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-02T15:27:02.656 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-02T15:27:02.959 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package librados2. 2023-06-02T15:27:02.977 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-02T15:27:02.985 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../011-librados2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:03.004 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:03.026 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking librados2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:03.043 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:03.470 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package librbd1. 2023-06-02T15:27:03.496 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../012-librbd1_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:03.537 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking librbd1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:03.973 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libcephfs2. 2023-06-02T15:27:03.999 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:04.014 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2023-06-02T15:27:04.040 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libcephfs2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:04.040 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-06-02T15:27:04.080 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-02T15:27:04.292 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-rados. 2023-06-02T15:27:04.307 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:04.342 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-rados (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:04.366 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-02T15:27:04.393 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-02T15:27:04.433 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-02T15:27:04.661 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-02T15:27:04.688 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:04.728 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-ceph-argparse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:04.767 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ceph-volume. 2023-06-02T15:27:04.770 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-02T15:27:04.783 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../099-ceph-volume_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:04.797 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-02T15:27:04.825 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ceph-volume (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:04.837 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-02T15:27:04.964 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-cephfs. 2023-06-02T15:27:04.979 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:05.022 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-cephfs (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:05.124 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-02T15:27:05.148 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2023-06-02T15:27:05.151 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../100-cephfs-mirror_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:05.175 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-06-02T15:27:05.182 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephfs-mirror (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:05.215 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-02T15:27:05.317 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-02T15:27:05.343 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:05.375 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:05.493 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2023-06-02T15:27:05.502 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-colorama. 2023-06-02T15:27:05.520 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-06-02T15:27:05.529 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-06-02T15:27:05.551 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-02T15:27:05.568 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-02T15:27:05.669 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-prettytable. 2023-06-02T15:27:05.696 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-02T15:27:05.736 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-02T15:27:05.829 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephfs-shell. 2023-06-02T15:27:05.845 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../102-cephfs-shell_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:05.855 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-02T15:27:05.882 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-02T15:27:05.887 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephfs-shell (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:05.921 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-02T15:27:05.997 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-rbd. 2023-06-02T15:27:06.012 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:06.055 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-rbd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:06.190 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package cephfs-top. 2023-06-02T15:27:06.218 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../103-cephfs-top_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:06.233 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2023-06-02T15:27:06.248 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking cephfs-top (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:06.260 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-06-02T15:27:06.299 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-02T15:27:06.425 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-02T15:27:06.451 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-02T15:27:06.484 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-02T15:27:06.491 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-02T15:27:06.500 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../104-libcephfs-dev_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:06.543 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libcephfs-dev (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:06.611 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-02T15:27:06.638 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-02T15:27:06.677 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-02T15:27:06.921 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package nvme-cli. 2023-06-02T15:27:06.928 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package librgw2. 2023-06-02T15:27:06.948 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-02T15:27:06.955 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../021-librgw2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:06.986 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking librgw2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:06.987 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-02T15:27:07.334 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-02T15:27:07.343 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-02T15:27:07.358 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-02T15:27:07.361 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:07.400 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:07.400 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-02T15:27:07.497 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-rgw. 2023-06-02T15:27:07.512 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:07.555 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-rgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:07.744 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-02T15:27:07.771 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-02T15:27:07.811 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-02T15:27:07.837 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pastescript. 2023-06-02T15:27:07.864 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-06-02T15:27:07.891 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-02T15:27:07.904 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-02T15:27:07.918 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-02T15:27:07.958 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-02T15:27:08.081 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-02T15:27:08.108 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-02T15:27:08.147 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-02T15:27:08.216 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-psutil. 2023-06-02T15:27:08.243 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-02T15:27:08.252 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libradosstriper1. 2023-06-02T15:27:08.278 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:08.282 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-02T15:27:08.319 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libradosstriper1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:08.375 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2023-06-02T15:27:08.402 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-02T15:27:08.442 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-02T15:27:08.618 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pygments. 2023-06-02T15:27:08.645 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-02T15:27:08.685 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-02T15:27:08.694 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2023-06-02T15:27:08.722 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-02T15:27:08.723 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-common. 2023-06-02T15:27:08.749 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:08.761 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-02T15:27:08.788 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:09.073 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2023-06-02T15:27:09.100 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-02T15:27:09.139 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-02T15:27:09.140 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-02T15:27:09.166 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-02T15:27:09.205 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-02T15:27:09.475 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package python3-simplejson. 2023-06-02T15:27:09.486 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2023-06-02T15:27:09.491 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-02T15:27:09.501 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-ceph-test_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:09.525 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-02T15:27:09.544 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:09.769 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-02T15:27:09.785 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-02T15:27:09.827 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-02T15:27:10.053 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-base. 2023-06-02T15:27:10.079 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:10.136 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-base (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:10.581 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package radosgw. 2023-06-02T15:27:10.609 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../113-radosgw_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:10.656 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking radosgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:10.865 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-02T15:27:10.891 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-02T15:27:10.932 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-02T15:27:11.234 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-cheroot. 2023-06-02T15:27:11.375 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-02T15:27:11.376 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-02T15:27:11.376 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package rbd-fuse. 2023-06-02T15:27:11.403 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:11.432 INFO:teuthology.orchestra.run.smithi150.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3488-g2870bf45-1jammy [237 kB] 2023-06-02T15:27:11.442 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking rbd-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:11.621 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-02T15:27:11.647 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-02T15:27:11.681 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-volume. 2023-06-02T15:27:11.688 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-02T15:27:11.693 INFO:teuthology.orchestra.run.smithi150.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3488-g2870bf45-1jammy [214 kB] 2023-06-02T15:27:11.708 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-ceph-volume_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:11.748 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-volume (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:11.754 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-02T15:27:11.905 INFO:teuthology.orchestra.run.smithi150.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3488-g2870bf45-1jammy [23.8 kB] 2023-06-02T15:27:11.908 INFO:teuthology.orchestra.run.smithi150.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3488-g2870bf45-1jammy [13.2 kB] 2023-06-02T15:27:11.940 INFO:teuthology.orchestra.run.smithi150.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3488-g2870bf45-1jammy [27.7 kB] 2023-06-02T15:27:11.959 INFO:teuthology.orchestra.run.smithi150.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3488-g2870bf45-1jammy [11.5 MB] 2023-06-02T15:27:11.989 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-02T15:27:12.078 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-02T15:27:12.105 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-cephfs-mirror_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:12.123 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-02T15:27:12.144 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-mirror (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:12.165 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-02T15:27:12.192 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-02T15:27:12.232 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-02T15:27:12.384 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-02T15:27:12.473 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-colorama. 2023-06-02T15:27:12.500 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-06-02T15:27:12.510 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-02T15:27:12.536 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-02T15:27:12.539 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-02T15:27:12.576 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-02T15:27:12.716 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-02T15:27:12.775 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-shell. 2023-06-02T15:27:12.790 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../102-cephfs-shell_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:12.825 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-shell (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:12.829 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-tempora. 2023-06-02T15:27:12.844 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-02T15:27:12.887 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-02T15:27:13.086 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-top. 2023-06-02T15:27:13.102 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../103-cephfs-top_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:13.144 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-top (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:13.190 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-portend. 2023-06-02T15:27:13.216 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-02T15:27:13.219 INFO:teuthology.orchestra.run.smithi132.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-02T15:27:13.257 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-02T15:27:13.292 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:13.406 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-02T15:27:13.433 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../104-libcephfs-dev_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:13.472 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:13.559 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-02T15:27:13.586 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-02T15:27:13.626 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-02T15:27:13.743 INFO:teuthology.orchestra.run.smithi132.stdout:Adding system user cephadm....done 2023-06-02T15:27:13.792 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2023-06-02T15:27:13.807 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-02T15:27:13.842 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-02T15:27:13.895 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-02T15:27:13.898 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-02T15:27:13.922 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-02T15:27:13.971 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-02T15:27:14.164 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-02T15:27:14.175 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-02T15:27:14.191 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-02T15:27:14.222 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-02T15:27:14.308 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-natsort. 2023-06-02T15:27:14.334 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-02T15:27:14.374 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-02T15:27:14.434 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-02T15:27:14.560 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-02T15:27:14.600 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2023-06-02T15:27:14.616 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-06-02T15:27:14.650 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-02T15:27:14.685 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-logutils. 2023-06-02T15:27:14.712 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-02T15:27:14.752 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-02T15:27:14.786 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-02T15:27:14.928 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2023-06-02T15:27:14.956 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-02T15:27:14.995 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-02T15:27:15.005 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-02T15:27:15.021 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-02T15:27:15.031 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-02T15:27:15.071 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-02T15:27:15.147 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-02T15:27:15.298 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pygments. 2023-06-02T15:27:15.325 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-02T15:27:15.365 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-02T15:27:15.374 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-mako. 2023-06-02T15:27:15.402 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-02T15:27:15.441 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-02T15:27:15.474 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-02T15:27:15.777 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-02T15:27:15.793 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-02T15:27:15.794 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-02T15:27:15.821 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-02T15:27:15.834 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-02T15:27:15.835 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-02T15:27:15.861 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-02T15:27:16.093 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-02T15:27:16.122 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-02T15:27:16.137 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-02T15:27:16.138 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplejson. 2023-06-02T15:27:16.166 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-02T15:27:16.172 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-02T15:27:16.205 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-02T15:27:16.328 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-02T15:27:16.458 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-webob. 2023-06-02T15:27:16.474 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-02T15:27:16.484 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-02T15:27:16.502 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-02T15:27:16.524 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-02T15:27:16.540 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-02T15:27:16.571 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-02T15:27:16.813 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-02T15:27:16.877 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-waitress. 2023-06-02T15:27:16.904 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-02T15:27:16.948 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-02T15:27:17.073 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-02T15:27:17.264 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-tempita. 2023-06-02T15:27:17.270 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2023-06-02T15:27:17.290 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-02T15:27:17.297 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../113-radosgw_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:17.330 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-02T15:27:17.336 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:17.341 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-ceph-argparse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:17.591 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-paste. 2023-06-02T15:27:17.601 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-02T15:27:17.618 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-02T15:27:17.649 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-02T15:27:17.876 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-02T15:27:18.003 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-02T15:27:18.029 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-02T15:27:18.069 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-02T15:27:18.098 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2023-06-02T15:27:18.114 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:18.136 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-02T15:27:18.156 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:18.339 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-02T15:27:18.354 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-02T15:27:18.370 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-02T15:27:18.389 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-02T15:27:18.443 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-02T15:27:18.513 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-02T15:27:18.658 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-webtest. 2023-06-02T15:27:18.685 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-02T15:27:18.694 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-02T15:27:18.725 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-02T15:27:18.812 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-02T15:27:18.856 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-02T15:27:18.991 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-02T15:27:19.019 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pecan. 2023-06-02T15:27:19.045 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-02T15:27:19.073 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-02T15:27:19.086 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-02T15:27:19.249 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-02T15:27:19.426 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-02T15:27:19.441 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-certifi. 2023-06-02T15:27:19.467 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-02T15:27:19.508 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-02T15:27:19.518 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-02T15:27:19.819 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-02T15:27:19.843 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-idna. 2023-06-02T15:27:19.870 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-02T15:27:19.910 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-02T15:27:19.923 INFO:teuthology.orchestra.run.smithi078.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-02T15:27:20.082 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:20.188 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-urllib3. 2023-06-02T15:27:20.214 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-02T15:27:20.246 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-02T15:27:20.495 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-02T15:27:20.541 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-requests. 2023-06-02T15:27:20.567 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-06-02T15:27:20.599 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-06-02T15:27:20.738 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-02T15:27:20.866 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2023-06-02T15:27:20.873 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-02T15:27:20.877 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-02T15:27:20.904 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-02T15:27:20.943 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-02T15:27:20.999 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-02T15:27:21.022 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-02T15:27:21.213 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-02T15:27:21.228 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:21.263 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:21.290 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-02T15:27:21.308 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-02T15:27:21.542 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-02T15:27:21.667 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-02T15:27:21.668 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-02T15:27:21.694 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:21.701 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-02T15:27:21.734 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:21.919 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-02T15:27:21.943 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-02T15:27:22.029 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-openssl. 2023-06-02T15:27:22.044 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-02T15:27:22.079 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-02T15:27:22.170 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-02T15:27:22.295 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-02T15:27:22.296 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-02T15:27:22.407 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr. 2023-06-02T15:27:22.434 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:22.474 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:22.563 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-02T15:27:22.590 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-02T15:27:22.865 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-02T15:27:22.868 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mon. 2023-06-02T15:27:22.895 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:22.935 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mon (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:22.949 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-02T15:27:23.208 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-02T15:27:23.209 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-02T15:27:23.458 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-02T15:27:23.477 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-02T15:27:23.728 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-02T15:27:23.805 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-osd. 2023-06-02T15:27:23.831 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:23.872 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-osd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:23.893 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:23.918 INFO:teuthology.orchestra.run.smithi150.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/reef-release/2870bf456d3115490c153abce9d47ac5c043b65e/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3488-g2870bf45-1jammy [82.2 kB] 2023-06-02T15:27:23.979 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-02T15:27:24.178 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-idna (3.3-1) ... 2023-06-02T15:27:24.231 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-02T15:27:24.462 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-02T15:27:24.465 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:24.508 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 180 MB in 1min 33s (1,940 kB/s) 2023-06-02T15:27:24.626 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyperclip. 2023-06-02T15:27:24.683 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165999 files and directories currently installed.) 2023-06-02T15:27:24.688 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-06-02T15:27:24.733 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-02T15:27:24.759 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-06-02T15:27:24.859 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-02T15:27:25.045 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-wcwidth. 2023-06-02T15:27:25.061 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-06-02T15:27:25.103 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-02T15:27:25.119 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-02T15:27:25.361 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-02T15:27:25.423 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cmd2. 2023-06-02T15:27:25.449 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-06-02T15:27:25.479 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-02T15:27:25.489 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-06-02T15:27:25.660 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:25.741 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph. 2023-06-02T15:27:25.757 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../061-ceph_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:25.784 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libfmt8:amd64. 2023-06-02T15:27:25.785 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-02T15:27:25.800 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:25.810 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-06-02T15:27:25.839 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-02T15:27:25.892 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-02T15:27:25.948 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-02T15:27:26.011 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-02T15:27:26.112 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-02T15:27:26.119 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-fuse. 2023-06-02T15:27:26.146 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:26.186 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:26.216 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-02T15:27:26.222 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-02T15:27:26.237 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-06-02T15:27:26.264 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-06-02T15:27:26.304 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-02T15:27:26.483 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-02T15:27:26.523 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-02T15:27:26.558 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mds. 2023-06-02T15:27:26.584 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:26.624 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-06-02T15:27:26.624 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mds (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:26.650 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-06-02T15:27:26.682 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-02T15:27:26.776 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-02T15:27:26.791 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-02T15:27:27.002 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-06-02T15:27:27.010 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package cephadm. 2023-06-02T15:27:27.028 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-06-02T15:27:27.037 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../064-cephadm_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:27.042 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:27.068 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-02T15:27:27.077 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:27.168 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-02T15:27:27.277 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-02T15:27:27.395 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-02T15:27:27.397 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-02T15:27:27.423 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-02T15:27:27.463 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-02T15:27:27.539 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-06-02T15:27:27.566 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:27:27.587 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-02T15:27:27.614 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:27.663 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-02T15:27:27.789 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-02T15:27:27.791 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-02T15:27:27.818 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-02T15:27:27.830 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-02T15:27:27.858 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-02T15:27:27.915 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-02T15:27:27.967 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-06-02T15:27:27.994 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:27:28.033 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:28.098 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-02T15:27:28.208 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-02T15:27:28.349 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-02T15:27:28.378 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-06-02T15:27:28.405 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-06-02T15:27:28.445 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:28.592 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-02T15:27:28.617 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-02T15:27:28.806 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-06-02T15:27:28.833 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-06-02T15:27:28.835 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-02T15:27:28.855 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-babel. 2023-06-02T15:27:28.873 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-02T15:27:28.882 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-02T15:27:28.884 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-02T15:27:28.921 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-02T15:27:29.010 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-02T15:27:29.142 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librados2. 2023-06-02T15:27:29.158 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../011-librados2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:29.192 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librados2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:29.220 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-02T15:27:29.242 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-jinja2. 2023-06-02T15:27:29.268 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-02T15:27:29.270 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-02T15:27:29.324 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-02T15:27:29.379 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-02T15:27:29.513 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-02T15:27:29.637 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librbd1. 2023-06-02T15:27:29.655 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-02T15:27:29.664 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../012-librbd1_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:29.678 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-02T15:27:29.704 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:29.744 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:29.798 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-02T15:27:29.865 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librbd1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:29.965 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-02T15:27:30.081 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-02T15:27:30.108 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-02T15:27:30.141 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-02T15:27:30.147 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-02T15:27:30.224 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-02T15:27:30.307 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs2. 2023-06-02T15:27:30.332 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:30.373 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:30.392 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-02T15:27:30.450 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pluggy. 2023-06-02T15:27:30.477 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-02T15:27:30.517 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-02T15:27:30.518 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:30.616 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-02T15:27:30.617 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rados. 2023-06-02T15:27:30.640 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:30.684 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rados (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:30.803 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-py. 2023-06-02T15:27:30.811 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-idna (3.3-1) ... 2023-06-02T15:27:30.830 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-06-02T15:27:30.861 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-02T15:27:30.870 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-02T15:27:30.962 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-02T15:27:31.012 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-06-02T15:27:31.039 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:31.078 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-argparse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:31.121 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-02T15:27:31.157 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-02T15:27:31.184 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-02T15:27:31.215 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-02T15:27:31.338 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-02T15:27:31.347 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cephfs. 2023-06-02T15:27:31.374 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:31.414 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cephfs (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:31.518 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-toml. 2023-06-02T15:27:31.545 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-06-02T15:27:31.585 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-02T15:27:31.598 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-02T15:27:31.700 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-common. 2023-06-02T15:27:31.766 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:31.766 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:31.849 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:31.887 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pytest. 2023-06-02T15:27:31.904 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-02T15:27:31.946 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-02T15:27:31.976 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-02T15:27:32.070 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-prettytable. 2023-06-02T15:27:32.096 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-06-02T15:27:32.137 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-06-02T15:27:32.291 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-02T15:27:32.318 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-06-02T15:27:32.319 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:32.326 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-02T15:27:32.358 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-02T15:27:32.397 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rbd. 2023-06-02T15:27:32.413 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:32.453 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-02T15:27:32.455 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rbd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:32.619 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-06-02T15:27:32.712 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-02T15:27:32.825 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-06-02T15:27:32.838 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-02T15:27:32.852 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-06-02T15:27:32.878 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-02T15:27:32.892 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-02T15:27:32.903 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-routes. 2023-06-02T15:27:32.930 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-02T15:27:32.964 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-02T15:27:32.969 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-02T15:27:32.979 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-02T15:27:33.161 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librgw2. 2023-06-02T15:27:33.188 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../021-librgw2_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:33.228 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librgw2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:33.238 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-02T15:27:33.274 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-02T15:27:33.331 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-02T15:27:33.358 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:33.398 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:33.532 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-02T15:27:33.730 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rgw. 2023-06-02T15:27:33.746 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:33.788 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:33.792 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-02T15:27:33.808 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-02T15:27:33.809 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-02T15:27:33.825 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-02T15:27:33.859 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-02T15:27:34.043 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:34.133 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liboath0:amd64. 2023-06-02T15:27:34.160 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-06-02T15:27:34.169 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-02T15:27:34.200 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-06-02T15:27:34.201 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-02T15:27:34.295 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-02T15:27:34.363 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-joblib. 2023-06-02T15:27:34.389 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-02T15:27:34.429 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-02T15:27:34.486 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libradosstriper1. 2023-06-02T15:27:34.502 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-02T15:27:34.513 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:34.544 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libradosstriper1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:34.597 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-02T15:27:34.767 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-02T15:27:34.782 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-02T15:27:34.816 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-02T15:27:34.821 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-02T15:27:34.839 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-02T15:27:34.938 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librados2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:34.973 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-common. 2023-06-02T15:27:35.000 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:35.039 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:35.065 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librgw2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:35.094 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-sklearn. 2023-06-02T15:27:35.099 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-02T15:27:35.121 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-02T15:27:35.160 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-02T15:27:35.276 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-02T15:27:35.402 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libcephfs2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:35.512 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libradosstriper1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:35.593 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-02T15:27:35.613 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-02T15:27:35.835 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-02T15:27:35.906 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up librbd1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:35.954 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-02T15:27:35.961 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-02T15:27:35.981 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:36.021 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:36.032 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-modules-core (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:36.158 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:36.240 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-02T15:27:36.312 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-base. 2023-06-02T15:27:36.338 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:36.366 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-02T15:27:36.371 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-02T15:27:36.371 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-02T15:27:36.387 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-base (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:36.667 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-02T15:27:36.935 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libcephfs-dev (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:36.960 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-02T15:27:37.008 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-cachetools. 2023-06-02T15:27:37.034 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-06-02T15:27:37.061 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rados (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:37.074 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-02T15:27:37.116 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-06-02T15:27:37.142 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-06-02T15:27:37.179 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephfs-top (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:37.182 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-06-02T15:27:37.194 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-02T15:27:37.279 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-02T15:27:37.335 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-02T15:27:37.362 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-02T15:27:37.393 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-02T15:27:37.460 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cheroot. 2023-06-02T15:27:37.475 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-06-02T15:27:37.510 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-02T15:27:37.598 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-02T15:27:37.730 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-02T15:27:37.757 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-02T15:27:37.797 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-02T15:27:37.797 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-06-02T15:27:37.823 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-06-02T15:27:37.855 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-06-02T15:27:37.855 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-02T15:27:37.998 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-02T15:27:38.125 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-rsa. 2023-06-02T15:27:38.133 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.text. 2023-06-02T15:27:38.152 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-06-02T15:27:38.159 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-06-02T15:27:38.192 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-02T15:27:38.199 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-06-02T15:27:38.383 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-02T15:27:38.468 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-06-02T15:27:38.476 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rbd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:38.484 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-06-02T15:27:38.487 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-google-auth. 2023-06-02T15:27:38.514 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-06-02T15:27:38.527 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-06-02T15:27:38.553 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-02T15:27:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up rbd-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:38.634 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-02T15:27:38.694 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-rgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:38.795 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up python3-cephfs (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:38.847 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempora. 2023-06-02T15:27:38.848 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-02T15:27:38.873 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-06-02T15:27:38.875 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-02T15:27:38.894 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:27:38.915 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-02T15:27:38.930 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephfs-shell (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:38.938 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-06-02T15:27:39.004 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-02T15:27:39.056 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:39.207 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-portend. 2023-06-02T15:27:39.223 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-06-02T15:27:39.226 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-websocket. 2023-06-02T15:27:39.253 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-06-02T15:27:39.257 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-06-02T15:27:39.293 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-02T15:27:39.330 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-02T15:27:39.544 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-06-02T15:27:39.570 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-06-02T15:27:39.599 INFO:teuthology.orchestra.run.smithi132.stdout:Adding group ceph....done 2023-06-02T15:27:39.610 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-06-02T15:27:39.613 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-02T15:27:39.631 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-06-02T15:27:39.640 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-02T15:27:39.679 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-02T15:27:39.907 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-02T15:27:39.921 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cherrypy3. 2023-06-02T15:27:39.948 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-06-02T15:27:39.988 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-06-02T15:27:39.992 INFO:teuthology.orchestra.run.smithi132.stdout:Adding system user ceph....done 2023-06-02T15:27:40.033 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-02T15:27:40.169 INFO:teuthology.orchestra.run.smithi132.stdout:Setting system user ceph properties....done 2023-06-02T15:27:40.183 INFO:teuthology.orchestra.run.smithi132.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-02T15:27:40.301 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-02T15:27:40.318 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-02T15:27:40.327 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-02T15:27:40.354 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:40.393 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:40.508 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-natsort. 2023-06-02T15:27:40.535 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-06-02T15:27:40.552 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-02T15:27:40.575 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-06-02T15:27:40.672 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-02T15:27:40.713 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-02T15:27:40.740 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-02T15:27:40.798 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-02T15:27:40.812 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-02T15:27:40.861 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-logutils. 2023-06-02T15:27:40.887 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-06-02T15:27:40.928 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-06-02T15:27:41.099 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-02T15:27:41.126 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-02T15:27:41.157 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-02T15:27:41.188 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-02T15:27:41.222 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-markupsafe. 2023-06-02T15:27:41.224 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up cephfs-mirror (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:41.248 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-06-02T15:27:41.289 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-06-02T15:27:41.350 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-test (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:41.402 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package jq. 2023-06-02T15:27:41.429 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-02T15:27:41.456 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-02T15:27:41.468 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-02T15:27:41.592 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-mako. 2023-06-02T15:27:41.618 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-06-02T15:27:41.626 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up radosgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:41.658 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-02T15:27:41.704 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package socat. 2023-06-02T15:27:41.720 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-02T15:27:41.762 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-02T15:27:41.834 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-02T15:27:41.890 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-02T15:27:41.890 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-02T15:27:41.960 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:41.978 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplegeneric. 2023-06-02T15:27:42.004 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-06-02T15:27:42.045 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-06-02T15:27:42.066 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package xmlstarlet. 2023-06-02T15:27:42.086 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:42.093 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-02T15:27:42.132 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-02T15:27:42.289 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:42.331 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-singledispatch. 2023-06-02T15:27:42.357 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-06-02T15:27:42.397 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-06-02T15:27:42.407 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:42.478 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-test. 2023-06-02T15:27:42.494 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../098-ceph-test_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:42.533 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:42.536 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-test (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:42.645 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-base (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:42.659 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webob. 2023-06-02T15:27:42.659 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-02T15:27:42.685 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-06-02T15:27:42.725 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-06-02T15:27:42.927 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:42.951 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-02T15:27:43.062 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:43.087 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-waitress. 2023-06-02T15:27:43.113 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-06-02T15:27:43.157 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-02T15:27:43.188 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:43.405 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-02T15:27:43.405 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-02T15:27:43.456 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempita. 2023-06-02T15:27:43.480 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mds (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:43.482 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-06-02T15:27:43.523 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-06-02T15:27:43.706 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-02T15:27:43.706 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-02T15:27:43.876 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-paste. 2023-06-02T15:27:43.902 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-06-02T15:27:43.950 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-06-02T15:27:43.964 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:44.099 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:44.215 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:44.225 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-top (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:44.279 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-06-02T15:27:44.305 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-06-02T15:27:44.343 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-02T15:27:44.345 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-06-02T15:27:44.448 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-02T15:27:44.448 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-02T15:27:44.657 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ceph-volume. 2023-06-02T15:27:44.684 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../099-ceph-volume_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:44.699 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastedeploy. 2023-06-02T15:27:44.724 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ceph-volume (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:44.725 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-06-02T15:27:44.773 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-06-02T15:27:45.000 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-osd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:45.053 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-02T15:27:45.069 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../100-cephfs-mirror_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:45.076 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webtest. 2023-06-02T15:27:45.102 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-06-02T15:27:45.112 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking cephfs-mirror (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:45.143 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-06-02T15:27:45.333 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-02T15:27:45.334 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-02T15:27:45.406 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-colorama. 2023-06-02T15:27:45.422 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-06-02T15:27:45.454 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pecan. 2023-06-02T15:27:45.464 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-02T15:27:45.480 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-06-02T15:27:45.529 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-06-02T15:27:45.556 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:45.665 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:45.726 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package cephfs-shell. 2023-06-02T15:27:45.742 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../102-cephfs-shell_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:45.784 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking cephfs-shell (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:45.791 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:45.875 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-certifi. 2023-06-02T15:27:45.902 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-06-02T15:27:45.917 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:45.942 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-06-02T15:27:45.969 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:46.043 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-shell (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:46.045 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package cephfs-top. 2023-06-02T15:27:46.070 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:46.072 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../103-cephfs-top_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:46.112 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking cephfs-top (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:46.170 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:46.196 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mon (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:46.245 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-idna. 2023-06-02T15:27:46.271 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-06-02T15:27:46.311 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-idna (3.3-1) ... 2023-06-02T15:27:46.365 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-02T15:27:46.392 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../104-libcephfs-dev_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:46.392 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-02T15:27:46.393 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-02T15:27:46.431 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libcephfs-dev (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:46.639 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-urllib3. 2023-06-02T15:27:46.666 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-06-02T15:27:46.706 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-06-02T15:27:46.713 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2023-06-02T15:27:46.809 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package nvme-cli. 2023-06-02T15:27:46.837 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-02T15:27:46.876 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-02T15:27:47.026 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests. 2023-06-02T15:27:47.052 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-06-02T15:27:47.073 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2023-06-02T15:27:47.092 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-06-02T15:27:47.118 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:47.222 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-02T15:27:47.243 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2023-06-02T15:27:47.243 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:47.253 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-02T15:27:47.260 INFO:teuthology.orchestra.run.smithi078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-02T15:27:47.289 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-02T15:27:47.361 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-mgr-dashboard (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:47.378 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-werkzeug. 2023-06-02T15:27:47.393 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-02T15:27:47.405 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-06-02T15:27:47.445 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-02T15:27:47.512 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ceph-volume (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:47.622 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-02T15:27:47.709 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pastescript. 2023-06-02T15:27:47.737 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-06-02T15:27:47.748 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-06-02T15:27:47.753 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-02T15:27:47.763 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:47.775 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-02T15:27:47.806 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:48.104 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-psutil. 2023-06-02T15:27:48.131 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-02T15:27:48.170 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-02T15:27:48.186 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-06-02T15:27:48.213 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:48.252 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:48.297 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-mirror (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:48.423 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:48.540 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pygments. 2023-06-02T15:27:48.549 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:48.568 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-02T15:27:48.581 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-openssl. 2023-06-02T15:27:48.598 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-02T15:27:48.607 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-06-02T15:27:48.647 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-06-02T15:27:48.757 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-02T15:27:48.886 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-02T15:27:48.887 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-02T15:27:48.950 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr. 2023-06-02T15:27:48.980 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:49.008 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:49.103 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-02T15:27:49.131 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-02T15:27:49.169 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-02T15:27:49.225 INFO:teuthology.orchestra.run.smithi132.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-02T15:27:49.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-02T15:27:49.331 INFO:teuthology.orchestra.run.smithi132.stdout:Reading package lists... 2023-06-02T15:27:49.420 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mon. 2023-06-02T15:27:49.446 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:49.481 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package python3-simplejson. 2023-06-02T15:27:49.486 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mon (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:49.508 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-02T15:27:49.515 INFO:teuthology.orchestra.run.smithi132.stdout:Building dependency tree... 2023-06-02T15:27:49.516 INFO:teuthology.orchestra.run.smithi132.stdout:Reading state information... 2023-06-02T15:27:49.547 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-02T15:27:49.601 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:49.679 INFO:teuthology.orchestra.run.smithi132.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-02T15:27:49.679 INFO:teuthology.orchestra.run.smithi132.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-02T15:27:49.679 INFO:teuthology.orchestra.run.smithi132.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-02T15:27:49.679 INFO:teuthology.orchestra.run.smithi132.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-02T15:27:49.679 INFO:teuthology.orchestra.run.smithi132.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-02T15:27:49.680 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:27:49.680 INFO:teuthology.orchestra.run.smithi132.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:27:49.680 INFO:teuthology.orchestra.run.smithi132.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:27:49.680 INFO:teuthology.orchestra.run.smithi132.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:27:49.681 INFO:teuthology.orchestra.run.smithi132.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:27:49.681 INFO:teuthology.orchestra.run.smithi132.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:27:49.681 INFO:teuthology.orchestra.run.smithi132.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:27:49.682 INFO:teuthology.orchestra.run.smithi132.stdout:The following additional packages will be installed: 2023-06-02T15:27:49.682 INFO:teuthology.orchestra.run.smithi132.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-02T15:27:49.682 INFO:teuthology.orchestra.run.smithi132.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-02T15:27:49.682 INFO:teuthology.orchestra.run.smithi132.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-02T15:27:49.682 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-02T15:27:49.682 INFO:teuthology.orchestra.run.smithi132.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-02T15:27:49.683 INFO:teuthology.orchestra.run.smithi132.stdout:Suggested packages: 2023-06-02T15:27:49.683 INFO:teuthology.orchestra.run.smithi132.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-02T15:27:49.683 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-02T15:27:49.683 INFO:teuthology.orchestra.run.smithi132.stdout: libengine-pkcs11-openssl 2023-06-02T15:27:49.718 INFO:teuthology.orchestra.run.smithi132.stdout:The following NEW packages will be installed: 2023-06-02T15:27:49.718 INFO:teuthology.orchestra.run.smithi132.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-02T15:27:49.718 INFO:teuthology.orchestra.run.smithi132.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-02T15:27:49.719 INFO:teuthology.orchestra.run.smithi132.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-02T15:27:49.719 INFO:teuthology.orchestra.run.smithi132.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-02T15:27:49.720 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-02T15:27:49.720 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-02T15:27:49.720 INFO:teuthology.orchestra.run.smithi132.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-02T15:27:49.720 INFO:teuthology.orchestra.run.smithi132.stdout:The following packages will be upgraded: 2023-06-02T15:27:49.721 INFO:teuthology.orchestra.run.smithi132.stdout: libssl3 2023-06-02T15:27:49.771 INFO:teuthology.orchestra.run.smithi132.stdout:1 upgraded, 39 newly installed, 0 to remove and 180 not upgraded. 2023-06-02T15:27:49.773 INFO:teuthology.orchestra.run.smithi132.stdout:Need to get 54.6 MB of archives. 2023-06-02T15:27:49.773 INFO:teuthology.orchestra.run.smithi132.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-02T15:27:49.773 INFO:teuthology.orchestra.run.smithi132.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-02T15:27:49.808 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-02T15:27:49.824 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-02T15:27:49.866 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-02T15:27:49.871 INFO:teuthology.orchestra.run.smithi132.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-02T15:27:49.915 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-02T15:27:49.930 INFO:teuthology.orchestra.run.smithi132.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-02T15:27:49.944 INFO:teuthology.orchestra.run.smithi132.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-02T15:27:49.945 INFO:teuthology.orchestra.run.smithi132.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-02T15:27:49.948 INFO:teuthology.orchestra.run.smithi132.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-02T15:27:49.950 INFO:teuthology.orchestra.run.smithi132.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-02T15:27:49.950 INFO:teuthology.orchestra.run.smithi132.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-02T15:27:49.952 INFO:teuthology.orchestra.run.smithi132.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-02T15:27:49.953 INFO:teuthology.orchestra.run.smithi132.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-02T15:27:49.989 INFO:teuthology.orchestra.run.smithi132.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-02T15:27:49.989 INFO:teuthology.orchestra.run.smithi132.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-02T15:27:50.039 INFO:teuthology.orchestra.run.smithi132.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-02T15:27:50.391 INFO:teuthology.orchestra.run.smithi132.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-02T15:27:50.392 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-osd. 2023-06-02T15:27:50.392 INFO:teuthology.orchestra.run.smithi132.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-02T15:27:50.393 INFO:teuthology.orchestra.run.smithi132.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-02T15:27:50.395 INFO:teuthology.orchestra.run.smithi132.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-02T15:27:50.419 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:50.453 INFO:teuthology.orchestra.run.smithi132.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-02T15:27:50.453 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:50.457 INFO:teuthology.orchestra.run.smithi132.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-02T15:27:50.459 INFO:teuthology.orchestra.run.smithi132.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-02T15:27:50.466 INFO:teuthology.orchestra.run.smithi132.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-02T15:27:50.483 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-osd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:50.501 INFO:teuthology.orchestra.run.smithi132.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-02T15:27:50.596 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package radosgw. 2023-06-02T15:27:50.623 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../113-radosgw_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:50.661 INFO:teuthology.orchestra.run.smithi132.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-02T15:27:50.661 INFO:teuthology.orchestra.run.smithi132.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-02T15:27:50.662 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking radosgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:50.681 INFO:teuthology.orchestra.run.smithi132.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-02T15:27:50.698 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-02T15:27:50.699 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-02T15:27:50.715 INFO:teuthology.orchestra.run.smithi132.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-02T15:27:50.719 INFO:teuthology.orchestra.run.smithi132.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-02T15:27:50.720 INFO:teuthology.orchestra.run.smithi132.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-02T15:27:50.720 INFO:teuthology.orchestra.run.smithi132.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-02T15:27:50.721 INFO:teuthology.orchestra.run.smithi132.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-02T15:27:50.734 INFO:teuthology.orchestra.run.smithi132.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-02T15:27:50.735 INFO:teuthology.orchestra.run.smithi132.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-02T15:27:50.978 INFO:teuthology.orchestra.run.smithi132.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-02T15:27:50.996 INFO:teuthology.orchestra.run.smithi132.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-02T15:27:50.997 INFO:teuthology.orchestra.run.smithi132.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-02T15:27:50.997 INFO:teuthology.orchestra.run.smithi132.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-02T15:27:51.015 INFO:teuthology.orchestra.run.smithi132.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-02T15:27:51.016 INFO:teuthology.orchestra.run.smithi132.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-02T15:27:51.114 INFO:teuthology.orchestra.run.smithi132.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-02T15:27:51.115 INFO:teuthology.orchestra.run.smithi132.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-02T15:27:51.246 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:51.356 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package rbd-fuse. 2023-06-02T15:27:51.373 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:51.415 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking rbd-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:51.466 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-02T15:27:51.466 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-02T15:27:51.513 INFO:teuthology.orchestra.run.smithi132.stdout:Preconfiguring packages ... 2023-06-02T15:27:51.665 INFO:teuthology.orchestra.run.smithi132.stdout:Fetched 54.6 MB in 1s (39.3 MB/s) 2023-06-02T15:27:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-02T15:27:51.780 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package flex. 2023-06-02T15:27:51.855 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172965 files and directories currently installed.) 2023-06-02T15:27:51.861 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-02T15:27:51.904 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-02T15:27:51.978 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-02T15:27:52.007 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:52.087 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-02T15:27:52.237 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph. 2023-06-02T15:27:52.252 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../061-ceph_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:52.286 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:52.302 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-02T15:27:52.303 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-02T15:27:52.351 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-02T15:27:52.622 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-02T15:27:52.639 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-fuse. 2023-06-02T15:27:52.666 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:52.702 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-02T15:27:52.705 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:52.795 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-02T15:27:52.850 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:52.968 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:53.059 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mds. 2023-06-02T15:27:53.086 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:53.102 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:53.125 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mds (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:53.165 INFO:teuthology.orchestra.run.smithi159.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-02T15:27:53.204 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:27:53.256 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:53.308 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-02T15:27:53.309 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-02T15:27:53.504 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephadm. 2023-06-02T15:27:53.530 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../064-cephadm_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:27:53.562 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:53.713 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package bison. 2023-06-02T15:27:53.814 INFO:teuthology.orchestra.run.smithi132.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173038 files and directories currently installed.) 2023-06-02T15:27:53.819 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-02T15:27:53.833 INFO:teuthology.orchestra.run.smithi159.stdout:Adding system user cephadm....done 2023-06-02T15:27:53.863 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:53.864 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-asyncssh. 2023-06-02T15:27:53.865 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-02T15:27:53.891 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-06-02T15:27:53.931 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-06-02T15:27:53.987 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-02T15:27:54.090 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:54.242 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-babel-localedata. 2023-06-02T15:27:54.255 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-02T15:27:54.258 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-06-02T15:27:54.273 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:54.283 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-02T15:27:54.310 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-02T15:27:54.317 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-02T15:27:54.349 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-02T15:27:54.424 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-volume (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:54.498 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-02T15:27:54.560 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-02T15:27:54.616 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-02T15:27:54.867 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-02T15:27:55.103 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package dump. 2023-06-02T15:27:55.110 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-02T15:27:55.130 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-02T15:27:55.169 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking dump (0.4b47-3) ... 2023-06-02T15:27:55.236 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-02T15:27:55.356 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-babel. 2023-06-02T15:27:55.383 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-06-02T15:27:55.422 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-06-02T15:27:55.473 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package indent. 2023-06-02T15:27:55.501 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-02T15:27:55.531 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-02T15:27:55.539 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-02T15:27:55.661 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-02T15:27:55.759 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-02T15:27:55.786 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-02T15:27:55.825 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-02T15:27:55.898 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-02T15:27:55.951 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jinja2. 2023-06-02T15:27:55.977 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-06-02T15:27:56.017 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-06-02T15:27:56.124 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-02T15:27:56.126 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-02T15:27:56.154 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-02T15:27:56.166 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-02T15:27:56.181 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-02T15:27:56.220 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-02T15:27:56.223 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-06-02T15:27:56.354 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-06-02T15:27:56.380 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:56.396 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-06-02T15:27:56.397 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-06-02T15:27:56.417 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-02T15:27:56.420 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:56.490 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-02T15:27:56.506 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-02T15:27:56.548 INFO:teuthology.orchestra.run.smithi078.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-02T15:27:56.548 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-02T15:27:56.549 INFO:teuthology.orchestra.run.smithi078.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-02T15:27:56.549 INFO:teuthology.orchestra.run.smithi078.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-02T15:27:56.549 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-02T15:27:56.549 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:27:56.549 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:27:56.550 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:27:56.550 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:27:56.550 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:27:56.550 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:27:56.550 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:27:56.551 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-02T15:27:56.552 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-06-02T15:27:56.552 INFO:teuthology.orchestra.run.smithi078.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-02T15:27:56.552 INFO:teuthology.orchestra.run.smithi078.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-02T15:27:56.553 INFO:teuthology.orchestra.run.smithi078.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-02T15:27:56.553 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-02T15:27:56.553 INFO:teuthology.orchestra.run.smithi078.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-02T15:27:56.554 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-06-02T15:27:56.554 INFO:teuthology.orchestra.run.smithi078.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-02T15:27:56.554 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-02T15:27:56.554 INFO:teuthology.orchestra.run.smithi078.stdout: libengine-pkcs11-openssl 2023-06-02T15:27:56.584 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-06-02T15:27:56.585 INFO:teuthology.orchestra.run.smithi078.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-02T15:27:56.585 INFO:teuthology.orchestra.run.smithi078.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-02T15:27:56.586 INFO:teuthology.orchestra.run.smithi078.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-02T15:27:56.586 INFO:teuthology.orchestra.run.smithi078.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-02T15:27:56.586 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-02T15:27:56.586 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-02T15:27:56.586 INFO:teuthology.orchestra.run.smithi078.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-02T15:27:56.587 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2023-06-02T15:27:56.587 INFO:teuthology.orchestra.run.smithi078.stdout: libssl3 2023-06-02T15:27:56.677 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-02T15:27:56.765 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-bcrypt. 2023-06-02T15:27:56.784 INFO:teuthology.orchestra.run.smithi078.stdout:1 upgraded, 39 newly installed, 0 to remove and 180 not upgraded. 2023-06-02T15:27:56.784 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 54.6 MB of archives. 2023-06-02T15:27:56.785 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-02T15:27:56.785 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-02T15:27:56.792 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-06-02T15:27:56.840 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-06-02T15:27:56.868 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-02T15:27:56.895 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-02T15:27:56.911 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-02T15:27:56.935 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-02T15:27:57.160 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pluggy. 2023-06-02T15:27:57.162 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-02T15:27:57.170 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-02T15:27:57.186 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-06-02T15:27:57.187 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-02T15:27:57.226 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-06-02T15:27:57.228 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-02T15:27:57.263 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-02T15:27:57.413 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-ceph-argparse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:57.464 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libjson-perl. 2023-06-02T15:27:57.492 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-02T15:27:57.520 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-02T15:27:57.521 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-py. 2023-06-02T15:27:57.525 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-02T15:27:57.548 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-06-02T15:27:57.556 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-02T15:27:57.557 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-02T15:27:57.562 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-02T15:27:57.566 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-02T15:27:57.566 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-02T15:27:57.570 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-02T15:27:57.572 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-02T15:27:57.587 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-py (1.10.0-1) ... 2023-06-02T15:27:57.737 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-02T15:27:57.738 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-02T15:27:57.781 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-02T15:27:57.828 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-02T15:27:57.855 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-02T15:27:57.894 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-02T15:27:57.907 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-02T15:27:57.924 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-iniconfig. 2023-06-02T15:27:57.951 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-06-02T15:27:57.983 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-02T15:27:57.990 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-06-02T15:27:58.158 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-02T15:27:58.310 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-toml. 2023-06-02T15:27:58.337 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-06-02T15:27:58.376 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-06-02T15:27:58.401 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-02T15:27:58.527 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-02T15:27:58.655 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pytest. 2023-06-02T15:27:58.682 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-06-02T15:27:58.721 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-06-02T15:27:58.887 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-02T15:27:59.013 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-02T15:27:59.083 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-repoze.lru. 2023-06-02T15:27:59.108 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-02T15:27:59.110 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-06-02T15:27:59.112 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-02T15:27:59.113 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-02T15:27:59.119 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-02T15:27:59.123 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-02T15:27:59.149 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-06-02T15:27:59.154 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-02T15:27:59.158 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-02T15:27:59.175 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-02T15:27:59.280 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-02T15:27:59.339 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-02T15:27:59.452 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-routes. 2023-06-02T15:27:59.480 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-06-02T15:27:59.519 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-06-02T15:27:59.565 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-02T15:27:59.581 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-02T15:27:59.608 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-02T15:27:59.647 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:27:59.864 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-06-02T15:27:59.891 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-02T15:27:59.892 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:27:59.916 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-02T15:27:59.930 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:27:59.944 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-02T15:27:59.983 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:28:00.060 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-02T15:28:00.061 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-02T15:28:00.087 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-02T15:28:00.165 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-02T15:28:00.174 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-02T15:28:00.175 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-02T15:28:00.176 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-02T15:28:00.177 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-02T15:28:00.203 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-02T15:28:00.207 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-02T15:28:00.278 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-02T15:28:00.305 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-02T15:28:00.326 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-06-02T15:28:00.335 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:00.353 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-06-02T15:28:00.392 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-02T15:28:00.552 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-02T15:28:00.671 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-02T15:28:00.699 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-02T15:28:00.738 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-02T15:28:00.794 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-02T15:28:00.871 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-joblib. 2023-06-02T15:28:00.898 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-06-02T15:28:00.912 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-02T15:28:00.921 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-02T15:28:00.929 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-06-02T15:28:01.003 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-02T15:28:01.004 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-02T15:28:01.004 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-02T15:28:01.038 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-02T15:28:01.074 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-02T15:28:01.094 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-02T15:28:01.099 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-02T15:28:01.101 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-02T15:28:01.140 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-02T15:28:01.283 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-06-02T15:28:01.310 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-06-02T15:28:01.339 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-02T15:28:01.349 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-06-02T15:28:01.460 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-02T15:28:01.488 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:01.527 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:01.555 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-02T15:28:01.557 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-02T15:28:01.660 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn. 2023-06-02T15:28:01.687 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-06-02T15:28:01.707 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-02T15:28:01.726 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-02T15:28:01.855 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-02T15:28:01.882 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:01.921 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:28:01.941 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-02T15:28:01.950 INFO:teuthology.orchestra.run.smithi078.stdout:Preconfiguring packages ... 2023-06-02T15:28:02.112 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2023-06-02T15:28:02.245 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package flex. 2023-06-02T15:28:02.285 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-02T15:28:02.346 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172965 files and directories currently installed.) 2023-06-02T15:28:02.351 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-02T15:28:02.357 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-02T15:28:02.384 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:02.401 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-02T15:28:02.423 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:28:02.512 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-06-02T15:28:02.539 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:28:02.553 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-02T15:28:02.578 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:02.676 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-02T15:28:02.703 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-02T15:28:02.743 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:28:02.854 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-02T15:28:03.010 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-02T15:28:03.158 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-02T15:28:03.197 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-02T15:28:03.229 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-02T15:28:03.257 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-02T15:28:03.296 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-02T15:28:03.448 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-02T15:28:03.490 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cachetools. 2023-06-02T15:28:03.517 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-06-02T15:28:03.548 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-06-02T15:28:03.559 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:28:03.574 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:03.649 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package modemmanager. 2023-06-02T15:28:03.677 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-02T15:28:03.715 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:03.834 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1. 2023-06-02T15:28:03.862 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-06-02T15:28:03.884 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-idna (3.3-1) ... 2023-06-02T15:28:03.900 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-06-02T15:28:04.111 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package bison. 2023-06-02T15:28:04.185 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-02T15:28:04.213 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173038 files and directories currently installed.) 2023-06-02T15:28:04.218 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-02T15:28:04.229 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-06-02T15:28:04.257 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-06-02T15:28:04.281 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-02T15:28:04.295 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-06-02T15:28:04.363 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package network-manager. 2023-06-02T15:28:04.391 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-02T15:28:04.438 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-02T15:28:04.590 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rsa. 2023-06-02T15:28:04.617 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-06-02T15:28:04.656 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rsa (4.8-1) ... 2023-06-02T15:28:04.747 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-02T15:28:04.774 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-02T15:28:04.822 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-02T15:28:04.960 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-google-auth. 2023-06-02T15:28:04.989 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-06-02T15:28:05.027 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-06-02T15:28:05.028 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package ppp. 2023-06-02T15:28:05.056 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-02T15:28:05.133 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package dump. 2023-06-02T15:28:05.161 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-02T15:28:05.200 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking dump (0.4b47-3) ... 2023-06-02T15:28:05.313 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-06-02T15:28:05.341 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-06-02T15:28:05.366 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:28:05.370 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-02T15:28:05.371 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-02T15:28:05.487 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package indent. 2023-06-02T15:28:05.509 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-02T15:28:05.514 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-02T15:28:05.553 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-02T15:28:05.666 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package pptp-linux. 2023-06-02T15:28:05.667 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-websocket. 2023-06-02T15:28:05.693 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-02T15:28:05.694 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-06-02T15:28:05.733 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-02T15:28:05.733 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-06-02T15:28:05.760 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-02T15:28:05.848 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-02T15:28:05.875 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-02T15:28:05.886 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-02T15:28:05.914 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-02T15:28:05.968 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-02T15:28:05.985 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-02T15:28:06.011 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-02T15:28:06.027 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-02T15:28:06.069 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-kubernetes. 2023-06-02T15:28:06.097 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-06-02T15:28:06.136 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-02T15:28:06.210 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-02T15:28:06.238 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-02T15:28:06.285 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-02T15:28:06.305 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-02T15:28:06.330 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-02T15:28:06.357 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-02T15:28:06.396 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-client-common (238) ... 2023-06-02T15:28:06.554 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-02T15:28:06.570 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-02T15:28:06.572 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-02T15:28:06.612 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-02T15:28:06.667 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-02T15:28:06.684 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:06.717 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:06.775 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-06-02T15:28:06.791 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:28:06.833 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:06.840 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:28:06.949 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-02T15:28:06.966 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-02T15:28:06.993 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-02T15:28:07.033 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-02T15:28:07.059 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-02T15:28:07.161 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libonig5:amd64. 2023-06-02T15:28:07.188 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-06-02T15:28:07.236 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-02T15:28:07.252 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-02T15:28:07.267 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-02T15:28:07.302 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-02T15:28:07.305 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-common. 2023-06-02T15:28:07.333 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-02T15:28:07.343 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-02T15:28:07.392 INFO:teuthology.orchestra.run.smithi132.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-02T15:28:07.419 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-common (238) ... 2023-06-02T15:28:07.563 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjson-perl. 2023-06-02T15:28:07.578 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-02T15:28:07.579 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-02T15:28:07.589 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjq1:amd64. 2023-06-02T15:28:07.616 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-06-02T15:28:07.621 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-02T15:28:07.655 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-02T15:28:07.854 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-02T15:28:07.925 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package jq. 2023-06-02T15:28:07.929 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-14. 2023-06-02T15:28:07.949 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-02T15:28:07.952 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-06-02T15:28:07.957 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:07.977 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-02T15:28:07.991 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-06-02T15:28:07.998 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:08.016 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-02T15:28:08.113 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-02T15:28:08.244 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package socat. 2023-06-02T15:28:08.271 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-06-02T15:28:08.310 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-06-02T15:28:08.364 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-02T15:28:08.632 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-02T15:28:08.638 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package xmlstarlet. 2023-06-02T15:28:08.654 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-06-02T15:28:08.697 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-06-02T15:28:08.752 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-02T15:28:09.011 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-02T15:28:09.060 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-test. 2023-06-02T15:28:09.087 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../098-ceph-test_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:28:09.126 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-test (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:09.138 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-02T15:28:09.282 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql. 2023-06-02T15:28:09.300 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-02T15:28:09.332 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql (14+238) ... 2023-06-02T15:28:09.439 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-02T15:28:09.551 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-client. 2023-06-02T15:28:09.567 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-02T15:28:09.609 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-client (14+238) ... 2023-06-02T15:28:09.740 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-02T15:28:09.803 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-02T15:28:09.830 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-02T15:28:09.853 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-02T15:28:09.869 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:28:09.881 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-02T15:28:09.919 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-02T15:28:09.990 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-02T15:28:10.121 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-02T15:28:10.138 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-02T15:28:10.182 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:28:10.239 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package tcl8.6. 2023-06-02T15:28:10.267 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-02T15:28:10.305 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-02T15:28:10.436 INFO:teuthology.orchestra.run.smithi159.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-02T15:28:10.500 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-02T15:28:10.527 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-02T15:28:10.566 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:10.575 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package tcl. 2023-06-02T15:28:10.602 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-02T15:28:10.646 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-02T15:28:10.677 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-02T15:28:10.803 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-02T15:28:10.944 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-02T15:28:10.969 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package wpasupplicant. 2023-06-02T15:28:10.971 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-02T15:28:10.997 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-02T15:28:11.010 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-02T15:28:11.036 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-02T15:28:11.196 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-02T15:28:11.313 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-02T15:28:11.341 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-02T15:28:11.380 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-02T15:28:11.390 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-02T15:28:11.418 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-02T15:28:11.456 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-02T15:28:11.456 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-02T15:28:11.546 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-volume. 2023-06-02T15:28:11.562 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../099-ceph-volume_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:28:11.613 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-volume (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:11.723 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:28:11.733 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-02T15:28:11.750 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:11.791 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:11.801 INFO:teuthology.orchestra.run.smithi132.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-02T15:28:11.829 INFO:teuthology.orchestra.run.smithi132.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-02T15:28:11.850 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-02T15:28:11.876 INFO:teuthology.orchestra.run.smithi132.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-02T15:28:11.951 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephfs-mirror. 2023-06-02T15:28:11.978 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../100-cephfs-mirror_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:28:12.017 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephfs-mirror (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:12.136 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-02T15:28:12.163 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:12.171 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-client-common (238) ... 2023-06-02T15:28:12.175 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-02T15:28:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:28:12.362 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-colorama. 2023-06-02T15:28:12.382 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-02T15:28:12.389 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-06-02T15:28:12.437 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-06-02T15:28:12.452 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-06-02T15:28:12.488 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-02T15:28:12.504 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:12.508 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-02T15:28:12.538 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:28:12.626 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:12.720 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-02T15:28:12.739 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephfs-shell. 2023-06-02T15:28:12.767 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../102-cephfs-shell_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:28:12.783 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-02T15:28:12.806 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephfs-shell (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:12.810 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-02T15:28:12.844 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-02T15:28:12.845 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-02T15:28:12.849 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:28:12.970 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-02T15:28:13.076 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephfs-top. 2023-06-02T15:28:13.091 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../103-cephfs-top_18.0.0-3488-g2870bf45-1jammy_all.deb ... 2023-06-02T15:28:13.095 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:13.113 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-02T15:28:13.134 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephfs-top (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:13.382 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-02T15:28:13.386 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs-dev. 2023-06-02T15:28:13.403 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-02T15:28:13.414 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../104-libcephfs-dev_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:28:13.430 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-02T15:28:13.453 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs-dev (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:13.461 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-02T15:28:13.610 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-02T15:28:13.641 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-02T15:28:13.693 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-02T15:28:13.789 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package modemmanager. 2023-06-02T15:28:13.816 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-02T15:28:13.855 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:13.906 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package nvme-cli. 2023-06-02T15:28:13.934 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-06-02T15:28:13.981 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-06-02T15:28:14.009 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-02T15:28:14.055 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-02T15:28:14.055 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-02T15:28:14.293 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-02T15:28:14.353 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-06-02T15:28:14.380 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-06-02T15:28:14.427 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-06-02T15:28:14.454 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager. 2023-06-02T15:28:14.481 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-02T15:28:14.571 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-02T15:28:14.621 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-02T15:28:14.629 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-02T15:28:14.747 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:28:14.755 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up librados2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:14.847 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastescript. 2023-06-02T15:28:14.873 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-02T15:28:14.875 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-06-02T15:28:14.881 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up librgw2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:14.922 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-06-02T15:28:14.999 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-02T15:28:15.092 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:15.125 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-02T15:28:15.194 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libcephfs2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:15.212 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ppp. 2023-06-02T15:28:15.239 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-02T15:28:15.243 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-02T15:28:15.295 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libradosstriper1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:15.301 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-psutil. 2023-06-02T15:28:15.328 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-06-02T15:28:15.344 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-02T15:28:15.376 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-06-02T15:28:15.437 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-02T15:28:15.504 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-02T15:28:15.712 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pygments. 2023-06-02T15:28:15.722 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up librbd1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:15.739 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-06-02T15:28:15.778 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-06-02T15:28:15.825 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pptp-linux. 2023-06-02T15:28:15.849 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr-modules-core (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:15.853 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-02T15:28:15.883 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-02T15:28:15.974 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:15.999 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-02T15:28:16.125 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up dump (0.4b47-3) ... 2023-06-02T15:28:16.136 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-02T15:28:16.152 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-02T15:28:16.187 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-02T15:28:16.187 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-02T15:28:16.194 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-02T15:28:16.219 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-02T15:28:16.266 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyinotify. 2023-06-02T15:28:16.285 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:16.293 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-06-02T15:28:16.332 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-06-02T15:28:16.386 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-02T15:28:16.489 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-02T15:28:16.504 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-02T15:28:16.516 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-02T15:28:16.555 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-common (238) ... 2023-06-02T15:28:16.630 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-02T15:28:16.652 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplejson. 2023-06-02T15:28:16.679 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-06-02T15:28:16.718 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-06-02T15:28:16.726 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libcephfs-dev (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:16.756 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-02T15:28:16.846 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-02T15:28:16.852 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-rados (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:16.859 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-02T15:28:16.887 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:16.907 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-02T15:28:16.926 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:16.978 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up cephfs-top (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:16.996 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-06-02T15:28:17.023 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-06-02T15:28:17.033 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-02T15:28:17.062 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-06-02T15:28:17.104 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-02T15:28:17.210 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-02T15:28:17.310 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:28:17.436 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-02T15:28:17.481 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-common. 2023-06-02T15:28:17.509 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-02T15:28:17.567 INFO:teuthology.orchestra.run.smithi078.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-02T15:28:17.595 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-common (238) ... 2023-06-02T15:28:17.605 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-client (14+238) ... 2023-06-02T15:28:17.731 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-02T15:28:17.816 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package radosgw. 2023-06-02T15:28:17.844 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../113-radosgw_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:28:17.874 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking radosgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:18.080 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-14. 2023-06-02T15:28:18.108 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:18.151 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:18.213 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:28:18.214 INFO:teuthology.orchestra.run.smithi132.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-02T15:28:18.214 INFO:teuthology.orchestra.run.smithi132.stdout:which means they are currently configured by ifupdown: 2023-06-02T15:28:18.214 INFO:teuthology.orchestra.run.smithi132.stdout:- enp3s0f1 2023-06-02T15:28:18.214 INFO:teuthology.orchestra.run.smithi132.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-02T15:28:18.214 INFO:teuthology.orchestra.run.smithi132.stdout:remove their configuration from /etc/network/interfaces. 2023-06-02T15:28:18.214 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:28:18.317 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-rbd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:18.335 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-02T15:28:18.434 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up rbd-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:18.536 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-rgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:18.610 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package rbd-fuse. 2023-06-02T15:28:18.626 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3488-g2870bf45-1jammy_amd64.deb ... 2023-06-02T15:28:18.645 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up python3-cephfs (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:18.654 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-02T15:28:18.668 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking rbd-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:18.771 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up cephfs-shell (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:18.897 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:18.972 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-06-02T15:28:19.004 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-02T15:28:19.231 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-06-02T15:28:19.357 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-06-02T15:28:19.465 INFO:teuthology.orchestra.run.smithi159.stdout:Adding group ceph....done 2023-06-02T15:28:19.476 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql. 2023-06-02T15:28:19.493 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-02T15:28:19.534 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql (14+238) ... 2023-06-02T15:28:19.566 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:28:19.605 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-06-02T15:28:19.701 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-02T15:28:19.802 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-02T15:28:19.867 INFO:teuthology.orchestra.run.smithi159.stdout:Adding system user ceph....done 2023-06-02T15:28:19.938 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-common (238) ... 2023-06-02T15:28:19.960 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-06-02T15:28:20.043 INFO:teuthology.orchestra.run.smithi159.stdout:Setting system user ceph properties....done 2023-06-02T15:28:20.056 INFO:teuthology.orchestra.run.smithi159.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-02T15:28:20.188 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-02T15:28:20.305 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client. 2023-06-02T15:28:20.333 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-02T15:28:20.371 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client (14+238) ... 2023-06-02T15:28:20.439 INFO:teuthology.orchestra.run.smithi150.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-06-02T15:28:20.535 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:20.537 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-02T15:28:20.660 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-02T15:28:20.688 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-02T15:28:20.732 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-02T15:28:21.060 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl8.6. 2023-06-02T15:28:21.066 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up cephfs-mirror (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:21.088 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-02T15:28:21.104 INFO:teuthology.orchestra.run.smithi132.stdout:Adding user postgres to group ssl-cert 2023-06-02T15:28:21.126 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-02T15:28:21.127 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user cephadm....done 2023-06-02T15:28:21.166 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-test (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:21.282 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-06-02T15:28:21.336 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:28:21.337 INFO:teuthology.orchestra.run.smithi132.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-02T15:28:21.379 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl. 2023-06-02T15:28:21.393 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up radosgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:21.407 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-02T15:28:21.442 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-02T15:28:21.521 INFO:teuthology.orchestra.run.smithi132.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-02T15:28:21.521 INFO:teuthology.orchestra.run.smithi132.stdout:Removing obsolete dictionary files: 2023-06-02T15:28:21.575 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-06-02T15:28:21.657 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-02T15:28:21.658 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-02T15:28:21.782 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package wpasupplicant. 2023-06-02T15:28:21.810 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-02T15:28:21.848 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-02T15:28:21.851 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-06-02T15:28:21.978 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-06-02T15:28:22.140 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-02T15:28:22.220 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-02T15:28:22.229 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-06-02T15:28:22.236 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-02T15:28:22.278 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-02T15:28:22.378 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-base (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:22.480 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-06-02T15:28:22.530 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:22.590 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-02T15:28:22.606 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-py (1.10.0-1) ... 2023-06-02T15:28:22.617 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-02T15:28:22.656 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-02T15:28:22.722 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-02T15:28:22.864 INFO:teuthology.orchestra.run.smithi132.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-02T15:28:22.876 INFO:teuthology.orchestra.run.smithi132.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-02T15:28:22.899 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-06-02T15:28:22.917 INFO:teuthology.orchestra.run.smithi132.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-02T15:28:22.917 INFO:teuthology.orchestra.run.smithi132.stdout:This user must also own the server process. 2023-06-02T15:28:22.917 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:28:22.917 INFO:teuthology.orchestra.run.smithi132.stdout:The database cluster will be initialized with locale "en_US". 2023-06-02T15:28:22.917 INFO:teuthology.orchestra.run.smithi132.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-02T15:28:22.917 INFO:teuthology.orchestra.run.smithi132.stdout:The default text search configuration will be set to "english". 2023-06-02T15:28:22.918 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:28:22.918 INFO:teuthology.orchestra.run.smithi132.stdout:Data page checksums are disabled. 2023-06-02T15:28:22.918 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:28:22.918 INFO:teuthology.orchestra.run.smithi132.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-02T15:28:22.918 INFO:teuthology.orchestra.run.smithi132.stdout:creating subdirectories ... ok 2023-06-02T15:28:22.919 INFO:teuthology.orchestra.run.smithi132.stdout:selecting dynamic shared memory implementation ... posix 2023-06-02T15:28:22.930 INFO:teuthology.orchestra.run.smithi132.stdout:selecting default max_connections ... 100 2023-06-02T15:28:22.951 INFO:teuthology.orchestra.run.smithi132.stdout:selecting default shared_buffers ... 128MB 2023-06-02T15:28:22.952 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-common (238) ... 2023-06-02T15:28:22.960 INFO:teuthology.orchestra.run.smithi132.stdout:selecting default time zone ... Etc/UTC 2023-06-02T15:28:22.961 INFO:teuthology.orchestra.run.smithi132.stdout:creating configuration files ... ok 2023-06-02T15:28:23.082 INFO:teuthology.orchestra.run.smithi132.stdout:running bootstrap script ... ok 2023-06-02T15:28:23.163 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-02T15:28:23.213 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mds (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:23.276 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-06-02T15:28:23.280 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-02T15:28:23.381 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:23.441 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-02T15:28:23.441 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-02T15:28:23.482 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-02T15:28:23.527 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-06-02T15:28:23.602 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-02T15:28:23.719 INFO:teuthology.orchestra.run.smithi132.stdout:performing post-bootstrap initialization ... ok 2023-06-02T15:28:23.728 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:23.787 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-06-02T15:28:23.931 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:24.063 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-06-02T15:28:24.119 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-02T15:28:24.119 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-02T15:28:24.201 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-02T15:28:24.284 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-02T15:28:24.323 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-06-02T15:28:24.392 INFO:teuthology.orchestra.run.smithi132.stdout:syncing data to disk ... ok 2023-06-02T15:28:24.557 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-06-02T15:28:24.650 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-osd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:24.681 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-02T15:28:24.682 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-02T15:28:24.807 INFO:teuthology.orchestra.run.smithi132.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-02T15:28:24.833 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-argparse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:24.971 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-02T15:28:24.972 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-02T15:28:25.092 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-06-02T15:28:25.219 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-06-02T15:28:25.312 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-02T15:28:25.438 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:28:25.495 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-06-02T15:28:25.547 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-02T15:28:25.561 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:25.648 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-02T15:28:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:25.746 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-06-02T15:28:25.749 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-02T15:28:25.838 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mon (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:25.858 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-02T15:28:25.872 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-06-02T15:28:25.984 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-02T15:28:26.048 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-02T15:28:26.048 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-02T15:28:26.231 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-06-02T15:28:26.340 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-06-02T15:28:26.581 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr-cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:26.606 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-02T15:28:26.617 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-06-02T15:28:26.707 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up dump (0.4b47-3) ... 2023-06-02T15:28:26.723 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:26.784 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-02T15:28:26.849 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-mgr-dashboard (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:26.851 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:26.993 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-02T15:28:27.025 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ceph-volume (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:27.060 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-06-02T15:28:27.136 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-02T15:28:27.203 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-02T15:28:27.329 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-02T15:28:27.369 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-06-02T15:28:27.455 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-02T15:28:27.545 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-02T15:28:27.598 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-02T15:28:27.645 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:28:27.699 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-02T15:28:27.771 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-02T15:28:27.842 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-02T15:28:27.897 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up postgresql (14+238) ... 2023-06-02T15:28:27.960 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:28:28.040 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:28:28.046 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-06-02T15:28:28.086 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-02T15:28:28.157 INFO:teuthology.orchestra.run.smithi132.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:28.254 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client (14+238) ... 2023-06-02T15:28:28.305 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-06-02T15:28:28.337 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-02T15:28:28.379 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-02T15:28:28.397 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-02T15:28:28.397 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-02T15:28:28.431 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-06-02T15:28:28.557 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-06-02T15:28:28.786 INFO:teuthology.orchestra.run.smithi159.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-02T15:28:28.788 DEBUG:teuthology.orchestra.run.smithi159:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-02T15:28:28.844 INFO:teuthology.orchestra.run.smithi159.stdout:Reading package lists... 2023-06-02T15:28:28.875 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-06-02T15:28:28.882 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:28:28.882 INFO:teuthology.orchestra.run.smithi078.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-02T15:28:28.882 INFO:teuthology.orchestra.run.smithi078.stdout:which means they are currently configured by ifupdown: 2023-06-02T15:28:28.883 INFO:teuthology.orchestra.run.smithi078.stdout:- enp3s0f1 2023-06-02T15:28:28.883 INFO:teuthology.orchestra.run.smithi078.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-02T15:28:28.883 INFO:teuthology.orchestra.run.smithi078.stdout:remove their configuration from /etc/network/interfaces. 2023-06-02T15:28:28.883 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:28:29.013 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-02T15:28:29.017 INFO:teuthology.orchestra.run.smithi159.stdout:Building dependency tree... 2023-06-02T15:28:29.018 INFO:teuthology.orchestra.run.smithi159.stdout:Reading state information... 2023-06-02T15:28:29.018 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-02T15:28:29.169 INFO:teuthology.orchestra.run.smithi159.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-02T15:28:29.169 INFO:teuthology.orchestra.run.smithi159.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-02T15:28:29.170 INFO:teuthology.orchestra.run.smithi159.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-02T15:28:29.170 INFO:teuthology.orchestra.run.smithi159.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-02T15:28:29.170 INFO:teuthology.orchestra.run.smithi159.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-02T15:28:29.170 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:28:29.170 INFO:teuthology.orchestra.run.smithi159.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:28:29.170 INFO:teuthology.orchestra.run.smithi159.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:28:29.170 INFO:teuthology.orchestra.run.smithi159.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:28:29.170 INFO:teuthology.orchestra.run.smithi159.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:28:29.171 INFO:teuthology.orchestra.run.smithi159.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:28:29.171 INFO:teuthology.orchestra.run.smithi159.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:28:29.172 INFO:teuthology.orchestra.run.smithi159.stdout:The following additional packages will be installed: 2023-06-02T15:28:29.172 INFO:teuthology.orchestra.run.smithi159.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-02T15:28:29.172 INFO:teuthology.orchestra.run.smithi159.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-02T15:28:29.172 INFO:teuthology.orchestra.run.smithi159.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-02T15:28:29.172 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-02T15:28:29.172 INFO:teuthology.orchestra.run.smithi159.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-02T15:28:29.173 INFO:teuthology.orchestra.run.smithi159.stdout:Suggested packages: 2023-06-02T15:28:29.173 INFO:teuthology.orchestra.run.smithi159.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-02T15:28:29.173 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-02T15:28:29.173 INFO:teuthology.orchestra.run.smithi159.stdout: libengine-pkcs11-openssl 2023-06-02T15:28:29.205 INFO:teuthology.orchestra.run.smithi159.stdout:The following NEW packages will be installed: 2023-06-02T15:28:29.206 INFO:teuthology.orchestra.run.smithi159.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-02T15:28:29.206 INFO:teuthology.orchestra.run.smithi159.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-02T15:28:29.207 INFO:teuthology.orchestra.run.smithi159.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-02T15:28:29.207 INFO:teuthology.orchestra.run.smithi159.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-02T15:28:29.207 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-02T15:28:29.207 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-02T15:28:29.207 INFO:teuthology.orchestra.run.smithi159.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-02T15:28:29.207 INFO:teuthology.orchestra.run.smithi159.stdout:The following packages will be upgraded: 2023-06-02T15:28:29.208 INFO:teuthology.orchestra.run.smithi159.stdout: libssl3 2023-06-02T15:28:29.259 INFO:teuthology.orchestra.run.smithi159.stdout:1 upgraded, 39 newly installed, 0 to remove and 180 not upgraded. 2023-06-02T15:28:29.259 INFO:teuthology.orchestra.run.smithi159.stdout:Need to get 54.6 MB of archives. 2023-06-02T15:28:29.259 INFO:teuthology.orchestra.run.smithi159.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-02T15:28:29.259 INFO:teuthology.orchestra.run.smithi159.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-02T15:28:29.260 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-06-02T15:28:29.358 INFO:teuthology.orchestra.run.smithi159.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-02T15:28:29.360 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-02T15:28:29.379 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-02T15:28:29.419 INFO:teuthology.orchestra.run.smithi159.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-02T15:28:29.433 INFO:teuthology.orchestra.run.smithi159.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-02T15:28:29.434 INFO:teuthology.orchestra.run.smithi159.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-02T15:28:29.436 INFO:teuthology.orchestra.run.smithi159.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-02T15:28:29.438 INFO:teuthology.orchestra.run.smithi159.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-02T15:28:29.439 INFO:teuthology.orchestra.run.smithi159.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-02T15:28:29.440 INFO:teuthology.orchestra.run.smithi159.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-02T15:28:29.441 INFO:teuthology.orchestra.run.smithi159.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-02T15:28:29.477 INFO:teuthology.orchestra.run.smithi159.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-02T15:28:29.477 INFO:teuthology.orchestra.run.smithi159.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-02T15:28:29.519 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-06-02T15:28:29.527 INFO:teuthology.orchestra.run.smithi159.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-02T15:28:29.681 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-02T15:28:29.721 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-02T15:28:29.896 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-06-02T15:28:29.920 INFO:teuthology.orchestra.run.smithi159.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-02T15:28:29.921 INFO:teuthology.orchestra.run.smithi159.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-02T15:28:29.921 INFO:teuthology.orchestra.run.smithi159.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-02T15:28:29.924 INFO:teuthology.orchestra.run.smithi159.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-02T15:28:29.974 INFO:teuthology.orchestra.run.smithi159.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-02T15:28:29.979 INFO:teuthology.orchestra.run.smithi159.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-02T15:28:29.981 INFO:teuthology.orchestra.run.smithi159.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-02T15:28:29.989 INFO:teuthology.orchestra.run.smithi159.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-02T15:28:30.024 INFO:teuthology.orchestra.run.smithi159.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-02T15:28:30.180 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-06-02T15:28:30.185 INFO:teuthology.orchestra.run.smithi159.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-02T15:28:30.186 INFO:teuthology.orchestra.run.smithi159.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-02T15:28:30.210 INFO:teuthology.orchestra.run.smithi159.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-02T15:28:30.243 INFO:teuthology.orchestra.run.smithi159.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-02T15:28:30.247 INFO:teuthology.orchestra.run.smithi159.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-02T15:28:30.252 INFO:teuthology.orchestra.run.smithi159.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-02T15:28:30.252 INFO:teuthology.orchestra.run.smithi159.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-02T15:28:30.252 INFO:teuthology.orchestra.run.smithi159.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-02T15:28:30.262 INFO:teuthology.orchestra.run.smithi159.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-02T15:28:30.264 INFO:teuthology.orchestra.run.smithi159.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-02T15:28:30.265 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:28:30.473 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-06-02T15:28:30.511 INFO:teuthology.orchestra.run.smithi159.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-02T15:28:30.517 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-02T15:28:30.529 INFO:teuthology.orchestra.run.smithi159.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-02T15:28:30.529 INFO:teuthology.orchestra.run.smithi159.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-02T15:28:30.530 INFO:teuthology.orchestra.run.smithi159.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-02T15:28:30.547 INFO:teuthology.orchestra.run.smithi159.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-02T15:28:30.548 INFO:teuthology.orchestra.run.smithi159.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-02T15:28:30.647 INFO:teuthology.orchestra.run.smithi159.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-02T15:28:30.647 INFO:teuthology.orchestra.run.smithi159.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-02T15:28:30.808 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-06-02T15:28:30.843 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-02T15:28:30.961 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-common (238) ... 2023-06-02T15:28:31.048 INFO:teuthology.orchestra.run.smithi159.stdout:Preconfiguring packages ... 2023-06-02T15:28:31.050 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-02T15:28:31.067 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-06-02T15:28:31.141 INFO:teuthology.orchestra.run.smithi132.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-02T15:28:31.195 INFO:teuthology.orchestra.run.smithi159.stdout:Fetched 54.6 MB in 1s (38.1 MB/s) 2023-06-02T15:28:31.210 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:31.312 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package flex. 2023-06-02T15:28:31.410 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172965 files and directories currently installed.) 2023-06-02T15:28:31.416 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-02T15:28:31.460 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-02T15:28:31.503 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-idna (3.3-1) ... 2023-06-02T15:28:31.747 INFO:teuthology.orchestra.run.smithi132.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-02T15:28:31.749 DEBUG:teuthology.parallel:result is None 2023-06-02T15:28:31.821 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-06-02T15:28:31.835 INFO:teuthology.orchestra.run.smithi078.stdout:Adding user postgres to group ssl-cert 2023-06-02T15:28:32.035 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-02T15:28:32.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:28:32.061 INFO:teuthology.orchestra.run.smithi078.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-02T15:28:32.208 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-02T15:28:32.238 INFO:teuthology.orchestra.run.smithi078.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-02T15:28:32.238 INFO:teuthology.orchestra.run.smithi078.stdout:Removing obsolete dictionary files: 2023-06-02T15:28:32.618 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:28:32.834 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-02T15:28:32.977 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:28:33.119 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-toml (0.10.2-1) ... 2023-06-02T15:28:33.134 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package bison. 2023-06-02T15:28:33.237 INFO:teuthology.orchestra.run.smithi159.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173038 files and directories currently installed.) 2023-06-02T15:28:33.243 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-02T15:28:33.245 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:33.287 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-02T15:28:33.379 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-06-02T15:28:33.505 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-06-02T15:28:33.571 INFO:teuthology.orchestra.run.smithi078.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-02T15:28:33.584 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-02T15:28:33.631 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-06-02T15:28:33.633 INFO:teuthology.orchestra.run.smithi078.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-02T15:28:33.633 INFO:teuthology.orchestra.run.smithi078.stdout:This user must also own the server process. 2023-06-02T15:28:33.633 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:28:33.634 INFO:teuthology.orchestra.run.smithi078.stdout:The database cluster will be initialized with locale "en_US". 2023-06-02T15:28:33.634 INFO:teuthology.orchestra.run.smithi078.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-02T15:28:33.634 INFO:teuthology.orchestra.run.smithi078.stdout:The default text search configuration will be set to "english". 2023-06-02T15:28:33.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:28:33.635 INFO:teuthology.orchestra.run.smithi078.stdout:Data page checksums are disabled. 2023-06-02T15:28:33.635 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:28:33.635 INFO:teuthology.orchestra.run.smithi078.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-02T15:28:33.635 INFO:teuthology.orchestra.run.smithi078.stdout:creating subdirectories ... ok 2023-06-02T15:28:33.635 INFO:teuthology.orchestra.run.smithi078.stdout:selecting dynamic shared memory implementation ... posix 2023-06-02T15:28:33.647 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default max_connections ... 100 2023-06-02T15:28:33.667 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default shared_buffers ... 128MB 2023-06-02T15:28:33.676 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default time zone ... Etc/UTC 2023-06-02T15:28:33.677 INFO:teuthology.orchestra.run.smithi078.stdout:creating configuration files ... ok 2023-06-02T15:28:33.687 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-02T15:28:33.715 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-02T15:28:33.754 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-02T15:28:33.792 INFO:teuthology.orchestra.run.smithi078.stdout:running bootstrap script ... ok 2023-06-02T15:28:33.924 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-06-02T15:28:34.090 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package dump. 2023-06-02T15:28:34.117 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-02T15:28:34.157 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking dump (0.4b47-3) ... 2023-06-02T15:28:34.192 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-06-02T15:28:34.411 INFO:teuthology.orchestra.run.smithi078.stdout:performing post-bootstrap initialization ... ok 2023-06-02T15:28:34.461 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package indent. 2023-06-02T15:28:34.468 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:28:34.488 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-02T15:28:34.527 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-02T15:28:34.594 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-06-02T15:28:34.720 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-06-02T15:28:34.805 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-02T15:28:34.821 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-02T15:28:34.871 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-02T15:28:35.030 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-06-02T15:28:35.086 INFO:teuthology.orchestra.run.smithi078.stdout:syncing data to disk ... ok 2023-06-02T15:28:35.233 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-02T15:28:35.261 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-02T15:28:35.280 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-06-02T15:28:35.300 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-02T15:28:35.493 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-02T15:28:35.523 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-06-02T15:28:35.562 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-02T15:28:35.589 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-02T15:28:35.777 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-06-02T15:28:35.932 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-02T15:28:36.028 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-06-02T15:28:36.296 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-06-02T15:28:36.421 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-06-02T15:28:36.706 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-06-02T15:28:36.800 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-02T15:28:36.828 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-02T15:28:36.849 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-06-02T15:28:36.866 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-02T15:28:37.102 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-02T15:28:37.130 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-02T15:28:37.133 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-06-02T15:28:37.169 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-02T15:28:37.422 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libjson-perl. 2023-06-02T15:28:37.426 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-06-02T15:28:37.438 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-02T15:28:37.480 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-02T15:28:37.677 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-06-02T15:28:37.825 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-02T15:28:37.852 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-02T15:28:37.899 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-02T15:28:38.080 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-06-02T15:28:38.302 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:28:38.330 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-06-02T15:28:38.428 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-02T15:28:38.456 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-06-02T15:28:38.553 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql (14+238) ... 2023-06-02T15:28:38.679 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:28:38.805 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:38.841 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-06-02T15:28:39.061 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-02T15:28:39.062 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-02T15:28:39.100 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-portend (3.0.0-1) ... 2023-06-02T15:28:39.377 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-06-02T15:28:39.503 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-06-02T15:28:39.553 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-02T15:28:39.581 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-02T15:28:39.619 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:28:39.650 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-02T15:28:39.829 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-06-02T15:28:39.863 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-02T15:28:39.880 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-02T15:28:39.921 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:28:39.968 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-02T15:28:40.120 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-02T15:28:40.147 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-06-02T15:28:40.274 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-02T15:28:40.302 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-02T15:28:40.349 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:40.431 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-06-02T15:28:40.532 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rsa (4.8-1) ... 2023-06-02T15:28:40.693 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-02T15:28:40.721 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-02T15:28:40.760 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-02T15:28:40.799 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-06-02T15:28:41.080 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-02T15:28:41.084 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-06-02T15:28:41.108 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-02T15:28:41.146 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-02T15:28:41.331 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-02T15:28:41.386 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-06-02T15:28:41.431 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-02T15:28:41.625 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-02T15:28:41.653 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:41.700 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:41.762 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-06-02T15:28:42.043 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-02T15:28:42.044 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-02T15:28:42.045 DEBUG:teuthology.parallel:result is None 2023-06-02T15:28:42.046 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-06-02T15:28:42.072 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:42.111 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:28:42.413 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-02T15:28:42.430 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:42.472 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:28:42.508 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-06-02T15:28:42.715 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-02T15:28:42.732 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-02T15:28:42.774 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:28:42.800 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librados2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:42.951 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librgw2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:43.171 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:43.269 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-02T15:28:43.289 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs2 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:43.297 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-02T15:28:43.336 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-02T15:28:43.389 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libradosstriper1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:43.490 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-06-02T15:28:43.689 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package modemmanager. 2023-06-02T15:28:43.717 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-02T15:28:43.755 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:43.767 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librbd1 (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:43.910 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-modules-core (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:44.036 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:44.246 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-02T15:28:44.246 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-06-02T15:28:44.395 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package network-manager. 2023-06-02T15:28:44.423 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-02T15:28:44.470 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-02T15:28:44.746 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs-dev (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:44.872 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rados (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:44.998 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephfs-top (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:45.124 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-06-02T15:28:45.210 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package ppp. 2023-06-02T15:28:45.238 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-02T15:28:45.561 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-02T15:28:45.873 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package pptp-linux. 2023-06-02T15:28:45.902 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-02T15:28:45.940 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-02T15:28:46.209 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-02T15:28:46.237 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-02T15:28:46.276 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-02T15:28:46.320 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rbd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:46.446 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up rbd-fuse (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:46.580 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:46.663 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-02T15:28:46.681 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cephfs (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:46.691 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-02T15:28:46.730 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking postgresql-client-common (238) ... 2023-06-02T15:28:46.799 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephfs-shell (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:46.925 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-common (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:47.034 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-02T15:28:47.062 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:47.100 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:47.468 INFO:teuthology.orchestra.run.smithi150.stdout:Adding group ceph....done 2023-06-02T15:28:47.680 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package postgresql-common. 2023-06-02T15:28:47.708 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-02T15:28:47.764 INFO:teuthology.orchestra.run.smithi159.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-02T15:28:47.795 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking postgresql-common (238) ... 2023-06-02T15:28:47.853 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user ceph....done 2023-06-02T15:28:48.080 INFO:teuthology.orchestra.run.smithi150.stdout:Setting system user ceph properties....done 2023-06-02T15:28:48.095 INFO:teuthology.orchestra.run.smithi150.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-06-02T15:28:48.233 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-06-02T15:28:48.254 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package postgresql-14. 2023-06-02T15:28:48.283 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:28:48.323 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:48.579 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-06-02T15:28:49.143 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephfs-mirror (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:49.278 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-test (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:49.487 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up radosgw (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:49.549 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package postgresql. 2023-06-02T15:28:49.578 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-02T15:28:49.616 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking postgresql (14+238) ... 2023-06-02T15:28:49.742 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-02T15:28:49.742 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-06-02T15:28:49.859 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package postgresql-client. 2023-06-02T15:28:49.888 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-02T15:28:49.951 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking postgresql-client (14+238) ... 2023-06-02T15:28:50.203 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-02T15:28:50.220 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-02T15:28:50.270 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-02T15:28:50.464 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-base (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:50.614 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package tcl8.6. 2023-06-02T15:28:50.642 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-02T15:28:50.681 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-02T15:28:50.773 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-06-02T15:28:50.975 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package tcl. 2023-06-02T15:28:51.003 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-02T15:28:51.047 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-02T15:28:51.274 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mds (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:51.395 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package wpasupplicant. 2023-06-02T15:28:51.423 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-02T15:28:51.504 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-02T15:28:51.504 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-06-02T15:28:51.788 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-02T15:28:51.967 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:52.183 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-02T15:28:52.183 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-06-02T15:28:52.261 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-02T15:28:52.289 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-02T15:28:52.377 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-02T15:28:52.694 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-osd (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:52.739 INFO:teuthology.orchestra.run.smithi159.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-02T15:28:52.768 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-02T15:28:52.814 INFO:teuthology.orchestra.run.smithi159.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-02T15:28:53.007 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-02T15:28:53.007 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-06-02T15:28:53.100 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up postgresql-client-common (238) ... 2023-06-02T15:28:53.287 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-02T15:28:53.413 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-02T15:28:53.556 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:53.562 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:53.682 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-02T15:28:53.808 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:53.841 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-02T15:28:53.958 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mon (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:53.967 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:28:54.170 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-02T15:28:54.170 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-06-02T15:28:54.493 INFO:teuthology.orchestra.run.smithi159.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-02T15:28:54.583 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-02T15:28:54.700 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-cephadm (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:54.860 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:54.965 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-02T15:28:54.965 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-02T15:28:54.986 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-dashboard (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:55.137 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-volume (18.0.0-3488-g2870bf45-1jammy) ... 2023-06-02T15:28:55.264 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-02T15:28:55.511 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-02T15:28:55.637 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:28:55.763 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-02T15:28:55.889 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-02T15:28:56.015 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-02T15:28:56.141 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-02T15:28:56.251 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-02T15:28:56.365 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-02T15:28:56.808 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-02T15:28:56.810 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-06-02T15:28:56.856 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-02T15:28:56.905 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2023-06-02T15:28:56.982 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up dump (0.4b47-3) ... 2023-06-02T15:28:57.076 INFO:teuthology.orchestra.run.smithi159.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-02T15:28:57.081 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2023-06-02T15:28:57.082 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2023-06-02T15:28:57.134 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:28:57.235 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-02T15:28:57.238 INFO:teuthology.orchestra.run.smithi150.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-06-02T15:28:57.238 INFO:teuthology.orchestra.run.smithi150.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-06-02T15:28:57.238 INFO:teuthology.orchestra.run.smithi150.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-06-02T15:28:57.239 INFO:teuthology.orchestra.run.smithi150.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-06-02T15:28:57.239 INFO:teuthology.orchestra.run.smithi150.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-06-02T15:28:57.239 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages were automatically installed and are no longer required: 2023-06-02T15:28:57.239 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-06-02T15:28:57.239 INFO:teuthology.orchestra.run.smithi150.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-06-02T15:28:57.240 INFO:teuthology.orchestra.run.smithi150.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-06-02T15:28:57.240 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-06-02T15:28:57.240 INFO:teuthology.orchestra.run.smithi150.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-06-02T15:28:57.240 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove them. 2023-06-02T15:28:57.240 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2023-06-02T15:28:57.241 INFO:teuthology.orchestra.run.smithi150.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-06-02T15:28:57.241 INFO:teuthology.orchestra.run.smithi150.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-06-02T15:28:57.241 INFO:teuthology.orchestra.run.smithi150.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-06-02T15:28:57.241 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-06-02T15:28:57.242 INFO:teuthology.orchestra.run.smithi150.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-02T15:28:57.242 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2023-06-02T15:28:57.242 INFO:teuthology.orchestra.run.smithi150.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-06-02T15:28:57.242 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-06-02T15:28:57.242 INFO:teuthology.orchestra.run.smithi150.stdout: libengine-pkcs11-openssl 2023-06-02T15:28:57.277 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2023-06-02T15:28:57.278 INFO:teuthology.orchestra.run.smithi150.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-06-02T15:28:57.278 INFO:teuthology.orchestra.run.smithi150.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-06-02T15:28:57.278 INFO:teuthology.orchestra.run.smithi150.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-06-02T15:28:57.278 INFO:teuthology.orchestra.run.smithi150.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-06-02T15:28:57.279 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-06-02T15:28:57.279 INFO:teuthology.orchestra.run.smithi150.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-06-02T15:28:57.279 INFO:teuthology.orchestra.run.smithi150.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-06-02T15:28:57.280 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2023-06-02T15:28:57.280 INFO:teuthology.orchestra.run.smithi150.stdout: libssl3 2023-06-02T15:28:57.336 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-02T15:28:57.446 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-02T15:28:57.478 INFO:teuthology.orchestra.run.smithi150.stdout:1 upgraded, 39 newly installed, 0 to remove and 180 not upgraded. 2023-06-02T15:28:57.478 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 54.6 MB of archives. 2023-06-02T15:28:57.478 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 202 MB of additional disk space will be used. 2023-06-02T15:28:57.479 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-06-02T15:28:57.571 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-02T15:28:57.688 INFO:teuthology.orchestra.run.smithi159.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-02T15:28:57.757 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-02T15:28:57.883 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-02T15:28:57.954 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.10 [1,901 kB] 2023-06-02T15:28:58.051 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-02T15:28:58.152 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:28:58.212 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-06-02T15:28:58.247 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-06-02T15:28:58.249 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-06-02T15:28:58.253 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-02T15:28:58.253 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-06-02T15:28:58.257 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-06-02T15:28:58.258 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-06-02T15:28:58.261 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-06-02T15:28:58.263 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-06-02T15:28:58.404 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up postgresql-client (14+238) ... 2023-06-02T15:28:58.429 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-06-02T15:28:58.429 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-06-02T15:28:58.539 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-02T15:28:58.674 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-06-02T15:28:59.036 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:28:59.037 INFO:teuthology.orchestra.run.smithi159.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-02T15:28:59.037 INFO:teuthology.orchestra.run.smithi159.stdout:which means they are currently configured by ifupdown: 2023-06-02T15:28:59.037 INFO:teuthology.orchestra.run.smithi159.stdout:- enp3s0f1 2023-06-02T15:28:59.037 INFO:teuthology.orchestra.run.smithi159.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-02T15:28:59.037 INFO:teuthology.orchestra.run.smithi159.stdout:remove their configuration from /etc/network/interfaces. 2023-06-02T15:28:59.037 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:28:59.163 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-02T15:28:59.503 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-02T15:28:59.820 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-06-02T15:28:59.825 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-06-02T15:28:59.825 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-06-02T15:28:59.832 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-06-02T15:28:59.833 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-06-02T15:28:59.843 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.8-0ubuntu0.22.04.1 [141 kB] 2023-06-02T15:28:59.847 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-06-02T15:28:59.860 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-02T15:28:59.865 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-06-02T15:29:00.029 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.10 [2,372 kB] 2023-06-02T15:29:00.392 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:29:00.543 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-02T15:29:00.669 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-02T15:29:00.754 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-06-02T15:29:00.754 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-06-02T15:29:00.781 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-06-02T15:29:00.795 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up postgresql-common (238) ... 2023-06-02T15:29:00.859 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-06-02T15:29:00.867 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-06-02T15:29:00.868 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-06-02T15:29:00.869 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-06-02T15:29:00.870 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.8-0ubuntu0.22.04.1 [1,221 kB] 2023-06-02T15:29:00.896 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-06-02T15:29:00.900 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.8-0ubuntu0.22.04.1 [16.1 MB] 2023-06-02T15:29:01.607 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-06-02T15:29:01.643 INFO:teuthology.orchestra.run.smithi159.stdout:Adding user postgres to group ssl-cert 2023-06-02T15:29:01.690 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-06-02T15:29:01.691 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-06-02T15:29:01.691 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-06-02T15:29:01.780 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-06-02T15:29:01.785 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-06-02T15:29:01.886 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:01.886 INFO:teuthology.orchestra.run.smithi159.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-02T15:29:02.087 INFO:teuthology.orchestra.run.smithi159.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-02T15:29:02.087 INFO:teuthology.orchestra.run.smithi159.stdout:Removing obsolete dictionary files: 2023-06-02T15:29:02.241 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-06-02T15:29:02.244 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-06-02T15:29:02.645 INFO:teuthology.orchestra.run.smithi150.stdout:Preconfiguring packages ... 2023-06-02T15:29:02.697 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-02T15:29:02.801 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2023-06-02T15:29:02.950 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package flex. 2023-06-02T15:29:03.052 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 172965 files and directories currently installed.) 2023-06-02T15:29:03.058 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-06-02T15:29:03.098 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking flex (2.6.4-8build2) ... 2023-06-02T15:29:03.114 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:29:03.435 INFO:teuthology.orchestra.run.smithi159.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-02T15:29:03.457 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-02T15:29:03.605 INFO:teuthology.orchestra.run.smithi159.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-02T15:29:03.605 INFO:teuthology.orchestra.run.smithi159.stdout:This user must also own the server process. 2023-06-02T15:29:03.605 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:03.605 INFO:teuthology.orchestra.run.smithi159.stdout:The database cluster will be initialized with locale "en_US". 2023-06-02T15:29:03.605 INFO:teuthology.orchestra.run.smithi159.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-02T15:29:03.606 INFO:teuthology.orchestra.run.smithi159.stdout:The default text search configuration will be set to "english". 2023-06-02T15:29:03.606 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:03.606 INFO:teuthology.orchestra.run.smithi159.stdout:Data page checksums are disabled. 2023-06-02T15:29:03.606 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:03.606 INFO:teuthology.orchestra.run.smithi159.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-02T15:29:03.607 INFO:teuthology.orchestra.run.smithi159.stdout:creating subdirectories ... ok 2023-06-02T15:29:03.607 INFO:teuthology.orchestra.run.smithi159.stdout:selecting dynamic shared memory implementation ... posix 2023-06-02T15:29:03.621 INFO:teuthology.orchestra.run.smithi159.stdout:selecting default max_connections ... 100 2023-06-02T15:29:03.641 INFO:teuthology.orchestra.run.smithi159.stdout:selecting default shared_buffers ... 128MB 2023-06-02T15:29:03.651 INFO:teuthology.orchestra.run.smithi159.stdout:selecting default time zone ... Etc/UTC 2023-06-02T15:29:03.652 INFO:teuthology.orchestra.run.smithi159.stdout:creating configuration files ... ok 2023-06-02T15:29:03.731 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-02T15:29:03.769 INFO:teuthology.orchestra.run.smithi159.stdout:running bootstrap script ... ok 2023-06-02T15:29:03.887 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.10) over (3.0.2-0ubuntu1.7) ... 2023-06-02T15:29:04.280 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:29:04.595 INFO:teuthology.orchestra.run.smithi159.stdout:performing post-bootstrap initialization ... ok 2023-06-02T15:29:04.813 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package bison. 2023-06-02T15:29:04.917 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173038 files and directories currently installed.) 2023-06-02T15:29:04.923 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-06-02T15:29:04.973 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-06-02T15:29:05.383 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-06-02T15:29:05.410 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-06-02T15:29:05.449 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-06-02T15:29:05.610 INFO:teuthology.orchestra.run.smithi159.stdout:syncing data to disk ... ok 2023-06-02T15:29:05.753 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package dump. 2023-06-02T15:29:05.780 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-06-02T15:29:05.819 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking dump (0.4b47-3) ... 2023-06-02T15:29:06.040 INFO:teuthology.orchestra.run.smithi159.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-02T15:29:06.106 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package indent. 2023-06-02T15:29:06.122 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-06-02T15:29:06.164 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking indent (2.2.12-1build2) ... 2023-06-02T15:29:06.459 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-06-02T15:29:06.486 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-06-02T15:29:06.533 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-02T15:29:06.879 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-06-02T15:29:06.906 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-06-02T15:29:06.945 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-02T15:29:07.206 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-06-02T15:29:07.234 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-06-02T15:29:07.273 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-06-02T15:29:07.668 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libfl2:amd64. 2023-06-02T15:29:07.695 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-06-02T15:29:07.743 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-06-02T15:29:07.987 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-06-02T15:29:08.003 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-06-02T15:29:08.045 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-02T15:29:08.297 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjson-perl. 2023-06-02T15:29:08.313 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-06-02T15:29:08.356 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-06-02T15:29:08.667 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libllvm14:amd64. 2023-06-02T15:29:08.695 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-06-02T15:29:08.734 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-02T15:29:09.635 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:29:09.761 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-02T15:29:09.887 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up postgresql (14+238) ... 2023-06-02T15:29:10.013 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:29:10.131 INFO:teuthology.orchestra.run.smithi159.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:29:10.368 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-02T15:29:10.368 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-02T15:29:10.453 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-06-02T15:29:10.481 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-02T15:29:10.520 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:29:10.781 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmbim-proxy. 2023-06-02T15:29:10.808 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-06-02T15:29:10.848 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:29:10.983 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-02T15:29:11.150 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-06-02T15:29:11.178 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-02T15:29:11.217 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:29:11.286 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-02T15:29:11.445 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-02T15:29:11.628 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libndp0:amd64. 2023-06-02T15:29:11.655 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-06-02T15:29:11.703 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-02T15:29:12.030 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libnm0:amd64. 2023-06-02T15:29:12.058 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-06-02T15:29:12.239 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-02T15:29:12.530 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-02T15:29:12.630 INFO:teuthology.orchestra.run.smithi159.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-02T15:29:12.675 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libpq5:amd64. 2023-06-02T15:29:12.702 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../16-libpq5_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:29:12.741 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:29:13.087 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-06-02T15:29:13.114 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:29:13.152 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:29:13.250 INFO:teuthology.orchestra.run.smithi159.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-02T15:29:13.252 DEBUG:teuthology.parallel:result is None 2023-06-02T15:29:13.455 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libqmi-proxy. 2023-06-02T15:29:13.471 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:29:13.513 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:29:13.757 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-06-02T15:29:13.773 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.10_amd64.deb ... 2023-06-02T15:29:13.815 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:29:14.303 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-06-02T15:29:14.330 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-06-02T15:29:14.369 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-06-02T15:29:14.730 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package modemmanager. 2023-06-02T15:29:14.758 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-06-02T15:29:14.797 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:29:15.470 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package network-manager. 2023-06-02T15:29:15.497 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-06-02T15:29:15.552 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-06-02T15:29:16.151 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ppp. 2023-06-02T15:29:16.181 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-06-02T15:29:16.473 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-06-02T15:29:16.797 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package pptp-linux. 2023-06-02T15:29:16.825 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-06-02T15:29:16.864 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-06-02T15:29:17.099 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package network-manager-pptp. 2023-06-02T15:29:17.115 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-06-02T15:29:17.158 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-06-02T15:29:17.453 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-client-common. 2023-06-02T15:29:17.480 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-06-02T15:29:17.511 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-client-common (238) ... 2023-06-02T15:29:17.798 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-client-14. 2023-06-02T15:29:17.826 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../27-postgresql-client-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:29:17.864 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:29:18.444 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-common. 2023-06-02T15:29:18.472 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-06-02T15:29:18.528 INFO:teuthology.orchestra.run.smithi150.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-06-02T15:29:18.567 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-common (238) ... 2023-06-02T15:29:19.051 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-14. 2023-06-02T15:29:19.079 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../29-postgresql-14_14.8-0ubuntu0.22.04.1_amd64.deb ... 2023-06-02T15:29:19.121 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:29:20.329 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql. 2023-06-02T15:29:20.346 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-06-02T15:29:20.379 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql (14+238) ... 2023-06-02T15:29:20.589 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-client. 2023-06-02T15:29:20.606 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-06-02T15:29:20.648 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-client (14+238) ... 2023-06-02T15:29:20.892 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package postgresql-contrib. 2023-06-02T15:29:20.920 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-06-02T15:29:20.958 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking postgresql-contrib (14+238) ... 2023-06-02T15:29:21.277 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package tcl8.6. 2023-06-02T15:29:21.306 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-06-02T15:29:21.344 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-02T15:29:21.596 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package tcl. 2023-06-02T15:29:21.613 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-06-02T15:29:21.651 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-06-02T15:29:21.933 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package wpasupplicant. 2023-06-02T15:29:21.961 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-06-02T15:29:21.991 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-02T15:29:22.346 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-06-02T15:29:22.373 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-06-02T15:29:22.412 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-06-02T15:29:22.773 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package usb-modeswitch. 2023-06-02T15:29:22.801 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-06-02T15:29:22.867 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-02T15:29:23.159 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-client-common (238) ... 2023-06-02T15:29:23.371 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up flex (2.6.4-8build2) ... 2023-06-02T15:29:23.497 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-06-02T15:29:23.639 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libpq5:amd64 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:29:23.740 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-06-02T15:29:23.841 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-06-02T15:29:23.959 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-client-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:29:24.389 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-06-02T15:29:24.473 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-06-02T15:29:24.811 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-02T15:29:24.812 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-06-02T15:29:25.309 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-06-02T15:29:25.510 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.10) ... 2023-06-02T15:29:25.644 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-06-02T15:29:25.772 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-06-02T15:29:25.890 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-06-02T15:29:25.991 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-06-02T15:29:26.100 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-06-02T15:29:26.798 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-06-02T15:29:26.907 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up dump (0.4b47-3) ... 2023-06-02T15:29:26.992 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-06-02T15:29:27.050 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:29:27.176 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-06-02T15:29:27.302 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up tcl (8.6.11+1build2) ... 2023-06-02T15:29:27.428 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjson-perl (4.04000-1) ... 2023-06-02T15:29:27.554 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-06-02T15:29:27.644 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-06-02T15:29:27.881 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up indent (2.2.12-1build2) ... 2023-06-02T15:29:28.132 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-06-02T15:29:28.283 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-06-02T15:29:28.393 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:29:28.519 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-06-02T15:29:28.687 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-client (14+238) ... 2023-06-02T15:29:28.813 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-06-02T15:29:29.341 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:29.341 INFO:teuthology.orchestra.run.smithi150.stdout:The following network interfaces were found in /etc/network/interfaces 2023-06-02T15:29:29.342 INFO:teuthology.orchestra.run.smithi150.stdout:which means they are currently configured by ifupdown: 2023-06-02T15:29:29.342 INFO:teuthology.orchestra.run.smithi150.stdout:- enp3s0f1 2023-06-02T15:29:29.342 INFO:teuthology.orchestra.run.smithi150.stdout:If you want to manage those interfaces with NetworkManager instead 2023-06-02T15:29:29.342 INFO:teuthology.orchestra.run.smithi150.stdout:remove their configuration from /etc/network/interfaces. 2023-06-02T15:29:29.342 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:29.467 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-06-02T15:29:29.790 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-06-02T15:29:30.141 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-06-02T15:29:30.699 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-06-02T15:29:30.842 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-06-02T15:29:30.969 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-06-02T15:29:31.094 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-common (238) ... 2023-06-02T15:29:32.004 INFO:teuthology.orchestra.run.smithi150.stdout:Adding user postgres to group ssl-cert 2023-06-02T15:29:32.235 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:32.235 INFO:teuthology.orchestra.run.smithi150.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-06-02T15:29:32.431 INFO:teuthology.orchestra.run.smithi150.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-06-02T15:29:32.431 INFO:teuthology.orchestra.run.smithi150.stdout:Removing obsolete dictionary files: 2023-06-02T15:29:33.012 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-06-02T15:29:33.387 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-14 (14.8-0ubuntu0.22.04.1) ... 2023-06-02T15:29:33.699 INFO:teuthology.orchestra.run.smithi150.stdout:Creating new PostgreSQL cluster 14/main ... 2023-06-02T15:29:33.711 INFO:teuthology.orchestra.run.smithi150.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-06-02T15:29:33.753 INFO:teuthology.orchestra.run.smithi150.stdout:The files belonging to this database system will be owned by user "postgres". 2023-06-02T15:29:33.753 INFO:teuthology.orchestra.run.smithi150.stdout:This user must also own the server process. 2023-06-02T15:29:33.753 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:33.753 INFO:teuthology.orchestra.run.smithi150.stdout:The database cluster will be initialized with locale "en_US". 2023-06-02T15:29:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-06-02T15:29:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:The default text search configuration will be set to "english". 2023-06-02T15:29:33.754 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:Data page checksums are disabled. 2023-06-02T15:29:33.754 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:33.754 INFO:teuthology.orchestra.run.smithi150.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-06-02T15:29:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:creating subdirectories ... ok 2023-06-02T15:29:33.755 INFO:teuthology.orchestra.run.smithi150.stdout:selecting dynamic shared memory implementation ... posix 2023-06-02T15:29:33.765 INFO:teuthology.orchestra.run.smithi150.stdout:selecting default max_connections ... 100 2023-06-02T15:29:33.781 INFO:teuthology.orchestra.run.smithi150.stdout:selecting default shared_buffers ... 128MB 2023-06-02T15:29:33.792 INFO:teuthology.orchestra.run.smithi150.stdout:selecting default time zone ... Etc/UTC 2023-06-02T15:29:33.792 INFO:teuthology.orchestra.run.smithi150.stdout:creating configuration files ... ok 2023-06-02T15:29:33.902 INFO:teuthology.orchestra.run.smithi150.stdout:running bootstrap script ... ok 2023-06-02T15:29:34.532 INFO:teuthology.orchestra.run.smithi150.stdout:performing post-bootstrap initialization ... ok 2023-06-02T15:29:35.174 INFO:teuthology.orchestra.run.smithi150.stdout:syncing data to disk ... ok 2023-06-02T15:29:35.586 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-06-02T15:29:38.402 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:29:38.544 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql-contrib (14+238) ... 2023-06-02T15:29:38.670 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up postgresql (14+238) ... 2023-06-02T15:29:38.796 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-06-02T15:29:38.931 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-06-02T15:29:39.187 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-06-02T15:29:39.188 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-06-02T15:29:39.783 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-06-02T15:29:40.094 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-06-02T15:29:40.229 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-06-02T15:29:41.490 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-06-02T15:29:41.598 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-06-02T15:29:42.203 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-06-02T15:29:42.206 DEBUG:teuthology.parallel:result is None 2023-06-02T15:29:42.206 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2870bf456d3115490c153abce9d47ac5c043b65e 2023-06-02T15:29:42.351 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2023-06-02T15:29:42.371 INFO:teuthology.orchestra.run.smithi078.stdout:18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:29:42.372 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:29:42.372 INFO:teuthology.task.install:The correct ceph version 18.0.0-3488-g2870bf45-1jammy is installed. 2023-06-02T15:29:42.372 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2870bf456d3115490c153abce9d47ac5c043b65e 2023-06-02T15:29:42.512 DEBUG:teuthology.orchestra.run.smithi132:> dpkg-query -W -f '${Version}' ceph 2023-06-02T15:29:42.531 INFO:teuthology.orchestra.run.smithi132.stdout:18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:29:42.532 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:29:42.532 INFO:teuthology.task.install:The correct ceph version 18.0.0-3488-g2870bf45-1jammy is installed. 2023-06-02T15:29:42.533 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2870bf456d3115490c153abce9d47ac5c043b65e 2023-06-02T15:29:42.670 DEBUG:teuthology.orchestra.run.smithi150:> dpkg-query -W -f '${Version}' ceph 2023-06-02T15:29:42.690 INFO:teuthology.orchestra.run.smithi150.stdout:18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:29:42.690 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:29:42.690 INFO:teuthology.task.install:The correct ceph version 18.0.0-3488-g2870bf45-1jammy is installed. 2023-06-02T15:29:42.691 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2870bf456d3115490c153abce9d47ac5c043b65e 2023-06-02T15:29:42.916 DEBUG:teuthology.orchestra.run.smithi159:> dpkg-query -W -f '${Version}' ceph 2023-06-02T15:29:42.935 INFO:teuthology.orchestra.run.smithi159.stdout:18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:29:42.936 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3488-g2870bf45-1jammy 2023-06-02T15:29:42.936 INFO:teuthology.task.install:The correct ceph version 18.0.0-3488-g2870bf45-1jammy is installed. 2023-06-02T15:29:42.936 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-06-02T15:29:42.937 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:29:42.937 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-02T15:29:42.952 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:29:42.952 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-02T15:29:42.966 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:29:42.966 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-02T15:29:42.981 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:29:42.981 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-06-02T15:29:42.996 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-06-02T15:29:42.996 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:29:42.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2023-06-02T15:29:43.008 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-02T15:29:43.063 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:29:43.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2023-06-02T15:29:43.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-02T15:29:43.132 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:29:43.132 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2023-06-02T15:29:43.146 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-02T15:29:43.202 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:29:43.202 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2023-06-02T15:29:43.215 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-06-02T15:29:43.268 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-06-02T15:29:43.268 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:29:43.269 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-02T15:29:43.282 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-02T15:29:43.335 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:29:43.335 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-02T15:29:43.349 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-02T15:29:43.404 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:29:43.405 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-02T15:29:43.419 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-02T15:29:43.473 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:29:43.473 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2023-06-02T15:29:43.486 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-06-02T15:29:43.539 INFO:teuthology.run_tasks:Running task ceph... 2023-06-02T15:29:43.612 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-06-02T15:29:43.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2023-06-02T15:29:43.615 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2023-06-02T15:29:43.617 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /var/log/ceph 2023-06-02T15:29:43.619 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /var/log/ceph 2023-06-02T15:29:43.632 INFO:tasks.ceph:Disabling ceph logrotate... 2023-06-02T15:29:43.633 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-02T15:29:43.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-02T15:29:43.674 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-02T15:29:43.676 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/logrotate.d/ceph 2023-06-02T15:29:43.688 INFO:tasks.ceph:Creating extra log directories... 2023-06-02T15:29:43.688 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-02T15:29:43.722 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-02T15:29:43.726 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-02T15:29:43.730 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-06-02T15:29:43.752 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-06-02T15:29:43.752 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-06-02T15:29:43.752 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-06-02T15:29:43.753 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:29:43.753 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-02T15:29:43.776 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-02T15:29:43.852 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:29:43.852 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-02T15:29:43.857 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-02T15:29:43.932 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:29:43.932 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-02T15:29:43.938 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-02T15:29:44.013 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:29:44.014 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-06-02T15:29:44.019 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-06-02T15:29:44.103 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-06-02T15:29:44.103 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-06-02T15:29:44.104 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361', 'branch': 'reef-release', 'description': 'fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest}', 'email': None, 'first_in_suite': False, 'job_id': '7294361', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'reef-release'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '2870bf456d3115490c153abce9d47ac5c043b65e'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '2870bf456d3115490c153abce9d47ac5c043b65e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef-release', 'sha1': '2870bf456d3115490c153abce9d47ac5c043b65e'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 71, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0'], ['client.1']], 'seed': 3048, 'sha1': '2870bf456d3115490c153abce9d47ac5c043b65e', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'reef-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_2870bf456d3115490c153abce9d47ac5c043b65e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '2870bf456d3115490c153abce9d47ac5c043b65e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi078.front.sepia.ceph.com': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAZR0uL9ylfTMCrHWJ2m9yZdwI7Zs0LYSXD8l/NhaQns', 'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObGrJhjSuegxyHezZeD992nLJv7Hn5SJHoi2yHJeEdDuey7WOBYRxui7li76nOCu/nlybVywM+zD+tvT5rBJn0=', 'smithi150.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdJOZSiX3+K3xurw+9W23izImR/2D8F1yD/nSBGZfyx5WupTuX/8co3hwAW4CQD0ajhkff2cnpJ4Ib+BMVYdNk=', 'smithi159.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA1/IRWm6AhkuqdkiWvx+BHPj6Kp6XrE4bGIu6bnFC6tAPc1BI/ngr5Frv6LIns5CFXMAL2CqqRhTeDemDZq25E='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2870bf456d3115490c153abce9d47ac5c043b65e'}}, {'ceph': None}, {'ceph-fuse': None}, {'pexec': {'clients': ['cd $TESTDIR', 'wget http://download.ceph.com/qa/mdtest-1.9.3.tgz', 'mkdir mdtest-1.9.3', 'cd mdtest-1.9.3', 'tar xvfz $TESTDIR/mdtest-1.9.3.tgz', 'rm $TESTDIR/mdtest-1.9.3.tgz', 'MPI_CC=mpicc make', 'ln -s $TESTDIR/mnt.* $TESTDIR/gmnt']}}, {'ssh_keys': None}, {'mpi': {'exec': '$TESTDIR/mdtest-1.9.3/mdtest -d $TESTDIR/gmnt -I 20 -z 5 -b 2 -R'}}, {'pexec': {'clients': ['rm -f $TESTDIR/gmnt', 'rm -rf $TESTDIR/mdtest-1.9.3', 'rm -rf $TESTDIR/._mdtest-1.9.3']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '62814aba234085f597115b9ba9bdc56af117de9e', 'timestamp': '2023-06-02_15:02:25', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-06-02T15:29:44.105 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-02T15:29:44.108 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-02T15:29:44.111 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-02T15:29:44.114 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-06-02T15:29:44.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2023-06-02T15:29:44.158 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2023-06-02T15:29:44.160 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m0777 -- /var/run/ceph 2023-06-02T15:29:44.163 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/run/ceph 2023-06-02T15:29:44.196 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:29:44.197 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2023-06-02T15:29:44.216 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-02T15:29:44.217 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2023-06-02T15:29:44.265 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-02T15:29:44.265 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-02T15:29:44.265 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 887 Links: 1 2023-06-02T15:29:44.265 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-02T15:29:44.265 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-06-02 15:22:16.405959783 +0000 2023-06-02T15:29:44.266 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-06-02 15:22:16.029963141 +0000 2023-06-02T15:29:44.266 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-06-02 15:22:16.029963141 +0000 2023-06-02T15:29:44.266 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-06-02T15:29:44.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-02T15:29:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-06-02T15:29:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-06-02T15:29:44.319 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00040731 s, 1.3 MB/s 2023-06-02T15:29:44.320 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-02T15:29:44.370 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2023-06-02T15:29:44.416 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-02T15:29:44.417 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-02T15:29:44.417 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-06-02T15:29:44.417 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-02T15:29:44.417 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-06-02 15:22:17.045954066 +0000 2023-06-02T15:29:44.417 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-06-02 15:22:16.645957639 +0000 2023-06-02T15:29:44.418 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-06-02 15:22:16.645957639 +0000 2023-06-02T15:29:44.418 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-06-02T15:29:44.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-02T15:29:44.471 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-06-02T15:29:44.472 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-06-02T15:29:44.472 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000363824 s, 1.4 MB/s 2023-06-02T15:29:44.474 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-02T15:29:44.522 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2023-06-02T15:29:44.569 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-02T15:29:44.569 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-02T15:29:44.569 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-06-02T15:29:44.569 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-02T15:29:44.569 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-06-02 15:22:17.645948707 +0000 2023-06-02T15:29:44.569 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-06-02 15:22:17.285951923 +0000 2023-06-02T15:29:44.570 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-06-02 15:22:17.285951923 +0000 2023-06-02T15:29:44.570 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-06-02T15:29:44.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-02T15:29:44.623 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-06-02T15:29:44.623 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-06-02T15:29:44.623 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000412729 s, 1.2 MB/s 2023-06-02T15:29:44.624 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-02T15:29:44.675 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2023-06-02T15:29:44.721 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-02T15:29:44.721 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-02T15:29:44.721 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-06-02T15:29:44.721 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-02T15:29:44.721 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-06-02 15:22:18.209943669 +0000 2023-06-02T15:29:44.722 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-06-02 15:22:17.861946777 +0000 2023-06-02T15:29:44.722 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-06-02 15:22:17.861946777 +0000 2023-06-02T15:29:44.723 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2023-06-02T15:29:44.723 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-02T15:29:44.775 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-06-02T15:29:44.776 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-06-02T15:29:44.776 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000387598 s, 1.3 MB/s 2023-06-02T15:29:44.777 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-02T15:29:44.826 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-02T15:29:44.826 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:29:44.827 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2023-06-02T15:29:44.832 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-06-02T15:29:44.833 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2023-06-02T15:29:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-06-02T15:29:44.881 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-02T15:29:44.881 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 879 Links: 1 2023-06-02T15:29:44.882 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-02T15:29:44.882 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-06-02 15:22:16.625054235 +0000 2023-06-02T15:29:44.882 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-06-02 15:22:16.253057557 +0000 2023-06-02T15:29:44.882 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-06-02 15:22:16.253057557 +0000 2023-06-02T15:29:44.882 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2023-06-02T15:29:44.882 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-06-02T15:29:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-06-02T15:29:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-06-02T15:29:44.936 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000448777 s, 1.1 MB/s 2023-06-02T15:29:44.937 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-06-02T15:29:44.986 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2023-06-02T15:29:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-06-02T15:29:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-02T15:29:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 899 Links: 1 2023-06-02T15:29:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-02T15:29:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-06-02 15:22:17.201049090 +0000 2023-06-02T15:29:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-06-02 15:22:16.845052269 +0000 2023-06-02T15:29:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-06-02 15:22:16.845052269 +0000 2023-06-02T15:29:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2023-06-02T15:29:45.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-06-02T15:29:45.087 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-06-02T15:29:45.087 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-06-02T15:29:45.087 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.00035671 s, 1.4 MB/s 2023-06-02T15:29:45.088 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-06-02T15:29:45.138 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2023-06-02T15:29:45.184 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-06-02T15:29:45.185 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-02T15:29:45.185 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 919 Links: 1 2023-06-02T15:29:45.185 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-02T15:29:45.185 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-06-02 15:22:17.801043730 +0000 2023-06-02T15:29:45.185 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-06-02 15:22:17.429047052 +0000 2023-06-02T15:29:45.185 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-06-02 15:22:17.429047052 +0000 2023-06-02T15:29:45.185 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2023-06-02T15:29:45.186 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-06-02T15:29:45.238 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-06-02T15:29:45.238 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-06-02T15:29:45.239 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000330103 s, 1.6 MB/s 2023-06-02T15:29:45.239 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-06-02T15:29:45.288 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2023-06-02T15:29:45.333 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-06-02T15:29:45.333 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-06-02T15:29:45.333 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-06-02T15:29:45.333 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-06-02T15:29:45.333 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-06-02 15:22:18.017041801 +0000 2023-06-02T15:29:45.334 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-06-02 15:22:18.013041837 +0000 2023-06-02T15:29:45.334 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-06-02 15:22:18.013041837 +0000 2023-06-02T15:29:45.334 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2023-06-02T15:29:45.334 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-06-02T15:29:45.387 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-06-02T15:29:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-06-02T15:29:45.388 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000415155 s, 1.2 MB/s 2023-06-02T15:29:45.389 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-06-02T15:29:45.438 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-02T15:29:45.439 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-02T15:29:45.439 INFO:tasks.ceph:Generating config... 2023-06-02T15:29:45.441 INFO:tasks.ceph:[client] client mount timeout = 600 2023-06-02T15:29:45.442 INFO:tasks.ceph:[client] debug client = 20 2023-06-02T15:29:45.442 INFO:tasks.ceph:[client] debug ms = 1 2023-06-02T15:29:45.442 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-06-02T15:29:45.443 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-06-02T15:29:45.443 INFO:tasks.ceph:[mds] debug mds = 20 2023-06-02T15:29:45.443 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-06-02T15:29:45.443 INFO:tasks.ceph:[mds] debug ms = 1 2023-06-02T15:29:45.444 INFO:tasks.ceph:[mds] mds debug frag = True 2023-06-02T15:29:45.444 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-06-02T15:29:45.444 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-06-02T15:29:45.445 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-06-02T15:29:45.445 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-06-02T15:29:45.445 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-06-02T15:29:45.446 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-06-02T15:29:45.446 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-06-02T15:29:45.446 INFO:tasks.ceph:[mgr] debug ms = 1 2023-06-02T15:29:45.447 INFO:tasks.ceph:[mon] debug mon = 20 2023-06-02T15:29:45.447 INFO:tasks.ceph:[mon] debug ms = 1 2023-06-02T15:29:45.447 INFO:tasks.ceph:[mon] debug paxos = 20 2023-06-02T15:29:45.447 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-06-02T15:29:45.448 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-06-02T15:29:45.448 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2023-06-02T15:29:45.448 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-06-02T15:29:45.448 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-06-02T15:29:45.449 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-06-02T15:29:45.449 INFO:tasks.ceph:[osd] debug ms = 1 2023-06-02T15:29:45.449 INFO:tasks.ceph:[osd] debug osd = 20 2023-06-02T15:29:45.449 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-06-02T15:29:45.449 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-06-02T15:29:45.450 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-06-02T15:29:45.450 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-06-02T15:29:45.450 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-06-02T15:29:45.450 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-06-02T15:29:45.451 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-06-02T15:29:45.451 INFO:tasks.ceph:Setting up mon.a... 2023-06-02T15:29:45.451 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-06-02T15:29:45.484 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2023-06-02T15:29:45.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-06-02T15:29:45.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-02T15:29:45.632 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '172.21.15.132'), ('mon.c', '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]')] 2023-06-02T15:29:45.633 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-06-02T15:29:45.634 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:29:45.634 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-06-02T15:29:45.681 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --add b 172.21.15.132 --addv c '[v2:172.21.15.132:3301,v1:172.21.15.132:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:29:45.765 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:29:45.766 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid 9af8d860-9431-412c-b8a4-990228d6b597 2023-06-02T15:29:45.766 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = pacific 2023-06-02T15:29:45.766 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2023-06-02T15:29:45.767 INFO:teuthology.orchestra.run.smithi078.stdout:fsid 9af8d860-9431-412c-b8a4-990228d6b597 2023-06-02T15:29:45.767 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2023-06-02T15:29:45.762857+0000 2023-06-02T15:29:45.767 INFO:teuthology.orchestra.run.smithi078.stdout:created 2023-06-02T15:29:45.762857+0000 2023-06-02T15:29:45.768 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 16 (pacific) 2023-06-02T15:29:45.768 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2023-06-02T15:29:45.768 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2023-06-02T15:29:45.768 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.b 2023-06-02T15:29:45.769 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] mon.c 2023-06-02T15:29:45.769 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-06-02T15:29:45.770 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-06-02T15:29:45.817 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9af8d860-9431-412c-b8a4-990228d6b597... 2023-06-02T15:29:45.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-02T15:29:45.862 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-02T15:29:45.864 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-02T15:29:45.867 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-06-02T15:29:45.890 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2023-06-02T15:29:45.890 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2023-06-02T15:29:45.890 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-02T15:29:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2023-06-02T15:29:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2023-06-02T15:29:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2023-06-02T15:29:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.891 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2023-06-02T15:29:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2023-06-02T15:29:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2023-06-02T15:29:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2023-06-02T15:29:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-02T15:29:45.892 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2023-06-02T15:29:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2023-06-02T15:29:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-02T15:29:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.893 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2023-06-02T15:29:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2023-06-02T15:29:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2023-06-02T15:29:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2023-06-02T15:29:45.894 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2023-06-02T15:29:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2023-06-02T15:29:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2023-06-02T15:29:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2023-06-02T15:29:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-02T15:29:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-02T15:29:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2023-06-02T15:29:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.895 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-02T15:29:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2023-06-02T15:29:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2023-06-02T15:29:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2023-06-02T15:29:45.896 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2023-06-02T15:29:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2023-06-02T15:29:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2023-06-02T15:29:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 9af8d860-9431-412c-b8a4-990228d6b597 2023-06-02T15:29:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.897 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2023-06-02T15:29:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2023-06-02T15:29:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.897 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2023-06-02T15:29:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2023-06-02T15:29:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2023-06-02T15:29:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2023-06-02T15:29:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2023-06-02T15:29:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2023-06-02T15:29:45.898 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2023-06-02T15:29:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2023-06-02T15:29:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2023-06-02T15:29:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2023-06-02T15:29:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2023-06-02T15:29:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.899 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2023-06-02T15:29:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2023-06-02T15:29:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2023-06-02T15:29:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2023-06-02T15:29:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.900 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2023-06-02T15:29:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2023-06-02T15:29:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2023-06-02T15:29:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore compression mode = aggressive 2023-06-02T15:29:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2023-06-02T15:29:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 20 2023-06-02T15:29:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 20 2023-06-02T15:29:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-06-02T15:29:45.901 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2023-06-02T15:29:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 10 2023-06-02T15:29:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2023-06-02T15:29:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2023-06-02T15:29:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2023-06-02T15:29:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2023-06-02T15:29:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2023-06-02T15:29:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-06-02T15:29:45.902 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.903 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2023-06-02T15:29:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-06-02T15:29:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2023-06-02T15:29:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-06-02T15:29:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-06-02T15:29:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-06-02T15:29:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-06-02T15:29:45.903 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2023-06-02T15:29:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.904 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2023-06-02T15:29:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-06-02T15:29:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-06-02T15:29:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2023-06-02T15:29:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-06-02T15:29:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2023-06-02T15:29:45.904 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2023-06-02T15:29:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-06-02T15:29:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2023-06-02T15:29:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2023-06-02T15:29:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-06-02T15:29:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.905 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-02T15:29:45.906 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2023-06-02T15:29:45.906 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2023-06-02T15:29:45.906 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.906 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2023-06-02T15:29:45.906 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-02T15:29:45.906 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-02T15:29:45.906 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.907 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2023-06-02T15:29:45.907 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2023-06-02T15:29:45.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.907 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2023-06-02T15:29:45.907 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2023-06-02T15:29:45.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:29:45.907 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2023-06-02T15:29:45.907 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2023-06-02T15:29:45.908 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2023-06-02T15:29:45.908 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2023-06-02T15:29:45.908 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-02T15:29:45.908 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-02T15:29:45.908 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2023-06-02T15:29:45.908 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2023-06-02T15:29:45.908 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-06-02T15:29:45.909 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-06-02T15:29:45.909 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-06-02T15:29:45.909 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2023-06-02T15:29:45.909 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2023-06-02T15:29:45.909 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2023-06-02T15:29:45.909 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-06-02T15:29:45.909 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-06-02T15:29:45.909 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-06-02T15:29:45.910 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2023-06-02T15:29:45.910 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2023-06-02T15:29:45.910 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2023-06-02T15:29:45.910 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-06-02T15:29:45.910 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2023-06-02T15:29:45.910 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2023-06-02T15:29:45.910 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2023-06-02T15:29:45.910 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2023-06-02T15:29:45.911 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-06-02T15:29:45.911 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-06-02T15:29:45.911 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-06-02T15:29:45.913 INFO:teuthology.orchestra.run.smithi159.stdout:[global] 2023-06-02T15:29:45.913 INFO:teuthology.orchestra.run.smithi159.stdout: chdir = "" 2023-06-02T15:29:45.913 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-02T15:29:45.913 INFO:teuthology.orchestra.run.smithi159.stdout: auth supported = cephx 2023-06-02T15:29:45.914 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.914 INFO:teuthology.orchestra.run.smithi159.stdout: filestore xattr use omap = true 2023-06-02T15:29:45.914 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.914 INFO:teuthology.orchestra.run.smithi159.stdout: mon clock drift allowed = 1.000 2023-06-02T15:29:45.914 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.914 INFO:teuthology.orchestra.run.smithi159.stdout: osd crush chooseleaf type = 0 2023-06-02T15:29:45.914 INFO:teuthology.orchestra.run.smithi159.stdout: auth debug = true 2023-06-02T15:29:45.915 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.915 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on old message = true 2023-06-02T15:29:45.915 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on bug = true 2023-06-02T15:29:45.915 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.915 INFO:teuthology.orchestra.run.smithi159.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-02T15:29:45.915 INFO:teuthology.orchestra.run.smithi159.stdout: mon pg warn max object skew = 0 2023-06-02T15:29:45.915 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.916 INFO:teuthology.orchestra.run.smithi159.stdout: # disable pg_autoscaler by default for new pools 2023-06-02T15:29:45.916 INFO:teuthology.orchestra.run.smithi159.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-02T15:29:45.916 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.916 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default size = 2 2023-06-02T15:29:45.916 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.916 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow primary affinity = true 2023-06-02T15:29:45.916 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow pg remap = true 2023-06-02T15:29:45.916 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on legacy crush tunables = false 2023-06-02T15:29:45.917 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on crush straw calc version zero = false 2023-06-02T15:29:45.917 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on no sortbitwise = false 2023-06-02T15:29:45.917 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on osd down out interval zero = false 2023-06-02T15:29:45.917 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on too few osds = false 2023-06-02T15:29:45.917 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-02T15:29:45.917 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-02T15:29:45.917 INFO:teuthology.orchestra.run.smithi159.stdout: mon_allow_pool_size_one = true 2023-06-02T15:29:45.918 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.918 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-02T15:29:45.918 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.918 INFO:teuthology.orchestra.run.smithi159.stdout: osd default data pool replay window = 5 2023-06-02T15:29:45.918 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.918 INFO:teuthology.orchestra.run.smithi159.stdout: mon allow pool delete = true 2023-06-02T15:29:45.918 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.918 INFO:teuthology.orchestra.run.smithi159.stdout: mon cluster log file level = debug 2023-06-02T15:29:45.919 INFO:teuthology.orchestra.run.smithi159.stdout: debug asserts on shutdown = true 2023-06-02T15:29:45.919 INFO:teuthology.orchestra.run.smithi159.stdout: mon health detail to clog = false 2023-06-02T15:29:45.919 INFO:teuthology.orchestra.run.smithi159.stdout: mon host = "172.21.15.78,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2023-06-02T15:29:45.919 INFO:teuthology.orchestra.run.smithi159.stdout: fsid = 9af8d860-9431-412c-b8a4-990228d6b597 2023-06-02T15:29:45.919 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.919 INFO:teuthology.orchestra.run.smithi159.stdout:[osd] 2023-06-02T15:29:45.919 INFO:teuthology.orchestra.run.smithi159.stdout: osd journal size = 100 2023-06-02T15:29:45.919 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.920 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub load threshold = 5.0 2023-06-02T15:29:45.920 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub max interval = 600 2023-06-02T15:29:45.920 INFO:teuthology.orchestra.run.smithi159.stdout: osd mclock profile = high_recovery_ops 2023-06-02T15:29:45.920 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.920 INFO:teuthology.orchestra.run.smithi159.stdout: osd recover clone overlap = true 2023-06-02T15:29:45.920 INFO:teuthology.orchestra.run.smithi159.stdout: osd recovery max chunk = 1048576 2023-06-02T15:29:45.920 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.921 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug shutdown = true 2023-06-02T15:29:45.921 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug op order = true 2023-06-02T15:29:45.921 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug verify stray on activate = true 2023-06-02T15:29:45.921 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.921 INFO:teuthology.orchestra.run.smithi159.stdout: osd open classes on start = true 2023-06-02T15:29:45.921 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug pg log writeout = true 2023-06-02T15:29:45.921 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.921 INFO:teuthology.orchestra.run.smithi159.stdout: osd deep scrub update digest min age = 30 2023-06-02T15:29:45.922 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.922 INFO:teuthology.orchestra.run.smithi159.stdout: osd map max advance = 10 2023-06-02T15:29:45.922 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.922 INFO:teuthology.orchestra.run.smithi159.stdout: journal zero on create = true 2023-06-02T15:29:45.922 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.922 INFO:teuthology.orchestra.run.smithi159.stdout: filestore ondisk finisher threads = 3 2023-06-02T15:29:45.922 INFO:teuthology.orchestra.run.smithi159.stdout: filestore apply finisher threads = 3 2023-06-02T15:29:45.922 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.923 INFO:teuthology.orchestra.run.smithi159.stdout: bdev debug aio = true 2023-06-02T15:29:45.923 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug misdirected ops = true 2023-06-02T15:29:45.923 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore block size = 96636764160 2023-06-02T15:29:45.923 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore compression mode = aggressive 2023-06-02T15:29:45.923 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore fsck on mount = True 2023-06-02T15:29:45.923 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluefs = 20 2023-06-02T15:29:45.923 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluestore = 20 2023-06-02T15:29:45.923 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-06-02T15:29:45.924 INFO:teuthology.orchestra.run.smithi159.stdout: debug osd = 20 2023-06-02T15:29:45.924 INFO:teuthology.orchestra.run.smithi159.stdout: debug rocksdb = 10 2023-06-02T15:29:45.924 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd backfillfull_ratio = 0.85 2023-06-02T15:29:45.924 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd full ratio = 0.9 2023-06-02T15:29:45.924 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd nearfull ratio = 0.8 2023-06-02T15:29:45.924 INFO:teuthology.orchestra.run.smithi159.stdout: osd failsafe full ratio = 0.95 2023-06-02T15:29:45.924 INFO:teuthology.orchestra.run.smithi159.stdout: osd objectstore = bluestore 2023-06-02T15:29:45.924 INFO:teuthology.orchestra.run.smithi159.stdout: osd op complaint time = 180 2023-06-02T15:29:45.925 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.925 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr] 2023-06-02T15:29:45.925 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-06-02T15:29:45.925 INFO:teuthology.orchestra.run.smithi159.stdout: debug mgr = 20 2023-06-02T15:29:45.925 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2023-06-02T15:29:45.925 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2023-06-02T15:29:45.925 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2023-06-02T15:29:45.925 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2023-06-02T15:29:45.926 INFO:teuthology.orchestra.run.smithi159.stdout: mgr/telemetry/nag = false 2023-06-02T15:29:45.926 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.926 INFO:teuthology.orchestra.run.smithi159.stdout:[mon] 2023-06-02T15:29:45.926 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-06-02T15:29:45.926 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2023-06-02T15:29:45.926 INFO:teuthology.orchestra.run.smithi159.stdout: debug paxos = 20 2023-06-02T15:29:45.926 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2023-06-02T15:29:45.926 INFO:teuthology.orchestra.run.smithi159.stdout: mon data avail warn = 5 2023-06-02T15:29:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: mon mgr mkfs grace = 240 2023-06-02T15:29:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2023-06-02T15:29:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd reporter subtree level = osd 2023-06-02T15:29:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd prime pg temp = true 2023-06-02T15:29:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2023-06-02T15:29:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.927 INFO:teuthology.orchestra.run.smithi159.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-02T15:29:45.928 INFO:teuthology.orchestra.run.smithi159.stdout: auth mon ticket ttl = 660 # 11m 2023-06-02T15:29:45.928 INFO:teuthology.orchestra.run.smithi159.stdout: auth service ticket ttl = 240 # 4m 2023-06-02T15:29:45.928 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.928 INFO:teuthology.orchestra.run.smithi159.stdout: # don't complain about insecure global_id in the test suite 2023-06-02T15:29:45.928 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-02T15:29:45.928 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-02T15:29:45.928 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.928 INFO:teuthology.orchestra.run.smithi159.stdout: # 1m isn't quite enough 2023-06-02T15:29:45.929 INFO:teuthology.orchestra.run.smithi159.stdout: mon_down_mkfs_grace = 2m 2023-06-02T15:29:45.929 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.929 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_filestore_osds = false 2023-06-02T15:29:45.929 INFO:teuthology.orchestra.run.smithi159.stdout: mon op complaint time = 120 2023-06-02T15:29:45.929 INFO:teuthology.orchestra.run.smithi159.stdout: 2023-06-02T15:29:45.929 INFO:teuthology.orchestra.run.smithi159.stdout:[client] 2023-06-02T15:29:45.929 INFO:teuthology.orchestra.run.smithi159.stdout: rgw cache enabled = true 2023-06-02T15:29:45.929 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable ops log = true 2023-06-02T15:29:45.930 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable usage log = true 2023-06-02T15:29:45.930 INFO:teuthology.orchestra.run.smithi159.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-02T15:29:45.930 INFO:teuthology.orchestra.run.smithi159.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-02T15:29:45.930 INFO:teuthology.orchestra.run.smithi159.stdout: client mount timeout = 600 2023-06-02T15:29:45.930 INFO:teuthology.orchestra.run.smithi159.stdout: debug client = 20 2023-06-02T15:29:45.930 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-06-02T15:29:45.930 INFO:teuthology.orchestra.run.smithi159.stdout: rados mon op timeout = 900 2023-06-02T15:29:45.930 INFO:teuthology.orchestra.run.smithi159.stdout: rados osd op timeout = 900 2023-06-02T15:29:45.931 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.a] 2023-06-02T15:29:45.931 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.b] 2023-06-02T15:29:45.931 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.c] 2023-06-02T15:29:45.931 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2023-06-02T15:29:45.931 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2023-06-02T15:29:45.931 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2023-06-02T15:29:45.931 INFO:teuthology.orchestra.run.smithi159.stdout:[mds] 2023-06-02T15:29:45.932 INFO:teuthology.orchestra.run.smithi159.stdout: debug mds = 20 2023-06-02T15:29:45.932 INFO:teuthology.orchestra.run.smithi159.stdout: debug mds balancer = 20 2023-06-02T15:29:45.932 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2023-06-02T15:29:45.932 INFO:teuthology.orchestra.run.smithi159.stdout: mds debug frag = True 2023-06-02T15:29:45.932 INFO:teuthology.orchestra.run.smithi159.stdout: mds debug scatterstat = True 2023-06-02T15:29:45.932 INFO:teuthology.orchestra.run.smithi159.stdout: mds op complaint time = 180 2023-06-02T15:29:45.932 INFO:teuthology.orchestra.run.smithi159.stdout: mds verify scatter = True 2023-06-02T15:29:45.932 INFO:teuthology.orchestra.run.smithi159.stdout: osd op complaint time = 180 2023-06-02T15:29:45.933 INFO:teuthology.orchestra.run.smithi159.stdout: rados mon op timeout = 900 2023-06-02T15:29:45.933 INFO:teuthology.orchestra.run.smithi159.stdout: rados osd op timeout = 900 2023-06-02T15:29:45.933 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2023-06-02T15:29:45.933 INFO:teuthology.orchestra.run.smithi150.stdout: chdir = "" 2023-06-02T15:29:45.933 INFO:teuthology.orchestra.run.smithi150.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-02T15:29:45.933 INFO:teuthology.orchestra.run.smithi150.stdout: auth supported = cephx 2023-06-02T15:29:45.933 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.934 INFO:teuthology.orchestra.run.smithi150.stdout: filestore xattr use omap = true 2023-06-02T15:29:45.934 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.934 INFO:teuthology.orchestra.run.smithi150.stdout: mon clock drift allowed = 1.000 2023-06-02T15:29:45.934 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.934 INFO:teuthology.orchestra.run.smithi150.stdout: osd crush chooseleaf type = 0 2023-06-02T15:29:45.934 INFO:teuthology.orchestra.run.smithi150.stdout: auth debug = true 2023-06-02T15:29:45.934 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.934 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on old message = true 2023-06-02T15:29:45.935 INFO:teuthology.orchestra.run.smithi150.stdout: ms die on bug = true 2023-06-02T15:29:45.935 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.935 INFO:teuthology.orchestra.run.smithi150.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-02T15:29:45.935 INFO:teuthology.orchestra.run.smithi150.stdout: mon pg warn max object skew = 0 2023-06-02T15:29:45.935 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.935 INFO:teuthology.orchestra.run.smithi150.stdout: # disable pg_autoscaler by default for new pools 2023-06-02T15:29:45.935 INFO:teuthology.orchestra.run.smithi150.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-02T15:29:45.935 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.936 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default size = 2 2023-06-02T15:29:45.936 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.936 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow primary affinity = true 2023-06-02T15:29:45.936 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd allow pg remap = true 2023-06-02T15:29:45.936 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on legacy crush tunables = false 2023-06-02T15:29:45.936 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on crush straw calc version zero = false 2023-06-02T15:29:45.936 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on no sortbitwise = false 2023-06-02T15:29:45.937 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on osd down out interval zero = false 2023-06-02T15:29:45.937 INFO:teuthology.orchestra.run.smithi150.stdout: mon warn on too few osds = false 2023-06-02T15:29:45.937 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-02T15:29:45.937 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-02T15:29:45.937 INFO:teuthology.orchestra.run.smithi150.stdout: mon_allow_pool_size_one = true 2023-06-02T15:29:45.937 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.937 INFO:teuthology.orchestra.run.smithi150.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-02T15:29:45.937 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.938 INFO:teuthology.orchestra.run.smithi150.stdout: osd default data pool replay window = 5 2023-06-02T15:29:45.938 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.938 INFO:teuthology.orchestra.run.smithi150.stdout: mon allow pool delete = true 2023-06-02T15:29:45.938 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.938 INFO:teuthology.orchestra.run.smithi150.stdout: mon cluster log file level = debug 2023-06-02T15:29:45.938 INFO:teuthology.orchestra.run.smithi150.stdout: debug asserts on shutdown = true 2023-06-02T15:29:45.938 INFO:teuthology.orchestra.run.smithi150.stdout: mon health detail to clog = false 2023-06-02T15:29:45.938 INFO:teuthology.orchestra.run.smithi150.stdout: mon host = "172.21.15.78,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2023-06-02T15:29:45.938 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = 9af8d860-9431-412c-b8a4-990228d6b597 2023-06-02T15:29:45.939 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.939 INFO:teuthology.orchestra.run.smithi150.stdout:[osd] 2023-06-02T15:29:45.939 INFO:teuthology.orchestra.run.smithi150.stdout: osd journal size = 100 2023-06-02T15:29:45.939 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.939 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub load threshold = 5.0 2023-06-02T15:29:45.939 INFO:teuthology.orchestra.run.smithi150.stdout: osd scrub max interval = 600 2023-06-02T15:29:45.939 INFO:teuthology.orchestra.run.smithi150.stdout: osd mclock profile = high_recovery_ops 2023-06-02T15:29:45.940 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.940 INFO:teuthology.orchestra.run.smithi150.stdout: osd recover clone overlap = true 2023-06-02T15:29:45.940 INFO:teuthology.orchestra.run.smithi150.stdout: osd recovery max chunk = 1048576 2023-06-02T15:29:45.940 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.940 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug shutdown = true 2023-06-02T15:29:45.940 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug op order = true 2023-06-02T15:29:45.940 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug verify stray on activate = true 2023-06-02T15:29:45.940 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.941 INFO:teuthology.orchestra.run.smithi150.stdout: osd open classes on start = true 2023-06-02T15:29:45.941 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug pg log writeout = true 2023-06-02T15:29:45.941 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.941 INFO:teuthology.orchestra.run.smithi150.stdout: osd deep scrub update digest min age = 30 2023-06-02T15:29:45.941 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.941 INFO:teuthology.orchestra.run.smithi150.stdout: osd map max advance = 10 2023-06-02T15:29:45.941 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.941 INFO:teuthology.orchestra.run.smithi150.stdout: journal zero on create = true 2023-06-02T15:29:45.942 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.942 INFO:teuthology.orchestra.run.smithi150.stdout: filestore ondisk finisher threads = 3 2023-06-02T15:29:45.942 INFO:teuthology.orchestra.run.smithi150.stdout: filestore apply finisher threads = 3 2023-06-02T15:29:45.942 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.942 INFO:teuthology.orchestra.run.smithi150.stdout: bdev debug aio = true 2023-06-02T15:29:45.942 INFO:teuthology.orchestra.run.smithi150.stdout: osd debug misdirected ops = true 2023-06-02T15:29:45.942 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore block size = 96636764160 2023-06-02T15:29:45.942 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore compression mode = aggressive 2023-06-02T15:29:45.943 INFO:teuthology.orchestra.run.smithi150.stdout: bluestore fsck on mount = True 2023-06-02T15:29:45.943 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluefs = 20 2023-06-02T15:29:45.943 INFO:teuthology.orchestra.run.smithi150.stdout: debug bluestore = 20 2023-06-02T15:29:45.943 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-06-02T15:29:45.943 INFO:teuthology.orchestra.run.smithi150.stdout: debug osd = 20 2023-06-02T15:29:45.943 INFO:teuthology.orchestra.run.smithi150.stdout: debug rocksdb = 10 2023-06-02T15:29:45.943 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd backfillfull_ratio = 0.85 2023-06-02T15:29:45.943 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd full ratio = 0.9 2023-06-02T15:29:45.944 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd nearfull ratio = 0.8 2023-06-02T15:29:45.944 INFO:teuthology.orchestra.run.smithi150.stdout: osd failsafe full ratio = 0.95 2023-06-02T15:29:45.944 INFO:teuthology.orchestra.run.smithi150.stdout: osd objectstore = bluestore 2023-06-02T15:29:45.944 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2023-06-02T15:29:45.944 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.944 INFO:teuthology.orchestra.run.smithi150.stdout:[mgr] 2023-06-02T15:29:45.944 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-06-02T15:29:45.944 INFO:teuthology.orchestra.run.smithi150.stdout: debug mgr = 20 2023-06-02T15:29:45.945 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2023-06-02T15:29:45.945 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2023-06-02T15:29:45.945 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2023-06-02T15:29:45.945 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2023-06-02T15:29:45.945 INFO:teuthology.orchestra.run.smithi150.stdout: mgr/telemetry/nag = false 2023-06-02T15:29:45.945 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.945 INFO:teuthology.orchestra.run.smithi150.stdout:[mon] 2023-06-02T15:29:45.945 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-06-02T15:29:45.946 INFO:teuthology.orchestra.run.smithi150.stdout: debug mon = 20 2023-06-02T15:29:45.946 INFO:teuthology.orchestra.run.smithi150.stdout: debug paxos = 20 2023-06-02T15:29:45.946 INFO:teuthology.orchestra.run.smithi150.stdout: debug auth = 20 2023-06-02T15:29:45.946 INFO:teuthology.orchestra.run.smithi150.stdout: mon data avail warn = 5 2023-06-02T15:29:45.946 INFO:teuthology.orchestra.run.smithi150.stdout: mon mgr mkfs grace = 240 2023-06-02T15:29:45.946 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min pgs per osd = 4 2023-06-02T15:29:45.946 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd reporter subtree level = osd 2023-06-02T15:29:45.946 INFO:teuthology.orchestra.run.smithi150.stdout: mon osd prime pg temp = true 2023-06-02T15:29:45.947 INFO:teuthology.orchestra.run.smithi150.stdout: mon reweight min bytes per osd = 10 2023-06-02T15:29:45.947 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.947 INFO:teuthology.orchestra.run.smithi150.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-02T15:29:45.947 INFO:teuthology.orchestra.run.smithi150.stdout: auth mon ticket ttl = 660 # 11m 2023-06-02T15:29:45.947 INFO:teuthology.orchestra.run.smithi150.stdout: auth service ticket ttl = 240 # 4m 2023-06-02T15:29:45.947 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.947 INFO:teuthology.orchestra.run.smithi150.stdout: # don't complain about insecure global_id in the test suite 2023-06-02T15:29:45.947 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-02T15:29:45.948 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-02T15:29:45.948 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.948 INFO:teuthology.orchestra.run.smithi150.stdout: # 1m isn't quite enough 2023-06-02T15:29:45.948 INFO:teuthology.orchestra.run.smithi150.stdout: mon_down_mkfs_grace = 2m 2023-06-02T15:29:45.948 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.948 INFO:teuthology.orchestra.run.smithi150.stdout: mon_warn_on_filestore_osds = false 2023-06-02T15:29:45.948 INFO:teuthology.orchestra.run.smithi150.stdout: mon op complaint time = 120 2023-06-02T15:29:45.949 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:29:45.949 INFO:teuthology.orchestra.run.smithi150.stdout:[client] 2023-06-02T15:29:45.949 INFO:teuthology.orchestra.run.smithi150.stdout: rgw cache enabled = true 2023-06-02T15:29:45.949 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable ops log = true 2023-06-02T15:29:45.949 INFO:teuthology.orchestra.run.smithi150.stdout: rgw enable usage log = true 2023-06-02T15:29:45.949 INFO:teuthology.orchestra.run.smithi150.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-02T15:29:45.949 INFO:teuthology.orchestra.run.smithi150.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-02T15:29:45.949 INFO:teuthology.orchestra.run.smithi150.stdout: client mount timeout = 600 2023-06-02T15:29:45.950 INFO:teuthology.orchestra.run.smithi150.stdout: debug client = 20 2023-06-02T15:29:45.950 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-06-02T15:29:45.950 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2023-06-02T15:29:45.950 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2023-06-02T15:29:45.950 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.a] 2023-06-02T15:29:45.950 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.b] 2023-06-02T15:29:45.950 INFO:teuthology.orchestra.run.smithi150.stdout:[mon.c] 2023-06-02T15:29:45.950 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.a] 2023-06-02T15:29:45.951 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.c] 2023-06-02T15:29:45.951 INFO:teuthology.orchestra.run.smithi150.stdout:[mds.b] 2023-06-02T15:29:45.951 INFO:teuthology.orchestra.run.smithi150.stdout:[mds] 2023-06-02T15:29:45.951 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds = 20 2023-06-02T15:29:45.951 INFO:teuthology.orchestra.run.smithi150.stdout: debug mds balancer = 20 2023-06-02T15:29:45.951 INFO:teuthology.orchestra.run.smithi150.stdout: debug ms = 1 2023-06-02T15:29:45.951 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug frag = True 2023-06-02T15:29:45.951 INFO:teuthology.orchestra.run.smithi150.stdout: mds debug scatterstat = True 2023-06-02T15:29:45.951 INFO:teuthology.orchestra.run.smithi150.stdout: mds op complaint time = 180 2023-06-02T15:29:45.952 INFO:teuthology.orchestra.run.smithi150.stdout: mds verify scatter = True 2023-06-02T15:29:45.952 INFO:teuthology.orchestra.run.smithi150.stdout: osd op complaint time = 180 2023-06-02T15:29:45.952 INFO:teuthology.orchestra.run.smithi150.stdout: rados mon op timeout = 900 2023-06-02T15:29:45.952 INFO:teuthology.orchestra.run.smithi150.stdout: rados osd op timeout = 900 2023-06-02T15:29:45.952 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2023-06-02T15:29:45.952 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2023-06-02T15:29:45.952 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-06-02T15:29:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2023-06-02T15:29:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2023-06-02T15:29:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2023-06-02T15:29:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2023-06-02T15:29:45.953 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2023-06-02T15:29:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2023-06-02T15:29:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2023-06-02T15:29:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2023-06-02T15:29:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2023-06-02T15:29:45.954 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2023-06-02T15:29:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2023-06-02T15:29:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2023-06-02T15:29:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2023-06-02T15:29:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2023-06-02T15:29:45.955 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2023-06-02T15:29:45.956 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2023-06-02T15:29:45.956 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2023-06-02T15:29:45.956 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2023-06-02T15:29:45.956 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2023-06-02T15:29:45.956 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-06-02T15:29:45.956 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2023-06-02T15:29:45.956 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2023-06-02T15:29:45.956 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.957 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-06-02T15:29:45.957 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.957 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2023-06-02T15:29:45.957 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.957 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2023-06-02T15:29:45.957 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.957 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2023-06-02T15:29:45.957 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2023-06-02T15:29:45.958 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2023-06-02T15:29:45.958 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.78,172.21.15.132,[v2:172.21.15.132:3301,v1:172.21.15.132:6790]" 2023-06-02T15:29:45.958 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 9af8d860-9431-412c-b8a4-990228d6b597 2023-06-02T15:29:45.958 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.958 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2023-06-02T15:29:45.958 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2023-06-02T15:29:45.958 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.959 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2023-06-02T15:29:45.959 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2023-06-02T15:29:45.959 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2023-06-02T15:29:45.959 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.959 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2023-06-02T15:29:45.959 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2023-06-02T15:29:45.959 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.959 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2023-06-02T15:29:45.960 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2023-06-02T15:29:45.960 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2023-06-02T15:29:45.960 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.960 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2023-06-02T15:29:45.960 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2023-06-02T15:29:45.960 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.960 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2023-06-02T15:29:45.960 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.961 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2023-06-02T15:29:45.961 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.961 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2023-06-02T15:29:45.961 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.962 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2023-06-02T15:29:45.962 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2023-06-02T15:29:45.962 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.962 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2023-06-02T15:29:45.962 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2023-06-02T15:29:45.963 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2023-06-02T15:29:45.963 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore compression mode = aggressive 2023-06-02T15:29:45.963 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2023-06-02T15:29:45.963 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 20 2023-06-02T15:29:45.963 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 20 2023-06-02T15:29:45.963 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-06-02T15:29:45.963 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2023-06-02T15:29:45.963 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 10 2023-06-02T15:29:45.964 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2023-06-02T15:29:45.964 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2023-06-02T15:29:45.964 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2023-06-02T15:29:45.964 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2023-06-02T15:29:45.964 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2023-06-02T15:29:45.964 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-06-02T15:29:45.964 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.965 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2023-06-02T15:29:45.965 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-06-02T15:29:45.965 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2023-06-02T15:29:45.965 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-06-02T15:29:45.965 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-06-02T15:29:45.965 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-06-02T15:29:45.965 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-06-02T15:29:45.965 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2023-06-02T15:29:45.966 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.966 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2023-06-02T15:29:45.966 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-06-02T15:29:45.966 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-06-02T15:29:45.966 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2023-06-02T15:29:45.966 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-06-02T15:29:45.966 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2023-06-02T15:29:45.966 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2023-06-02T15:29:45.967 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-06-02T15:29:45.967 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2023-06-02T15:29:45.967 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2023-06-02T15:29:45.967 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-06-02T15:29:45.967 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.967 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-06-02T15:29:45.967 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2023-06-02T15:29:45.967 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2023-06-02T15:29:45.968 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.968 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2023-06-02T15:29:45.968 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-06-02T15:29:45.968 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-06-02T15:29:45.968 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.968 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2023-06-02T15:29:45.968 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2023-06-02T15:29:45.968 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.969 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2023-06-02T15:29:45.969 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2023-06-02T15:29:45.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-06-02T15:29:45.969 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2023-06-02T15:29:45.969 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2023-06-02T15:29:45.969 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2023-06-02T15:29:45.969 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2023-06-02T15:29:45.969 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-06-02T15:29:45.970 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-06-02T15:29:45.970 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2023-06-02T15:29:45.970 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2023-06-02T15:29:45.970 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-06-02T15:29:45.970 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-06-02T15:29:45.970 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-06-02T15:29:45.970 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2023-06-02T15:29:45.970 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2023-06-02T15:29:45.971 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2023-06-02T15:29:45.971 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-06-02T15:29:45.971 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-06-02T15:29:45.971 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-06-02T15:29:45.971 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2023-06-02T15:29:45.971 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2023-06-02T15:29:45.971 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2023-06-02T15:29:45.971 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-06-02T15:29:45.972 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2023-06-02T15:29:45.972 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2023-06-02T15:29:45.972 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2023-06-02T15:29:45.972 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2023-06-02T15:29:45.972 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-06-02T15:29:45.972 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-06-02T15:29:45.972 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-06-02T15:29:45.973 INFO:tasks.ceph:Creating admin key on mon.a... 2023-06-02T15:29:45.973 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-06-02T15:29:46.023 INFO:tasks.ceph:Copying monmap to all nodes... 2023-06-02T15:29:46.024 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:29:46.024 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-06-02T15:29:46.029 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:29:46.029 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-06-02T15:29:46.077 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:29:46.077 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:29:46.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-02T15:29:46.078 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-02T15:29:46.174 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:29:46.175 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:29:46.221 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:29:46.221 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:29:46.221 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-02T15:29:46.222 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-02T15:29:46.245 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:29:46.245 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:29:46.293 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi150.front.sepia.ceph.com 2023-06-02T15:29:46.293 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:29:46.293 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-02T15:29:46.293 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-02T15:29:46.317 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:29:46.318 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:29:46.370 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi159.front.sepia.ceph.com 2023-06-02T15:29:46.370 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:29:46.371 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.keyring 2023-06-02T15:29:46.371 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-06-02T15:29:46.395 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:29:46.396 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:29:46.441 INFO:tasks.ceph:Setting up mon nodes... 2023-06-02T15:29:46.442 INFO:tasks.ceph:Setting up mgr nodes... 2023-06-02T15:29:46.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-06-02T15:29:46.486 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-06-02T15:29:46.489 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-06-02T15:29:46.533 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-06-02T15:29:46.557 INFO:tasks.ceph:Setting up mds nodes... 2023-06-02T15:29:46.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-06-02T15:29:46.599 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-06-02T15:29:46.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-06-02T15:29:46.657 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-06-02T15:29:46.742 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-06-02T15:29:46.744 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-06-02T15:29:46.799 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-06-02T15:29:46.842 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-06-02T15:29:46.845 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-06-02T15:29:46.900 INFO:tasks.ceph_client:Setting up client nodes... 2023-06-02T15:29:46.901 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-06-02T15:29:46.938 INFO:teuthology.orchestra.run.smithi150.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-06-02T15:29:47.021 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-06-02T15:29:47.058 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-06-02T15:29:47.082 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-06-02T15:29:47.082 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-06-02T15:29:47.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-06-02T15:29:47.097 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-02T15:29:47.097 INFO:tasks.ceph:role: osd.0 2023-06-02T15:29:47.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:29:47.098 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-02T15:29:47.160 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-02T15:29:47.161 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-02T15:29:47.161 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-02T15:29:47.161 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-02T15:29:47.161 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-02T15:29:47.161 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-06-02T15:29:47.161 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-02T15:29:47.162 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-02T15:29:47.162 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-02T15:29:47.162 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-02T15:29:47.626 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-06-02T15:29:47.628 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-06-02T15:29:47.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-06-02T15:29:47.795 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-06-02T15:29:47.806 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-06-02T15:29:47.807 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:29:47.808 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-06-02T15:29:47.860 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-02T15:29:47.860 INFO:tasks.ceph:role: osd.1 2023-06-02T15:29:47.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:29:47.861 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-02T15:29:47.921 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-02T15:29:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-02T15:29:47.921 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-02T15:29:47.922 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-02T15:29:47.922 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-02T15:29:47.922 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-06-02T15:29:47.922 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-02T15:29:47.922 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-02T15:29:47.922 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-02T15:29:47.922 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-02T15:29:48.376 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-06-02T15:29:48.378 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-06-02T15:29:48.378 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-06-02T15:29:48.465 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-06-02T15:29:48.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:29:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-06-02T15:29:48.477 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-06-02T15:29:48.540 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-02T15:29:48.541 INFO:tasks.ceph:role: osd.2 2023-06-02T15:29:48.541 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:29:48.541 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-02T15:29:48.608 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-02T15:29:48.608 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-02T15:29:48.608 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-02T15:29:48.608 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-02T15:29:48.609 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-02T15:29:48.609 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-06-02T15:29:48.609 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-02T15:29:48.609 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-02T15:29:48.609 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-02T15:29:48.609 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-02T15:29:49.069 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-06-02T15:29:49.071 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-06-02T15:29:49.071 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-06-02T15:29:49.195 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-06-02T15:29:49.206 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-06-02T15:29:49.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:29:49.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-06-02T15:29:49.260 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-06-02T15:29:49.260 INFO:tasks.ceph:role: osd.3 2023-06-02T15:29:49.260 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:29:49.261 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-02T15:29:49.325 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-02T15:29:49.325 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-02T15:29:49.326 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-02T15:29:49.326 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-02T15:29:49.326 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-02T15:29:49.326 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-06-02T15:29:49.326 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-02T15:29:49.326 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-02T15:29:49.326 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-02T15:29:49.327 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-02T15:29:49.816 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-06-02T15:29:49.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-06-02T15:29:49.818 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-06-02T15:29:49.949 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-06-02T15:29:50.012 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-06-02T15:29:50.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:29:50.013 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:29:50.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:50.124+0000 7f2ac7480640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-06-02T15:29:50.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:50.124+0000 7f2ac7480640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-06-02T15:29:50.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:50.124+0000 7f2ac7480640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-02T15:29:50.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:50.124+0000 7f2ac7480640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-02T15:29:50.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:50.124+0000 7f2ac7480640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-06-02T15:29:50.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:50.128+0000 7f2ac7480640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-06-02T15:29:53.138 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-06-02T15:29:53.151 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:29:53.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:53.224+0000 7feca4ae0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-06-02T15:29:53.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:53.224+0000 7feca4ae0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-06-02T15:29:53.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:53.224+0000 7feca4ae0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-02T15:29:53.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:53.224+0000 7feca4ae0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-02T15:29:53.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:53.224+0000 7feca4ae0640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-06-02T15:29:53.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:53.228+0000 7feca4ae0640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-06-02T15:29:56.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-06-02T15:29:56.300 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:29:56.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:56.380+0000 7f6b4c666640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-06-02T15:29:56.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:56.384+0000 7f6b4c666640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-06-02T15:29:56.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:56.384+0000 7f6b4c666640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-02T15:29:56.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:56.384+0000 7f6b4c666640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-02T15:29:56.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:56.384+0000 7f6b4c666640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-06-02T15:29:56.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:56.384+0000 7f6b4c666640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-06-02T15:29:59.393 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-06-02T15:29:59.450 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:29:59.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:59.523+0000 7fc5d6b66640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-06-02T15:29:59.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:59.523+0000 7fc5d6b66640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-06-02T15:29:59.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:59.523+0000 7fc5d6b66640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-02T15:29:59.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:59.523+0000 7fc5d6b66640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-02T15:29:59.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:59.523+0000 7fc5d6b66640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-06-02T15:29:59.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:29:59.523+0000 7fc5d6b66640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-06-02T15:30:02.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-06-02T15:30:02.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-06-02T15:30:02.616 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-02T15:30:02.616 INFO:tasks.ceph:role: osd.4 2023-06-02T15:30:02.616 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:30:02.616 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-06-02T15:30:02.677 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-06-02T15:30:02.677 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-02T15:30:02.677 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-02T15:30:02.677 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-02T15:30:02.677 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-02T15:30:02.677 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-06-02T15:30:02.678 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-02T15:30:02.678 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-02T15:30:02.678 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-02T15:30:02.678 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-02T15:30:03.126 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-06-02T15:30:03.128 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-06-02T15:30:03.128 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-06-02T15:30:03.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-06-02T15:30:03.235 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2023-06-02T15:30:03.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:30:03.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-06-02T15:30:03.291 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-02T15:30:03.291 INFO:tasks.ceph:role: osd.5 2023-06-02T15:30:03.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:30:03.292 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-06-02T15:30:03.356 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-06-02T15:30:03.356 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-02T15:30:03.357 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-02T15:30:03.357 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-02T15:30:03.357 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-02T15:30:03.357 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-06-02T15:30:03.357 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-02T15:30:03.357 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-02T15:30:03.358 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-02T15:30:03.358 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-02T15:30:03.827 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-06-02T15:30:03.829 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-06-02T15:30:03.830 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-06-02T15:30:03.968 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-06-02T15:30:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2023-06-02T15:30:03.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:30:03.981 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-06-02T15:30:04.036 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-02T15:30:04.036 INFO:tasks.ceph:role: osd.6 2023-06-02T15:30:04.037 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:30:04.037 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-06-02T15:30:04.100 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-06-02T15:30:04.101 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-02T15:30:04.101 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-02T15:30:04.101 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-02T15:30:04.101 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-02T15:30:04.102 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-06-02T15:30:04.102 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-02T15:30:04.102 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-02T15:30:04.103 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-02T15:30:04.103 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-02T15:30:04.579 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-06-02T15:30:04.581 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-06-02T15:30:04.581 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-06-02T15:30:04.744 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-06-02T15:30:04.755 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2023-06-02T15:30:04.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:30:04.756 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-06-02T15:30:04.812 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-06-02T15:30:04.813 INFO:tasks.ceph:role: osd.7 2023-06-02T15:30:04.813 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:30:04.814 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-06-02T15:30:04.876 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-06-02T15:30:04.876 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-06-02T15:30:04.877 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-06-02T15:30:04.877 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-06-02T15:30:04.877 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-06-02T15:30:04.877 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-06-02T15:30:04.877 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-06-02T15:30:04.877 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-06-02T15:30:04.877 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-06-02T15:30:04.878 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-06-02T15:30:05.296 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-06-02T15:30:05.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-06-02T15:30:05.298 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-06-02T15:30:05.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-06-02T15:30:05.433 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: /sbin/restorecon: command not found 2023-06-02T15:30:05.434 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:30:05.434 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:30:05.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:05.534+0000 7f48cbeac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-06-02T15:30:05.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:05.538+0000 7f48cbeac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-06-02T15:30:05.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:05.538+0000 7f48cbeac640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-02T15:30:05.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:05.538+0000 7f48cbeac640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-02T15:30:05.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:05.538+0000 7f48cbeac640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-06-02T15:30:05.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:05.546+0000 7f48cbeac640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-06-02T15:30:08.561 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-06-02T15:30:08.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:30:08.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:08.646+0000 7f4eb7ee0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-06-02T15:30:08.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:08.646+0000 7f4eb7ee0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-06-02T15:30:08.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:08.646+0000 7f4eb7ee0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-02T15:30:08.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:08.646+0000 7f4eb7ee0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-02T15:30:08.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:08.646+0000 7f4eb7ee0640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-06-02T15:30:08.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:08.650+0000 7f4eb7ee0640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-06-02T15:30:11.671 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-06-02T15:30:11.725 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:30:11.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:11.798+0000 7f5c3de23640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-06-02T15:30:11.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:11.802+0000 7f5c3de23640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-06-02T15:30:11.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:11.802+0000 7f5c3de23640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-02T15:30:11.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:11.802+0000 7f5c3de23640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-02T15:30:11.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:11.802+0000 7f5c3de23640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-06-02T15:30:11.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:11.802+0000 7f5c3de23640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-06-02T15:30:14.107 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:30:14.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:30:14.112 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:30:14.115 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:30:14.828 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-06-02T15:30:14.841 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:30:14.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:14.918+0000 7fe13f105640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-06-02T15:30:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:14.918+0000 7fe13f105640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-06-02T15:30:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:14.918+0000 7fe13f105640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-02T15:30:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:14.918+0000 7fe13f105640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-02T15:30:14.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:14.918+0000 7fe13f105640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-06-02T15:30:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:14.922+0000 7fe13f105640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-06-02T15:30:17.939 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-06-02T15:30:17.992 INFO:tasks.ceph:Reading keys from all nodes... 2023-06-02T15:30:17.993 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:17.993 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-06-02T15:30:18.006 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:18.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-06-02T15:30:18.060 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:18.061 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-06-02T15:30:18.116 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:18.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-06-02T15:30:18.167 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:18.168 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-06-02T15:30:18.219 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:18.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-06-02T15:30:18.277 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:18.277 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-06-02T15:30:18.332 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:30:18.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-06-02T15:30:18.346 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:30:18.346 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-06-02T15:30:18.401 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:30:18.401 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-06-02T15:30:18.460 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:30:18.460 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-06-02T15:30:18.516 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:30:18.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-06-02T15:30:18.568 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:30:18.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-06-02T15:30:18.624 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:30:18.624 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-06-02T15:30:18.630 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:30:18.631 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-06-02T15:30:18.636 INFO:tasks.ceph:Adding keys to all mons... 2023-06-02T15:30:18.637 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-02T15:30:18.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2023-06-02T15:30:18.666 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2023-06-02T15:30:18.667 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDqCnpk7tDQHBAAJIeLORisR4XGhpTNNpVDdw== 2023-06-02T15:30:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-06-02T15:30:18.667 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDqCnpk6DWTIxAAiGR+ecYYNSUC0maucoGcwQ== 2023-06-02T15:30:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-06-02T15:30:18.667 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDqCnpk05IOLBAAWqjqGmbnM+BMwDJjvk9P7Q== 2023-06-02T15:30:18.667 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2023-06-02T15:30:18.667 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDuCnpkzpWmBxAA2oedcBNKmfgLuVwMeaDwOA== 2023-06-02T15:30:18.668 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2023-06-02T15:30:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDxCnpk8SqhDRAAYtvwPLBR7Y7EyoHV56oyyg== 2023-06-02T15:30:18.668 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2023-06-02T15:30:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQD0Cnpket/7FhAAERlo6rkvL4k+VPuVKtYztA== 2023-06-02T15:30:18.668 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2023-06-02T15:30:18.668 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQD3CnpkQFJ4HxAAQBCPpV2u66kwhrqDsuDSbg== 2023-06-02T15:30:18.668 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2023-06-02T15:30:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDqCnpkNNGoHxAA8oLgRvYLh7GQxdJl/d6fkA== 2023-06-02T15:30:18.669 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-06-02T15:30:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDqCnpkMTsXMhAAM8HbO08ak+mwhlmMG5VEnQ== 2023-06-02T15:30:18.669 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2023-06-02T15:30:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQD9CnpkkW1PIBAAABBeqIDNTf7/ziVhfcPRRg== 2023-06-02T15:30:18.669 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2023-06-02T15:30:18.669 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAAC3pkUBX1JhAAgdFunnp/SDzvI8L9DhCcdw== 2023-06-02T15:30:18.670 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2023-06-02T15:30:18.670 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQADC3pk1k0QMBAAIT5Ub1/FoNTh2Dm8QeJ69A== 2023-06-02T15:30:18.670 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2023-06-02T15:30:18.670 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQAGC3pkCB8qNxAAkZ1YPYOKtkyuxhsSNMr71w== 2023-06-02T15:30:18.670 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-06-02T15:30:18.670 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDqCnpk48rkNxAAjcTt7z0rjSEOTxWMD1ss/w== 2023-06-02T15:30:18.670 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2023-06-02T15:30:18.670 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDrCnpkRF1eAxAASMaj8K487MB/AUwEnJdeJQ== 2023-06-02T15:30:18.677 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2023-06-02T15:30:18.678 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDqCnpk7tDQHBAAJIeLORisR4XGhpTNNpVDdw== 2023-06-02T15:30:18.678 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-06-02T15:30:18.678 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDqCnpk6DWTIxAAiGR+ecYYNSUC0maucoGcwQ== 2023-06-02T15:30:18.678 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-06-02T15:30:18.678 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDqCnpk05IOLBAAWqjqGmbnM+BMwDJjvk9P7Q== 2023-06-02T15:30:18.678 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2023-06-02T15:30:18.679 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDuCnpkzpWmBxAA2oedcBNKmfgLuVwMeaDwOA== 2023-06-02T15:30:18.679 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2023-06-02T15:30:18.679 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDxCnpk8SqhDRAAYtvwPLBR7Y7EyoHV56oyyg== 2023-06-02T15:30:18.679 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2023-06-02T15:30:18.679 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD0Cnpket/7FhAAERlo6rkvL4k+VPuVKtYztA== 2023-06-02T15:30:18.679 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2023-06-02T15:30:18.679 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD3CnpkQFJ4HxAAQBCPpV2u66kwhrqDsuDSbg== 2023-06-02T15:30:18.680 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2023-06-02T15:30:18.680 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDqCnpkNNGoHxAA8oLgRvYLh7GQxdJl/d6fkA== 2023-06-02T15:30:18.680 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-06-02T15:30:18.680 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDqCnpkMTsXMhAAM8HbO08ak+mwhlmMG5VEnQ== 2023-06-02T15:30:18.680 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2023-06-02T15:30:18.680 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD9CnpkkW1PIBAAABBeqIDNTf7/ziVhfcPRRg== 2023-06-02T15:30:18.680 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2023-06-02T15:30:18.681 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAAC3pkUBX1JhAAgdFunnp/SDzvI8L9DhCcdw== 2023-06-02T15:30:18.681 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2023-06-02T15:30:18.681 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQADC3pk1k0QMBAAIT5Ub1/FoNTh2Dm8QeJ69A== 2023-06-02T15:30:18.681 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2023-06-02T15:30:18.681 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAGC3pkCB8qNxAAkZ1YPYOKtkyuxhsSNMr71w== 2023-06-02T15:30:18.681 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2023-06-02T15:30:18.681 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDqCnpk48rkNxAAjcTt7z0rjSEOTxWMD1ss/w== 2023-06-02T15:30:18.681 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2023-06-02T15:30:18.682 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDrCnpkRF1eAxAASMaj8K487MB/AUwEnJdeJQ== 2023-06-02T15:30:18.682 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-02T15:30:18.714 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-02T15:30:18.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-02T15:30:18.802 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-02T15:30:18.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-02T15:30:18.859 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-02T15:30:18.901 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:18.942 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:18.981 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.065 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.182 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-02T15:30:19.266 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-06-02T15:30:19.307 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-02T15:30:19.346 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-06-02T15:30:19.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.553 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.594 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.674 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-06-02T15:30:19.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-02T15:30:19.754 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-02T15:30:19.804 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-02T15:30:19.838 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-06-02T15:30:19.880 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-06-02T15:30:19.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-06-02T15:30:19.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-02T15:30:20.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-06-02T15:30:20.039 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-06-02T15:30:20.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-02T15:30:20.155 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-06-02T15:30:20.165 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-06-02T15:30:20.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-06-02T15:30:20.314 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-06-02T15:30:20.324 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:30:20.326 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-06-02T15:30:20.372 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-06-02T15:30:20.372 INFO:tasks.ceph.mon.a:Restarting daemon 2023-06-02T15:30:20.373 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-06-02T15:30:20.375 INFO:tasks.ceph.mon.a:Started 2023-06-02T15:30:20.375 INFO:tasks.ceph.mon.b:Restarting daemon 2023-06-02T15:30:20.375 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-06-02T15:30:20.413 INFO:tasks.ceph.mon.b:Started 2023-06-02T15:30:20.414 INFO:tasks.ceph.mon.c:Restarting daemon 2023-06-02T15:30:20.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-06-02T15:30:20.416 INFO:tasks.ceph.mon.c:Started 2023-06-02T15:30:20.416 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-06-02T15:30:20.416 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-06-02T15:30:20.416 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-06-02T15:30:20.419 INFO:tasks.ceph.mgr.y:Started 2023-06-02T15:30:20.419 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-06-02T15:30:20.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-06-02T15:30:20.421 INFO:tasks.ceph.mgr.x:Started 2023-06-02T15:30:20.421 INFO:tasks.ceph:Setting crush tunables to default 2023-06-02T15:30:20.421 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2023-06-02T15:30:20.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c293f7640 1 Processor -- start 2023-06-02T15:30:20.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c293f7640 1 -- start start 2023-06-02T15:30:20.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c293f7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 0x7f2c240c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:20.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c293f7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2414bfe0 con 0x7f2c240c2c20 2023-06-02T15:30:20.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c293f7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2406e820 con 0x7f2c2406f0e0 2023-06-02T15:30:20.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c293f7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c24071a10 con 0x7f2c2414bc10 2023-06-02T15:30:20.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c227fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2c240c2c20 0x7f2c240a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45610/0 (socket says 172.21.15.78:45610) 2023-06-02T15:30:20.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c227fc640 1 -- 172.21.15.78:0/2885423016 learned_addr learned my addr 172.21.15.78:0/2885423016 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:20.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c22ffd640 1 --2- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 0x7f2c240c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:20.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c22ffd640 1 -- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 msgr2=0x7f2c240c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-02T15:30:20.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c22ffd640 1 -- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 msgr2=0x7f2c240c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-02T15:30:20.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c22ffd640 1 --2- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 0x7f2c240c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-02T15:30:20.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.527+0000 7f2c22ffd640 1 --2- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 0x7f2c240c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-06-02T15:30:20.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.731+0000 7f2c22ffd640 1 --2- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 0x7f2c240c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:20.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.731+0000 7f2c22ffd640 1 -- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 msgr2=0x7f2c240c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-06-02T15:30:20.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.731+0000 7f2c22ffd640 1 -- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 msgr2=0x7f2c240c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-06-02T15:30:20.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.731+0000 7f2c22ffd640 1 --2- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 0x7f2c240c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-06-02T15:30:20.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.731+0000 7f2c22ffd640 1 --2- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 0x7f2c240c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-06-02T15:30:20.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216876847 0 0) 0x7f2c14001120 con 0x7f2c240c2c20 2023-06-02T15:30:20.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c0c003530 con 0x7f2c240c2c20 2023-06-02T15:30:20.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1359131052 0 0) 0x7f2c0c003530 con 0x7f2c240c2c20 2023-06-02T15:30:20.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 msgr2=0x7f2c240c26e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-02T15:30:20.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 --2- 172.21.15.78:0/2885423016 >> v2:172.21.15.132:3300/0 conn(0x7f2c2414bc10 0x7f2c240c26e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:20.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 >> v1:172.21.15.132:6789/0 conn(0x7f2c2406f0e0 legacy=0x7f2c24158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:20.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2406e640 con 0x7f2c240c2c20 2023-06-02T15:30:20.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f2c14001810 con 0x7f2c240c2c20 2023-06-02T15:30:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 >> v1:172.21.15.78:6789/0 conn(0x7f2c240c2c20 legacy=0x7f2c240a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c0c003a40 0x7f2c0c003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c0047d0 0x7f2c0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c0c0052a0 0x7f2c0c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c00c130 con 0x7f2c0c0047d0 2023-06-02T15:30:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c00c2a0 con 0x7f2c0c003a40 2023-06-02T15:30:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c0c00c460 con 0x7f2c0c0052a0 2023-06-02T15:30:20.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c227fc640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c0047d0 0x7f2c0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:20.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c237fe640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c0c0052a0 0x7f2c0c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:20.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.787+0000 7f2c22ffd640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c0c003a40 0x7f2c0c003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:20.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.791+0000 7f2c227fc640 1 -- 172.21.15.78:0/2885423016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c0c0052a0 msgr2=0x7f2c0c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:20.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.791+0000 7f2c227fc640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c0c0052a0 0x7f2c0c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:20.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.791+0000 7f2c227fc640 1 -- 172.21.15.78:0/2885423016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c0c003a40 msgr2=0x7f2c0c003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:20.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.791+0000 7f2c227fc640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c0c003a40 0x7f2c0c003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:20.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.791+0000 7f2c227fc640 1 -- 172.21.15.78:0/2885423016 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c003530 con 0x7f2c0c0047d0 2023-06-02T15:30:20.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.791+0000 7f2c22ffd640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c0c003a40 0x7f2c0c003e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:20.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.791+0000 7f2c237fe640 1 -- 172.21.15.78:0/2885423016 reap_dead start 2023-06-02T15:30:20.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.795+0000 7f2c227fc640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c0047d0 0x7f2c0c004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c14007fd0 tx=0x7f2c1401f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5add24376d764258 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.799+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140a8e90 con 0x7f2c0c0047d0 2023-06-02T15:30:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.799+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c140058e0 con 0x7f2c0c0047d0 2023-06-02T15:30:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.799+0000 7f2c21ffb640 1 -- 172.21.15.78:0/2885423016 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14005cf0 con 0x7f2c0c0047d0 2023-06-02T15:30:20.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.803+0000 7f2c293f7640 1 -- 172.21.15.78:0/2885423016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c0047d0 msgr2=0x7f2c0c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:20.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.803+0000 7f2c293f7640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c0047d0 0x7f2c0c004c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2c14007fd0 tx=0x7f2c1401f270 comp rx=0 tx=0).stop 2023-06-02T15:30:20.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.803+0000 7f2c293f7640 1 -- 172.21.15.78:0/2885423016 shutdown_connections 2023-06-02T15:30:20.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.803+0000 7f2c293f7640 1 --2- 172.21.15.78:0/2885423016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c0c0047d0 0x7f2c0c004c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:20.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.803+0000 7f2c293f7640 1 -- 172.21.15.78:0/2885423016 >> 172.21.15.78:0/2885423016 conn(0x7f2c240a5730 msgr2=0x7f2c240a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:20.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.803+0000 7f2c293f7640 1 -- 172.21.15.78:0/2885423016 shutdown_connections 2023-06-02T15:30:20.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.803+0000 7f2c293f7640 1 -- 172.21.15.78:0/2885423016 wait complete. 2023-06-02T15:30:20.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c293f7640 1 Processor -- start 2023-06-02T15:30:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c293f7640 1 -- start start 2023-06-02T15:30:20.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c293f7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c0c0047d0 0x7f2c2414aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:20.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c293f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2414f090 0x7f2c241404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:20.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c293f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c24140a30 0x7f2c241e6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:20.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c293f7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240bf310 con 0x7f2c2414f090 2023-06-02T15:30:20.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c293f7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c241e11f0 con 0x7f2c24140a30 2023-06-02T15:30:20.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c293f7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c240be4e0 con 0x7f2c0c0047d0 2023-06-02T15:30:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c227fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2414f090 0x7f2c241404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c22ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c0c0047d0 0x7f2c2414aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c227fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2414f090 0x7f2c241404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44606/0 (socket says 172.21.15.78:44606) 2023-06-02T15:30:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c227fc640 1 -- 172.21.15.78:0/825508317 learned_addr learned my addr 172.21.15.78:0/825508317 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c237fe640 1 --2- 172.21.15.78:0/825508317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c24140a30 0x7f2c241e6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:20.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c227fc640 1 -- 172.21.15.78:0/825508317 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c0c0047d0 msgr2=0x7f2c2414aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c227fc640 1 --2- 172.21.15.78:0/825508317 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c0c0047d0 0x7f2c2414aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c227fc640 1 -- 172.21.15.78:0/825508317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c24140a30 msgr2=0x7f2c241e6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c227fc640 1 --2- 172.21.15.78:0/825508317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c24140a30 0x7f2c241e6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c227fc640 1 -- 172.21.15.78:0/825508317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c240714f0 con 0x7f2c2414f090 2023-06-02T15:30:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.807+0000 7f2c227fc640 1 --2- 172.21.15.78:0/825508317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2414f090 0x7f2c241404f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400c1a0 tx=0x7f2c0c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.811+0000 7f2c0b7fe640 1 -- 172.21.15.78:0/825508317 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140b6070 con 0x7f2c2414f090 2023-06-02T15:30:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.811+0000 7f2c0b7fe640 1 -- 172.21.15.78:0/825508317 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c14005a50 con 0x7f2c2414f090 2023-06-02T15:30:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.811+0000 7f2c293f7640 1 -- 172.21.15.78:0/825508317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c2406e360 con 0x7f2c2414f090 2023-06-02T15:30:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.811+0000 7f2c0b7fe640 1 -- 172.21.15.78:0/825508317 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14005dc0 con 0x7f2c2414f090 2023-06-02T15:30:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.811+0000 7f2c293f7640 1 -- 172.21.15.78:0/825508317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2406ee20 con 0x7f2c2414f090 2023-06-02T15:30:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.811+0000 7f2c0b7fe640 1 -- 172.21.15.78:0/825508317 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2c140047f0 con 0x7f2c2414f090 2023-06-02T15:30:20.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.811+0000 7f2c0b7fe640 1 -- 172.21.15.78:0/825508317 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2c14007030 con 0x7f2c2414f090 2023-06-02T15:30:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.811+0000 7f2c293f7640 1 -- 172.21.15.78:0/825508317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c2414b430 con 0x7f2c2414f090 2023-06-02T15:30:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.815+0000 7f2c0b7fe640 1 -- 172.21.15.78:0/825508317 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f2c2414bfe0 con 0x7f2c2414f090 2023-06-02T15:30:20.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.879+0000 7f2c293f7640 1 -- 172.21.15.78:0/825508317 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2c24073bc0 con 0x7f2c2414f090 2023-06-02T15:30:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.883+0000 7f2c0b7fe640 1 -- 172.21.15.78:0/825508317 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2c14004c30 con 0x7f2c2414f090 2023-06-02T15:30:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2023-06-02T15:30:20.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.883+0000 7f2c293f7640 1 -- 172.21.15.78:0/825508317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2414f090 msgr2=0x7f2c241404f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:20.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.883+0000 7f2c293f7640 1 --2- 172.21.15.78:0/825508317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2414f090 0x7f2c241404f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400c1a0 tx=0x7f2c0c005800 comp rx=0 tx=0).stop 2023-06-02T15:30:20.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.883+0000 7f2c293f7640 1 -- 172.21.15.78:0/825508317 shutdown_connections 2023-06-02T15:30:20.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.883+0000 7f2c293f7640 1 --2- 172.21.15.78:0/825508317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c24140a30 0x7f2c241e6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:20.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.883+0000 7f2c293f7640 1 --2- 172.21.15.78:0/825508317 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c2414f090 0x7f2c241404f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:20.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.883+0000 7f2c293f7640 1 --2- 172.21.15.78:0/825508317 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2c0c0047d0 0x7f2c2414aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:20.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.883+0000 7f2c293f7640 1 -- 172.21.15.78:0/825508317 >> 172.21.15.78:0/825508317 conn(0x7f2c240a5730 msgr2=0x7f2c24141d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:20.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.887+0000 7f2c293f7640 1 -- 172.21.15.78:0/825508317 shutdown_connections 2023-06-02T15:30:20.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:20.887+0000 7f2c293f7640 1 -- 172.21.15.78:0/825508317 wait complete. 2023-06-02T15:30:20.912 INFO:tasks.ceph:check_enable_crimson: False 2023-06-02T15:30:20.913 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-06-02T15:30:20.913 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:20.913 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-06-02T15:30:20.925 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:20.925 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-06-02T15:30:20.983 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:20.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-06-02T15:30:21.016 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:21.007+0000 7f82f2bd6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-02T15:30:21.027 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-06-02T15:30:21.027 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-06-02T15:30:21.042 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:21.034+0000 7f13fdd62180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-06-02T15:30:21.080 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:30:21.080 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-06-02T15:30:21.094 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:30:21.094 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-06-02T15:30:21.147 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:30:21.148 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-06-02T15:30:21.203 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-06-02T15:30:21.203 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-06-02T15:30:21.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 81de9701-ff04-401f-a4d6-385203d117fd 0 2023-06-02T15:30:21.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd92e4f3640 1 Processor -- start 2023-06-02T15:30:21.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd92e4f3640 1 -- start start 2023-06-02T15:30:21.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd92e4f3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd92814d020 0x7fd928071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd92e4f3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9280bc870 con 0x7fd9280a66a0 2023-06-02T15:30:21.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd92e4f3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd928071990 con 0x7fd928071be0 2023-06-02T15:30:21.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd92e4f3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9281505d0 con 0x7fd92814d020 2023-06-02T15:30:21.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd92ca90640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd928071be0 0x7fd9280c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42094/0 (socket says 172.21.15.132:42094) 2023-06-02T15:30:21.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd92ca90640 1 -- 172.21.15.132:0/546715612 learned_addr learned my addr 172.21.15.132:0/546715612 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-06-02T15:30:21.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd927fff640 1 --2- 172.21.15.132:0/546715612 >> v2:172.21.15.78:3300/0 conn(0x7fd92814d020 0x7fd928071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687846336 0 0) 0x7fd928071990 con 0x7fd928071be0 2023-06-02T15:30:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd914003530 con 0x7fd928071be0 2023-06-02T15:30:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 447627667 0 0) 0x7fd914003530 con 0x7fd928071be0 2023-06-02T15:30:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 >> v2:172.21.15.78:3300/0 conn(0x7fd92814d020 msgr2=0x7fd928071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 --2- 172.21.15.132:0/546715612 >> v2:172.21.15.78:3300/0 conn(0x7fd92814d020 0x7fd928071450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 >> v1:172.21.15.78:6789/0 conn(0x7fd9280a66a0 legacy=0x7fd9280a6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92814d3f0 con 0x7fd928071be0 2023-06-02T15:30:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fd920001a00 con 0x7fd928071be0 2023-06-02T15:30:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 >> v1:172.21.15.132:6789/0 conn(0x7fd928071be0 legacy=0x7fd9280c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140039f0 0x7fd914003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140047d0 0x7fd914004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9140051f0 0x7fd91400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9281505d0 con 0x7fd9140039f0 2023-06-02T15:30:21.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91400c130 con 0x7fd9140047d0 2023-06-02T15:30:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91400c2f0 con 0x7fd9140051f0 2023-06-02T15:30:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd927fff640 1 --2- 172.21.15.132:0/546715612 >> v2:172.21.15.78:3300/0 conn(0x7fd92814d020 0x7fd928071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd9277fe640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140047d0 0x7fd914004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd92ca90640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9140051f0 0x7fd91400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd927fff640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140039f0 0x7fd914003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd9277fe640 1 -- 172.21.15.132:0/546715612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9140051f0 msgr2=0x7fd91400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:21.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd9277fe640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd9140051f0 0x7fd91400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd9277fe640 1 -- 172.21.15.132:0/546715612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140039f0 msgr2=0x7fd914003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:21.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd9277fe640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140039f0 0x7fd914003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd9277fe640 1 -- 172.21.15.132:0/546715612 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd914003530 con 0x7fd9140047d0 2023-06-02T15:30:21.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.410+0000 7fd92ca90640 1 -- 172.21.15.132:0/546715612 reap_dead start 2023-06-02T15:30:21.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd9277fe640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140047d0 0x7fd914004c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd918001780 tx=0x7fd91801c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffe6cb4212bda15a server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:21.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9180a4ea0 con 0x7fd9140047d0 2023-06-02T15:30:21.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9180a7050 con 0x7fd9140047d0 2023-06-02T15:30:21.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd926ffd640 1 -- 172.21.15.132:0/546715612 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd918003600 con 0x7fd9140047d0 2023-06-02T15:30:21.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd92e4f3640 1 -- 172.21.15.132:0/546715612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140047d0 msgr2=0x7fd914004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd92e4f3640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140047d0 0x7fd914004c40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fd918001780 tx=0x7fd91801c3e0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd92e4f3640 1 -- 172.21.15.132:0/546715612 shutdown_connections 2023-06-02T15:30:21.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd92e4f3640 1 --2- 172.21.15.132:0/546715612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140047d0 0x7fd914004c40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd92e4f3640 1 -- 172.21.15.132:0/546715612 >> 172.21.15.132:0/546715612 conn(0x7fd9280a5730 msgr2=0x7fd9280a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:21.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd92e4f3640 1 -- 172.21.15.132:0/546715612 shutdown_connections 2023-06-02T15:30:21.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd92e4f3640 1 -- 172.21.15.132:0/546715612 wait complete. 2023-06-02T15:30:21.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd92e4f3640 1 Processor -- start 2023-06-02T15:30:21.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.414+0000 7fd92e4f3640 1 -- start start 2023-06-02T15:30:21.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92e4f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140047d0 0x7fd9281e5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92e4f3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd92814d690 0x7fd9281dbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92e4f3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd928147ab0 0x7fd9280c0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92e4f3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92814e0e0 con 0x7fd9140047d0 2023-06-02T15:30:21.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92e4f3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9280c1e10 con 0x7fd928147ab0 2023-06-02T15:30:21.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92e4f3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9281e5b60 con 0x7fd92814d690 2023-06-02T15:30:21.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92ca90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd928147ab0 0x7fd9280c0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd9277fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd92814d690 0x7fd9281dbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92ca90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd928147ab0 0x7fd9280c0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40382/0 (socket says 172.21.15.132:40382) 2023-06-02T15:30:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92ca90640 1 -- 172.21.15.132:0/2955556338 learned_addr learned my addr 172.21.15.132:0/2955556338 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd927fff640 1 --2- 172.21.15.132:0/2955556338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140047d0 0x7fd9281e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92ca90640 1 -- 172.21.15.132:0/2955556338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd92814d690 msgr2=0x7fd9281dbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92ca90640 1 --2- 172.21.15.132:0/2955556338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd92814d690 0x7fd9281dbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92ca90640 1 -- 172.21.15.132:0/2955556338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140047d0 msgr2=0x7fd9281e5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92ca90640 1 --2- 172.21.15.132:0/2955556338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140047d0 0x7fd9281e5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92ca90640 1 -- 172.21.15.132:0/2955556338 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9280a6e20 con 0x7fd928147ab0 2023-06-02T15:30:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd9277fe640 1 --2- 172.21.15.132:0/2955556338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd92814d690 0x7fd9281dbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92ca90640 1 --2- 172.21.15.132:0/2955556338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd928147ab0 0x7fd9280c0550 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd92806f000 tx=0x7fd920007800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd924ff9640 1 -- 172.21.15.132:0/2955556338 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd920007b20 con 0x7fd928147ab0 2023-06-02T15:30:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd924ff9640 1 -- 172.21.15.132:0/2955556338 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd920012560 con 0x7fd928147ab0 2023-06-02T15:30:21.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92e4f3640 1 -- 172.21.15.132:0/2955556338 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9280a6c90 con 0x7fd928147ab0 2023-06-02T15:30:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd924ff9640 1 -- 172.21.15.132:0/2955556338 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9200128f0 con 0x7fd928147ab0 2023-06-02T15:30:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92e4f3640 1 -- 172.21.15.132:0/2955556338 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9280a6fb0 con 0x7fd928147ab0 2023-06-02T15:30:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd924ff9640 1 -- 172.21.15.132:0/2955556338 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd920012d50 con 0x7fd928147ab0 2023-06-02T15:30:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd924ff9640 1 -- 172.21.15.132:0/2955556338 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd9200133f0 con 0x7fd928147ab0 2023-06-02T15:30:21.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.418+0000 7fd92e4f3640 1 -- 172.21.15.132:0/2955556338 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9281dcc50 con 0x7fd928147ab0 2023-06-02T15:30:21.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.434+0000 7fd924ff9640 1 -- 172.21.15.132:0/2955556338 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fd92001d4b0 con 0x7fd928147ab0 2023-06-02T15:30:21.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.498+0000 7fd92e4f3640 1 -- 172.21.15.132:0/2955556338 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "81de9701-ff04-401f-a4d6-385203d117fd", "id": 0} v 0) v1 -- 0x7fd928073bc0 con 0x7fd928147ab0 2023-06-02T15:30:21.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.510+0000 7fd924ff9640 1 -- 172.21.15.132:0/2955556338 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "81de9701-ff04-401f-a4d6-385203d117fd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd92001d720 con 0x7fd928147ab0 2023-06-02T15:30:21.517 INFO:teuthology.orchestra.run.smithi132.stdout:0 2023-06-02T15:30:21.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.510+0000 7fd92e4f3640 1 -- 172.21.15.132:0/2955556338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd928147ab0 msgr2=0x7fd9280c0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.510+0000 7fd92e4f3640 1 --2- 172.21.15.132:0/2955556338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd928147ab0 0x7fd9280c0550 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd92806f000 tx=0x7fd920007800 comp rx=0 tx=0).stop 2023-06-02T15:30:21.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.510+0000 7fd92e4f3640 1 -- 172.21.15.132:0/2955556338 shutdown_connections 2023-06-02T15:30:21.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.510+0000 7fd92e4f3640 1 --2- 172.21.15.132:0/2955556338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd928147ab0 0x7fd9280c0550 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.510+0000 7fd92e4f3640 1 --2- 172.21.15.132:0/2955556338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd92814d690 0x7fd9281dbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.510+0000 7fd92e4f3640 1 --2- 172.21.15.132:0/2955556338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140047d0 0x7fd9281e5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.510+0000 7fd92e4f3640 1 -- 172.21.15.132:0/2955556338 >> 172.21.15.132:0/2955556338 conn(0x7fd9280a5730 msgr2=0x7fd92814c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:21.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.510+0000 7fd92e4f3640 1 -- 172.21.15.132:0/2955556338 shutdown_connections 2023-06-02T15:30:21.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.510+0000 7fd92e4f3640 1 -- 172.21.15.132:0/2955556338 wait complete. 2023-06-02T15:30:21.528 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:21.523+0000 7f82f2bd6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-02T15:30:21.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 81c04070-19f3-4cc4-9ee0-46ac7d200b49 1 2023-06-02T15:30:21.592 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:21.586+0000 7f13fdd62180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-06-02T15:30:21.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.646+0000 7f6e8aaff640 1 Processor -- start 2023-06-02T15:30:21.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.646+0000 7f6e8aaff640 1 -- start start 2023-06-02T15:30:21.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.646+0000 7f6e8aaff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e8414d020 0x7f6e84071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.646+0000 7f6e8aaff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e840a66a0 0x7f6e840a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.646+0000 7f6e8aaff640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e840bc870 con 0x7f6e84071be0 2023-06-02T15:30:21.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.646+0000 7f6e8aaff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e84071990 con 0x7f6e840a66a0 2023-06-02T15:30:21.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.646+0000 7f6e8aaff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e841505d0 con 0x7f6e8414d020 2023-06-02T15:30:21.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.646+0000 7f6e8889b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e8414d020 0x7f6e84071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.646+0000 7f6e8889b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e8414d020 0x7f6e84071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:57504/0 (socket says 172.21.15.132:57504) 2023-06-02T15:30:21.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.646+0000 7f6e8889b640 1 -- 172.21.15.132:0/4145708157 learned_addr learned my addr 172.21.15.132:0/4145708157 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:21.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e83fff640 1 --2- 172.21.15.132:0/4145708157 >> v2:172.21.15.132:3300/0 conn(0x7f6e840a66a0 0x7f6e840a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8889b640 1 -- 172.21.15.132:0/4145708157 >> v2:172.21.15.132:3300/0 conn(0x7f6e840a66a0 msgr2=0x7f6e840a6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:21.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8889b640 1 --2- 172.21.15.132:0/4145708157 >> v2:172.21.15.132:3300/0 conn(0x7f6e840a66a0 0x7f6e840a6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8889b640 1 -- 172.21.15.132:0/4145708157 >> v1:172.21.15.78:6789/0 conn(0x7f6e84071be0 legacy=0x7f6e840c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:21.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8889b640 1 -- 172.21.15.132:0/4145708157 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8414d3f0 con 0x7f6e8414d020 2023-06-02T15:30:21.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8889b640 1 --2- 172.21.15.132:0/4145708157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e8414d020 0x7f6e84071450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0098a0 tx=0x7f6e7c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ffa8e14f52440b6 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:21.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e837fe640 1 -- 172.21.15.132:0/4145708157 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0ac410 con 0x7f6e8414d020 2023-06-02T15:30:21.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e837fe640 1 -- 172.21.15.132:0/4145708157 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0ac570 con 0x7f6e8414d020 2023-06-02T15:30:21.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e837fe640 1 -- 172.21.15.132:0/4145708157 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0ac900 con 0x7f6e8414d020 2023-06-02T15:30:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8aaff640 1 -- 172.21.15.132:0/4145708157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e8414d020 msgr2=0x7f6e84071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8aaff640 1 --2- 172.21.15.132:0/4145708157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e8414d020 0x7f6e84071450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0098a0 tx=0x7f6e7c01c4e0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8aaff640 1 -- 172.21.15.132:0/4145708157 shutdown_connections 2023-06-02T15:30:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8aaff640 1 --2- 172.21.15.132:0/4145708157 >> v2:172.21.15.132:3300/0 conn(0x7f6e840a66a0 0x7f6e840a6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8aaff640 1 --2- 172.21.15.132:0/4145708157 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e8414d020 0x7f6e84071450 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8aaff640 1 -- 172.21.15.132:0/4145708157 >> 172.21.15.132:0/4145708157 conn(0x7f6e840a5730 msgr2=0x7f6e840a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:21.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8aaff640 1 -- 172.21.15.132:0/4145708157 shutdown_connections 2023-06-02T15:30:21.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.650+0000 7f6e8aaff640 1 -- 172.21.15.132:0/4145708157 wait complete. 2023-06-02T15:30:21.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 Processor -- start 2023-06-02T15:30:21.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 -- start start 2023-06-02T15:30:21.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e84071be0 0x7f6e84144b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e840a66a0 0x7f6e840beaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e8414d020 0x7f6e84148d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840b8cb0 con 0x7f6e8414d020 2023-06-02T15:30:21.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e841e84d0 con 0x7f6e84071be0 2023-06-02T15:30:21.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e840bf030 con 0x7f6e840a66a0 2023-06-02T15:30:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8889b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e84071be0 0x7f6e84144b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8889b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e84071be0 0x7f6e84144b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40404/0 (socket says 172.21.15.132:40404) 2023-06-02T15:30:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e83fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e840a66a0 0x7f6e840beaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8889b640 1 -- 172.21.15.132:0/3450742607 learned_addr learned my addr 172.21.15.132:0/3450742607 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8909c640 1 --2- 172.21.15.132:0/3450742607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e8414d020 0x7f6e84148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8889b640 1 -- 172.21.15.132:0/3450742607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e840a66a0 msgr2=0x7f6e840beaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8889b640 1 --2- 172.21.15.132:0/3450742607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e840a66a0 0x7f6e840beaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8889b640 1 -- 172.21.15.132:0/3450742607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e8414d020 msgr2=0x7f6e84148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8889b640 1 --2- 172.21.15.132:0/3450742607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e8414d020 0x7f6e84148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8889b640 1 -- 172.21.15.132:0/3450742607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c0094d0 con 0x7f6e84071be0 2023-06-02T15:30:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8909c640 1 --2- 172.21.15.132:0/3450742607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e8414d020 0x7f6e84148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e83fff640 1 --2- 172.21.15.132:0/3450742607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e840a66a0 0x7f6e840beaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8889b640 1 --2- 172.21.15.132:0/3450742607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e84071be0 0x7f6e84144b30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0af040 tx=0x7f6e7c019280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e817fa640 1 -- 172.21.15.132:0/3450742607 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0ac410 con 0x7f6e84071be0 2023-06-02T15:30:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e817fa640 1 -- 172.21.15.132:0/3450742607 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7c0b65f0 con 0x7f6e84071be0 2023-06-02T15:30:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 -- 172.21.15.132:0/3450742607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e84159590 con 0x7f6e84071be0 2023-06-02T15:30:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e817fa640 1 -- 172.21.15.132:0/3450742607 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7c0b69a0 con 0x7f6e84071be0 2023-06-02T15:30:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 -- 172.21.15.132:0/3450742607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e840c2df0 con 0x7f6e84071be0 2023-06-02T15:30:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e817fa640 1 -- 172.21.15.132:0/3450742607 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6e7c0b7480 con 0x7f6e84071be0 2023-06-02T15:30:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e817fa640 1 -- 172.21.15.132:0/3450742607 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6e7c0c1810 con 0x7f6e84071be0 2023-06-02T15:30:21.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.654+0000 7f6e8aaff640 1 -- 172.21.15.132:0/3450742607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e84159720 con 0x7f6e84071be0 2023-06-02T15:30:21.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.658+0000 7f6e817fa640 1 -- 172.21.15.132:0/3450742607 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f6e7c0b1070 con 0x7f6e84071be0 2023-06-02T15:30:21.700 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:21.691+0000 7f82f2bd6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-02T15:30:21.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.722+0000 7f6e8aaff640 1 -- 172.21.15.132:0/3450742607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "81c04070-19f3-4cc4-9ee0-46ac7d200b49", "id": 1} v 0) v1 -- 0x7f6e84073bc0 con 0x7f6e84071be0 2023-06-02T15:30:21.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.730+0000 7f6e817fa640 1 -- 172.21.15.132:0/3450742607 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "81c04070-19f3-4cc4-9ee0-46ac7d200b49", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6e7c0c19d0 con 0x7f6e84071be0 2023-06-02T15:30:21.740 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-06-02T15:30:21.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.734+0000 7f6e8aaff640 1 -- 172.21.15.132:0/3450742607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e84071be0 msgr2=0x7f6e84144b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.734+0000 7f6e8aaff640 1 --2- 172.21.15.132:0/3450742607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e84071be0 0x7f6e84144b30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c0af040 tx=0x7f6e7c019280 comp rx=0 tx=0).stop 2023-06-02T15:30:21.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.734+0000 7f6e8aaff640 1 -- 172.21.15.132:0/3450742607 shutdown_connections 2023-06-02T15:30:21.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.734+0000 7f6e8aaff640 1 --2- 172.21.15.132:0/3450742607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6e8414d020 0x7f6e84148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.734+0000 7f6e8aaff640 1 --2- 172.21.15.132:0/3450742607 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6e840a66a0 0x7f6e840beaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.734+0000 7f6e8aaff640 1 --2- 172.21.15.132:0/3450742607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e84071be0 0x7f6e84144b30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.734+0000 7f6e8aaff640 1 -- 172.21.15.132:0/3450742607 >> 172.21.15.132:0/3450742607 conn(0x7f6e840a5730 msgr2=0x7f6e841561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:21.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.734+0000 7f6e8aaff640 1 -- 172.21.15.132:0/3450742607 shutdown_connections 2023-06-02T15:30:21.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.734+0000 7f6e8aaff640 1 -- 172.21.15.132:0/3450742607 wait complete. 2023-06-02T15:30:21.756 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 2a1911f4-0f97-4074-b1a2-1ad2b9698c8f 2 2023-06-02T15:30:21.777 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:21.770+0000 7f13fdd62180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-06-02T15:30:21.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.862+0000 7f8c68623640 1 Processor -- start 2023-06-02T15:30:21.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.862+0000 7f8c68623640 1 -- start start 2023-06-02T15:30:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600be620 0x7f8c600be9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c600c0ad0 con 0x7f8c6006d100 2023-06-02T15:30:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c600bf4e0 con 0x7f8c600a2ca0 2023-06-02T15:30:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600c0d20 con 0x7f8c600be620 2023-06-02T15:30:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c663bf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600be620 0x7f8c600be9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c65bbe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8c600a2ca0 0x7f8c6014e8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42096/0 (socket says 172.21.15.132:42096) 2023-06-02T15:30:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c65bbe640 1 -- 172.21.15.132:0/2820414327 learned_addr learned my addr 172.21.15.132:0/2820414327 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-06-02T15:30:21.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c653bd640 1 -- 172.21.15.132:0/2820414327 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187277870 0 0) 0x7f8c600bf4e0 con 0x7f8c600a2ca0 2023-06-02T15:30:21.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c663bf640 1 -- 172.21.15.132:0/2820414327 >> v1:172.21.15.132:6789/0 conn(0x7f8c600a2ca0 legacy=0x7f8c6014e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c663bf640 1 -- 172.21.15.132:0/2820414327 >> v1:172.21.15.78:6789/0 conn(0x7f8c6006d100 legacy=0x7f8c6006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:21.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c663bf640 1 -- 172.21.15.132:0/2820414327 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6014bdf0 con 0x7f8c600be620 2023-06-02T15:30:21.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c663bf640 1 --2- 172.21.15.132:0/2820414327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600be620 0x7f8c600be9f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0097f0 tx=0x7f8c5c01c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=807117c47fdcbb98 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:21.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c653bd640 1 -- 172.21.15.132:0/2820414327 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0ab600 con 0x7f8c600be620 2023-06-02T15:30:21.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c653bd640 1 -- 172.21.15.132:0/2820414327 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c0a7050 con 0x7f8c600be620 2023-06-02T15:30:21.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c653bd640 1 -- 172.21.15.132:0/2820414327 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c0ab980 con 0x7f8c600be620 2023-06-02T15:30:21.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 -- 172.21.15.132:0/2820414327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600be620 msgr2=0x7f8c600be9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 --2- 172.21.15.132:0/2820414327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600be620 0x7f8c600be9f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c0097f0 tx=0x7f8c5c01c330 comp rx=0 tx=0).stop 2023-06-02T15:30:21.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 -- 172.21.15.132:0/2820414327 shutdown_connections 2023-06-02T15:30:21.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 --2- 172.21.15.132:0/2820414327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600be620 0x7f8c600be9f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 -- 172.21.15.132:0/2820414327 >> 172.21.15.132:0/2820414327 conn(0x7f8c600a3180 msgr2=0x7f8c600a3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:21.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 -- 172.21.15.132:0/2820414327 shutdown_connections 2023-06-02T15:30:21.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.866+0000 7f8c68623640 1 -- 172.21.15.132:0/2820414327 wait complete. 2023-06-02T15:30:21.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 Processor -- start 2023-06-02T15:30:21.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 -- start start 2023-06-02T15:30:21.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6006d100 0x7f8c6014d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600a2ca0 0x7f8c601e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c600be620 0x7f8c601e82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:21.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c601e7eb0 con 0x7f8c6006d100 2023-06-02T15:30:21.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c60146c50 con 0x7f8c600be620 2023-06-02T15:30:21.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c600a7050 con 0x7f8c600a2ca0 2023-06-02T15:30:21.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c65bbe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600a2ca0 0x7f8c601e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c66bc0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c600be620 0x7f8c601e82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c65bbe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600a2ca0 0x7f8c601e4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:57522/0 (socket says 172.21.15.132:57522) 2023-06-02T15:30:21.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c65bbe640 1 -- 172.21.15.132:0/2167899423 learned_addr learned my addr 172.21.15.132:0/2167899423 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:21.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c663bf640 1 --2- 172.21.15.132:0/2167899423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6006d100 0x7f8c6014d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:21.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c66bc0640 1 -- 172.21.15.132:0/2167899423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600a2ca0 msgr2=0x7f8c601e4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c66bc0640 1 --2- 172.21.15.132:0/2167899423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600a2ca0 0x7f8c601e4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c66bc0640 1 -- 172.21.15.132:0/2167899423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6006d100 msgr2=0x7f8c6014d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c66bc0640 1 --2- 172.21.15.132:0/2167899423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6006d100 0x7f8c6014d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c66bc0640 1 -- 172.21.15.132:0/2167899423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5c009420 con 0x7f8c600be620 2023-06-02T15:30:21.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c65bbe640 1 --2- 172.21.15.132:0/2167899423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600a2ca0 0x7f8c601e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:21.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c663bf640 1 --2- 172.21.15.132:0/2167899423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6006d100 0x7f8c6014d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:21.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c66bc0640 1 --2- 172.21.15.132:0/2167899423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c600be620 0x7f8c601e82d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800be00 tx=0x7f8c5800bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:21.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c56ffd640 1 -- 172.21.15.132:0/2167899423 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5800ce70 con 0x7f8c600be620 2023-06-02T15:30:21.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c56ffd640 1 -- 172.21.15.132:0/2167899423 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c58003980 con 0x7f8c600be620 2023-06-02T15:30:21.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 -- 172.21.15.132:0/2167899423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c6014efd0 con 0x7f8c600be620 2023-06-02T15:30:21.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c56ffd640 1 -- 172.21.15.132:0/2167899423 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c58003d30 con 0x7f8c600be620 2023-06-02T15:30:21.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 -- 172.21.15.132:0/2167899423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c6014f660 con 0x7f8c600be620 2023-06-02T15:30:21.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c56ffd640 1 -- 172.21.15.132:0/2167899423 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8c580041b0 con 0x7f8c600be620 2023-06-02T15:30:21.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c56ffd640 1 -- 172.21.15.132:0/2167899423 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f8c58014d10 con 0x7f8c600be620 2023-06-02T15:30:21.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.870+0000 7f8c68623640 1 -- 172.21.15.132:0/2167899423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6014f160 con 0x7f8c600be620 2023-06-02T15:30:21.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.874+0000 7f8c56ffd640 1 -- 172.21.15.132:0/2167899423 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f8c58022060 con 0x7f8c600be620 2023-06-02T15:30:21.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.942+0000 7f8c68623640 1 -- 172.21.15.132:0/2167899423 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2a1911f4-0f97-4074-b1a2-1ad2b9698c8f", "id": 2} v 0) v1 -- 0x7f8c601e7ff0 con 0x7f8c600be620 2023-06-02T15:30:21.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.950+0000 7f8c56ffd640 1 -- 172.21.15.132:0/2167899423 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2a1911f4-0f97-4074-b1a2-1ad2b9698c8f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8c601e7ff0 con 0x7f8c600be620 2023-06-02T15:30:21.960 INFO:teuthology.orchestra.run.smithi132.stdout:2 2023-06-02T15:30:21.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.954+0000 7f8c68623640 1 -- 172.21.15.132:0/2167899423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c600be620 msgr2=0x7f8c601e82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:21.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.954+0000 7f8c68623640 1 --2- 172.21.15.132:0/2167899423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c600be620 0x7f8c601e82d0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800be00 tx=0x7f8c5800bef0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.954+0000 7f8c68623640 1 -- 172.21.15.132:0/2167899423 shutdown_connections 2023-06-02T15:30:21.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.954+0000 7f8c68623640 1 --2- 172.21.15.132:0/2167899423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c600be620 0x7f8c601e82d0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.954+0000 7f8c68623640 1 --2- 172.21.15.132:0/2167899423 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8c600a2ca0 0x7f8c601e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.954+0000 7f8c68623640 1 --2- 172.21.15.132:0/2167899423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8c6006d100 0x7f8c6014d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.954+0000 7f8c68623640 1 -- 172.21.15.132:0/2167899423 >> 172.21.15.132:0/2167899423 conn(0x7f8c600a3180 msgr2=0x7f8c60069aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.954+0000 7f8c68623640 1 -- 172.21.15.132:0/2167899423 shutdown_connections 2023-06-02T15:30:21.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:21.954+0000 7f8c68623640 1 -- 172.21.15.132:0/2167899423 wait complete. 2023-06-02T15:30:21.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new c7b07679-693b-4ac9-84ff-71af0d08b77a 3 2023-06-02T15:30:22.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.126+0000 7f723cb3d640 1 Processor -- start 2023-06-02T15:30:22.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.126+0000 7f723cb3d640 1 -- start start 2023-06-02T15:30:22.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72380bab00 0x7f72380bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f723806a200 con 0x7f72380bb650 2023-06-02T15:30:22.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7238069c40 con 0x7f72380c2110 2023-06-02T15:30:22.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723814e7e0 con 0x7f72380bab00 2023-06-02T15:30:22.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f7236d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72380bab00 0x7f72380bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f7236d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72380bab00 0x7f72380bd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:57530/0 (socket says 172.21.15.132:57530) 2023-06-02T15:30:22.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f7236d9d640 1 -- 172.21.15.132:0/1795630312 learned_addr learned my addr 172.21.15.132:0/1795630312 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:22.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f7235d9b640 1 --1- 172.21.15.132:0/1795630312 >> v1:172.21.15.132:6789/0 conn(0x7f72380c2110 0x7f723814ec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42098/0 (socket says 172.21.15.132:42098) 2023-06-02T15:30:22.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f7236d9d640 1 -- 172.21.15.132:0/1795630312 >> v1:172.21.15.132:6789/0 conn(0x7f72380c2110 legacy=0x7f723814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723559a640 1 -- 172.21.15.132:0/1795630312 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474760798 0 0) 0x7f7238069c40 con 0x7f72380c2110 2023-06-02T15:30:22.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f7236d9d640 1 -- 172.21.15.132:0/1795630312 >> v1:172.21.15.78:6789/0 conn(0x7f72380bb650 legacy=0x7f72380c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:22.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f7236d9d640 1 -- 172.21.15.132:0/1795630312 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7238069f20 con 0x7f72380bab00 2023-06-02T15:30:22.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f7236d9d640 1 --2- 172.21.15.132:0/1795630312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72380bab00 0x7f72380bd560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7230009e80 tx=0x7f723001c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75bcc650a20e45c8 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:22.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723559a640 1 -- 172.21.15.132:0/1795630312 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72300a58e0 con 0x7f72380bab00 2023-06-02T15:30:22.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723559a640 1 -- 172.21.15.132:0/1795630312 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72300a5a40 con 0x7f72380bab00 2023-06-02T15:30:22.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723559a640 1 -- 172.21.15.132:0/1795630312 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72300a5dd0 con 0x7f72380bab00 2023-06-02T15:30:22.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 -- 172.21.15.132:0/1795630312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72380bab00 msgr2=0x7f72380bd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 --2- 172.21.15.132:0/1795630312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72380bab00 0x7f72380bd560 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7230009e80 tx=0x7f723001c9f0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 -- 172.21.15.132:0/1795630312 shutdown_connections 2023-06-02T15:30:22.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 --2- 172.21.15.132:0/1795630312 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f72380bab00 0x7f72380bd560 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 -- 172.21.15.132:0/1795630312 >> 172.21.15.132:0/1795630312 conn(0x7f72380a3280 msgr2=0x7f72380a3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:22.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 -- 172.21.15.132:0/1795630312 shutdown_connections 2023-06-02T15:30:22.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.130+0000 7f723cb3d640 1 -- 172.21.15.132:0/1795630312 wait complete. 2023-06-02T15:30:22.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 Processor -- start 2023-06-02T15:30:22.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 -- start start 2023-06-02T15:30:22.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72380bb650 0x7f72381eaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72380c2110 0x7f7238144a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7238143e40 0x7f7238145870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238144f60 con 0x7f72380c2110 2023-06-02T15:30:22.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7238142840 con 0x7f72380bb650 2023-06-02T15:30:22.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723806dae0 con 0x7f7238143e40 2023-06-02T15:30:22.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72380bb650 0x7f72381eaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f7236d9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7238143e40 0x7f7238145870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72380bb650 0x7f72381eaaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40418/0 (socket says 172.21.15.132:40418) 2023-06-02T15:30:22.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723659c640 1 -- 172.21.15.132:0/1854252337 learned_addr learned my addr 172.21.15.132:0/1854252337 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:22.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f7235d9b640 1 --2- 172.21.15.132:0/1854252337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72380c2110 0x7f7238144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723659c640 1 -- 172.21.15.132:0/1854252337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7238143e40 msgr2=0x7f7238145870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723659c640 1 --2- 172.21.15.132:0/1854252337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7238143e40 0x7f7238145870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723659c640 1 -- 172.21.15.132:0/1854252337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72380c2110 msgr2=0x7f7238144a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723659c640 1 --2- 172.21.15.132:0/1854252337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72380c2110 0x7f7238144a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723659c640 1 -- 172.21.15.132:0/1854252337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7230009b30 con 0x7f72380bb650 2023-06-02T15:30:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f7236d9d640 1 --2- 172.21.15.132:0/1854252337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7238143e40 0x7f7238145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f7235d9b640 1 --2- 172.21.15.132:0/1854252337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72380c2110 0x7f7238144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723659c640 1 --2- 172.21.15.132:0/1854252337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72380bb650 0x7f72381eaaa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f722800c450 tx=0x7f722800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f7226ffd640 1 -- 172.21.15.132:0/1854252337 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228012830 con 0x7f72380bb650 2023-06-02T15:30:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f7226ffd640 1 -- 172.21.15.132:0/1854252337 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72280129b0 con 0x7f72380bb650 2023-06-02T15:30:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 -- 172.21.15.132:0/1854252337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f723815c910 con 0x7f72380bb650 2023-06-02T15:30:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f7226ffd640 1 -- 172.21.15.132:0/1854252337 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7228012d60 con 0x7f72380bb650 2023-06-02T15:30:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 -- 172.21.15.132:0/1854252337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f723815c780 con 0x7f72380bb650 2023-06-02T15:30:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f7226ffd640 1 -- 172.21.15.132:0/1854252337 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f722801c760 con 0x7f72380bb650 2023-06-02T15:30:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f723cb3d640 1 -- 172.21.15.132:0/1854252337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723815caa0 con 0x7f72380bb650 2023-06-02T15:30:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.134+0000 7f7226ffd640 1 -- 172.21.15.132:0/1854252337 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f722801bb20 con 0x7f72380bb650 2023-06-02T15:30:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.138+0000 7f7226ffd640 1 -- 172.21.15.132:0/1854252337 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f722801b690 con 0x7f72380bb650 2023-06-02T15:30:22.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.206+0000 7f723cb3d640 1 -- 172.21.15.132:0/1854252337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c7b07679-693b-4ac9-84ff-71af0d08b77a", "id": 3} v 0) v1 -- 0x7f72381e6a90 con 0x7f72380bb650 2023-06-02T15:30:22.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.214+0000 7f7226ffd640 1 -- 172.21.15.132:0/1854252337 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c7b07679-693b-4ac9-84ff-71af0d08b77a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f722801b930 con 0x7f72380bb650 2023-06-02T15:30:22.223 INFO:teuthology.orchestra.run.smithi132.stdout:3 2023-06-02T15:30:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.214+0000 7f723cb3d640 1 -- 172.21.15.132:0/1854252337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72380bb650 msgr2=0x7f72381eaaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.214+0000 7f723cb3d640 1 --2- 172.21.15.132:0/1854252337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72380bb650 0x7f72381eaaa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f722800c450 tx=0x7f722800c910 comp rx=0 tx=0).stop 2023-06-02T15:30:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.214+0000 7f723cb3d640 1 -- 172.21.15.132:0/1854252337 shutdown_connections 2023-06-02T15:30:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.214+0000 7f723cb3d640 1 --2- 172.21.15.132:0/1854252337 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7238143e40 0x7f7238145870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.214+0000 7f723cb3d640 1 --2- 172.21.15.132:0/1854252337 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f72380c2110 0x7f7238144a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.214+0000 7f723cb3d640 1 --2- 172.21.15.132:0/1854252337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72380bb650 0x7f72381eaaa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.214+0000 7f723cb3d640 1 -- 172.21.15.132:0/1854252337 >> 172.21.15.132:0/1854252337 conn(0x7f72380a3280 msgr2=0x7f72380a3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.214+0000 7f723cb3d640 1 -- 172.21.15.132:0/1854252337 shutdown_connections 2023-06-02T15:30:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.214+0000 7f723cb3d640 1 -- 172.21.15.132:0/1854252337 wait complete. 2023-06-02T15:30:22.239 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new fc9bae87-5c32-44b2-af2a-619f0a0339c9 4 2023-06-02T15:30:22.253 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:22.247+0000 7f82f2bd6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-02T15:30:22.307 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:22.299+0000 7f82f2bd6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-02T15:30:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd786bad640 1 Processor -- start 2023-06-02T15:30:22.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd786bad640 1 -- start start 2023-06-02T15:30:22.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd786bad640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd780151f90 0x7fd7800c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd786bad640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7800aa5b0 0x7fd780158e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd786bad640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7800c0a50 con 0x7fd78006bd60 2023-06-02T15:30:22.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd786bad640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd780152360 con 0x7fd7800aa5b0 2023-06-02T15:30:22.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd786bad640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd780152620 con 0x7fd780151f90 2023-06-02T15:30:22.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd784949640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd780151f90 0x7fd7800c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd77ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd78006bd60 0x7fd78006a320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42114/0 (socket says 172.21.15.132:42114) 2023-06-02T15:30:22.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd784949640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd780151f90 0x7fd7800c1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40432/0 (socket says 172.21.15.132:40432) 2023-06-02T15:30:22.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd77ffff640 1 -- 172.21.15.132:0/3410542169 learned_addr learned my addr 172.21.15.132:0/3410542169 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-06-02T15:30:22.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd78514a640 1 --2- 172.21.15.132:0/3410542169 >> v2:172.21.15.78:3300/0 conn(0x7fd7800aa5b0 0x7fd780158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd784949640 1 -- 172.21.15.132:0/3410542169 >> v2:172.21.15.78:3300/0 conn(0x7fd7800aa5b0 msgr2=0x7fd780158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:22.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd784949640 1 --2- 172.21.15.132:0/3410542169 >> v2:172.21.15.78:3300/0 conn(0x7fd7800aa5b0 0x7fd780158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd784949640 1 -- 172.21.15.132:0/3410542169 >> v1:172.21.15.132:6789/0 conn(0x7fd78006bd60 legacy=0x7fd78006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd77f7fe640 1 -- 172.21.15.132:0/3410542169 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2090865493 0 0) 0x7fd7800c0a50 con 0x7fd78006bd60 2023-06-02T15:30:22.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd784949640 1 -- 172.21.15.132:0/3410542169 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd780152900 con 0x7fd780151f90 2023-06-02T15:30:22.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.350+0000 7fd78514a640 1 --2- 172.21.15.132:0/3410542169 >> v2:172.21.15.78:3300/0 conn(0x7fd7800aa5b0 0x7fd780158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:22.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd784949640 1 --2- 172.21.15.132:0/3410542169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780151f90 0x7fd7800c1260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd78008aa60 tx=0x7fd77001ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f3ea87d5856b78b server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:22.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd77f7fe640 1 -- 172.21.15.132:0/3410542169 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7700a8950 con 0x7fd780151f90 2023-06-02T15:30:22.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd77f7fe640 1 -- 172.21.15.132:0/3410542169 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7700a8ab0 con 0x7fd780151f90 2023-06-02T15:30:22.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd77f7fe640 1 -- 172.21.15.132:0/3410542169 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7700a8e40 con 0x7fd780151f90 2023-06-02T15:30:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd786bad640 1 -- 172.21.15.132:0/3410542169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780151f90 msgr2=0x7fd7800c1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd786bad640 1 --2- 172.21.15.132:0/3410542169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780151f90 0x7fd7800c1260 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd78008aa60 tx=0x7fd77001ec50 comp rx=0 tx=0).stop 2023-06-02T15:30:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd786bad640 1 -- 172.21.15.132:0/3410542169 shutdown_connections 2023-06-02T15:30:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd786bad640 1 --2- 172.21.15.132:0/3410542169 >> v2:172.21.15.78:3300/0 conn(0x7fd7800aa5b0 0x7fd780158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd786bad640 1 --2- 172.21.15.132:0/3410542169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd780151f90 0x7fd7800c1260 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd786bad640 1 -- 172.21.15.132:0/3410542169 >> 172.21.15.132:0/3410542169 conn(0x7fd7800a63c0 msgr2=0x7fd7800a67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:22.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd786bad640 1 -- 172.21.15.132:0/3410542169 shutdown_connections 2023-06-02T15:30:22.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.354+0000 7fd786bad640 1 -- 172.21.15.132:0/3410542169 wait complete. 2023-06-02T15:30:22.361 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:22.351+0000 7f82f2bd6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-02T15:30:22.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 Processor -- start 2023-06-02T15:30:22.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 -- start start 2023-06-02T15:30:22.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd78006bd60 0x7fd7800b9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7800aa5b0 0x7fd7800c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd780151f90 0x7fd7800b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800c5140 con 0x7fd780151f90 2023-06-02T15:30:22.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800bc180 con 0x7fd7800aa5b0 2023-06-02T15:30:22.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800bb1d0 con 0x7fd78006bd60 2023-06-02T15:30:22.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd77ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7800aa5b0 0x7fd7800c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd784949640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd78006bd60 0x7fd7800b9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd784949640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd78006bd60 0x7fd7800b9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:57548/0 (socket says 172.21.15.132:57548) 2023-06-02T15:30:22.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd784949640 1 -- 172.21.15.132:0/954709334 learned_addr learned my addr 172.21.15.132:0/954709334 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:22.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd78514a640 1 --2- 172.21.15.132:0/954709334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd780151f90 0x7fd7800b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd784949640 1 -- 172.21.15.132:0/954709334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7800aa5b0 msgr2=0x7fd7800c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd784949640 1 --2- 172.21.15.132:0/954709334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7800aa5b0 0x7fd7800c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd784949640 1 -- 172.21.15.132:0/954709334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd780151f90 msgr2=0x7fd7800b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd784949640 1 --2- 172.21.15.132:0/954709334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd780151f90 0x7fd7800b73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd784949640 1 -- 172.21.15.132:0/954709334 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd770009420 con 0x7fd78006bd60 2023-06-02T15:30:22.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd78514a640 1 --2- 172.21.15.132:0/954709334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd780151f90 0x7fd7800b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:22.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd784949640 1 --2- 172.21.15.132:0/954709334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd78006bd60 0x7fd7800b9a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd7700b3040 tx=0x7fd77001b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:22.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd77d7fa640 1 -- 172.21.15.132:0/954709334 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7700b9630 con 0x7fd78006bd60 2023-06-02T15:30:22.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd77d7fa640 1 -- 172.21.15.132:0/954709334 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7700b97b0 con 0x7fd78006bd60 2023-06-02T15:30:22.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd77d7fa640 1 -- 172.21.15.132:0/954709334 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7700b9b60 con 0x7fd78006bd60 2023-06-02T15:30:22.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 -- 172.21.15.132:0/954709334 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7800c0ee0 con 0x7fd78006bd60 2023-06-02T15:30:22.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 -- 172.21.15.132:0/954709334 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7800bf320 con 0x7fd78006bd60 2023-06-02T15:30:22.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd77d7fa640 1 -- 172.21.15.132:0/954709334 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd7700b7040 con 0x7fd78006bd60 2023-06-02T15:30:22.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd77d7fa640 1 -- 172.21.15.132:0/954709334 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fd7700c4d20 con 0x7fd78006bd60 2023-06-02T15:30:22.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.358+0000 7fd786bad640 1 -- 172.21.15.132:0/954709334 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7800aa040 con 0x7fd78006bd60 2023-06-02T15:30:22.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.362+0000 7fd77d7fa640 1 -- 172.21.15.132:0/954709334 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fd7700b5070 con 0x7fd78006bd60 2023-06-02T15:30:22.374 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:22.370+0000 7f13fdd62180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-06-02T15:30:22.429 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:22.426+0000 7f13fdd62180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-06-02T15:30:22.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.430+0000 7fd786bad640 1 -- 172.21.15.132:0/954709334 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fc9bae87-5c32-44b2-af2a-619f0a0339c9", "id": 4} v 0) v1 -- 0x7fd7800bc2c0 con 0x7fd78006bd60 2023-06-02T15:30:22.436 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:22.427+0000 7f82f2bd6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-02T15:30:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.438+0000 7fd77d7fa640 1 -- 172.21.15.132:0/954709334 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc9bae87-5c32-44b2-af2a-619f0a0339c9", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd7700c4530 con 0x7fd78006bd60 2023-06-02T15:30:22.442 INFO:teuthology.orchestra.run.smithi132.stdout:4 2023-06-02T15:30:22.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.438+0000 7fd786bad640 1 -- 172.21.15.132:0/954709334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd78006bd60 msgr2=0x7fd7800b9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.438+0000 7fd786bad640 1 --2- 172.21.15.132:0/954709334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd78006bd60 0x7fd7800b9a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd7700b3040 tx=0x7fd77001b9f0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.438+0000 7fd786bad640 1 -- 172.21.15.132:0/954709334 shutdown_connections 2023-06-02T15:30:22.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.438+0000 7fd786bad640 1 --2- 172.21.15.132:0/954709334 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd780151f90 0x7fd7800b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.438+0000 7fd786bad640 1 --2- 172.21.15.132:0/954709334 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7800aa5b0 0x7fd7800c4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.438+0000 7fd786bad640 1 --2- 172.21.15.132:0/954709334 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd78006bd60 0x7fd7800b9a90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.438+0000 7fd786bad640 1 -- 172.21.15.132:0/954709334 >> 172.21.15.132:0/954709334 conn(0x7fd7800a63c0 msgr2=0x7fd78014a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:22.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.438+0000 7fd786bad640 1 -- 172.21.15.132:0/954709334 shutdown_connections 2023-06-02T15:30:22.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.438+0000 7fd786bad640 1 -- 172.21.15.132:0/954709334 wait complete. 2023-06-02T15:30:22.458 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 6284d11a-8e31-42e9-a34b-787229a6bc92 5 2023-06-02T15:30:22.484 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:22.482+0000 7f13fdd62180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-06-02T15:30:22.488 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:22.479+0000 7f82f2bd6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-02T15:30:22.563 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:22.558+0000 7f13fdd62180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-06-02T15:30:22.564 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:22.555+0000 7f82f2bd6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-02T15:30:22.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d4e634640 1 Processor -- start 2023-06-02T15:30:22.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d4e634640 1 -- start start 2023-06-02T15:30:22.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d4e634640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d48149b10 0x7f1d4806a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d4e634640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d4806ae40 0x7f1d480bc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d4e634640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d4814ce40 con 0x7f1d480bb0d0 2023-06-02T15:30:22.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d4e634640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d48149ee0 con 0x7f1d48149b10 2023-06-02T15:30:22.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d4e634640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d4814c550 con 0x7f1d4806ae40 2023-06-02T15:30:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d477fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d4806ae40 0x7f1d480bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d477fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d4806ae40 0x7f1d480bc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40446/0 (socket says 172.21.15.132:40446) 2023-06-02T15:30:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d477fe640 1 -- 172.21.15.132:0/3564674395 learned_addr learned my addr 172.21.15.132:0/3564674395 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d47fff640 1 --2- 172.21.15.132:0/3564674395 >> v2:172.21.15.78:3300/0 conn(0x7f1d48149b10 0x7f1d4806a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d477fe640 1 -- 172.21.15.132:0/3564674395 >> v2:172.21.15.78:3300/0 conn(0x7f1d48149b10 msgr2=0x7f1d4806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d477fe640 1 --2- 172.21.15.132:0/3564674395 >> v2:172.21.15.78:3300/0 conn(0x7f1d48149b10 0x7f1d4806a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d477fe640 1 -- 172.21.15.132:0/3564674395 >> v1:172.21.15.78:6789/0 conn(0x7f1d480bb0d0 legacy=0x7f1d4806c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:22.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d477fe640 1 -- 172.21.15.132:0/3564674395 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4814c7f0 con 0x7f1d4806ae40 2023-06-02T15:30:22.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.566+0000 7f1d47fff640 1 --2- 172.21.15.132:0/3564674395 >> v2:172.21.15.78:3300/0 conn(0x7f1d48149b10 0x7f1d4806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:22.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d477fe640 1 --2- 172.21.15.132:0/3564674395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806ae40 0x7f1d480bc450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1d4806efd0 tx=0x7f1d3801ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47cd92a0f37615ca server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:22.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d46ffd640 1 -- 172.21.15.132:0/3564674395 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d380a89b0 con 0x7f1d4806ae40 2023-06-02T15:30:22.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d46ffd640 1 -- 172.21.15.132:0/3564674395 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d380a8b10 con 0x7f1d4806ae40 2023-06-02T15:30:22.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d46ffd640 1 -- 172.21.15.132:0/3564674395 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d380a8ea0 con 0x7f1d4806ae40 2023-06-02T15:30:22.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d4e634640 1 -- 172.21.15.132:0/3564674395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806ae40 msgr2=0x7f1d480bc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d4e634640 1 --2- 172.21.15.132:0/3564674395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806ae40 0x7f1d480bc450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1d4806efd0 tx=0x7f1d3801ecb0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d4e634640 1 -- 172.21.15.132:0/3564674395 shutdown_connections 2023-06-02T15:30:22.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d4e634640 1 --2- 172.21.15.132:0/3564674395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d4806ae40 0x7f1d480bc450 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d4e634640 1 --2- 172.21.15.132:0/3564674395 >> v2:172.21.15.78:3300/0 conn(0x7f1d48149b10 0x7f1d4806a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d4e634640 1 -- 172.21.15.132:0/3564674395 >> 172.21.15.132:0/3564674395 conn(0x7f1d480bd800 msgr2=0x7f1d480bdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:22.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d4e634640 1 -- 172.21.15.132:0/3564674395 shutdown_connections 2023-06-02T15:30:22.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d4e634640 1 -- 172.21.15.132:0/3564674395 wait complete. 2023-06-02T15:30:22.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d4e634640 1 Processor -- start 2023-06-02T15:30:22.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.570+0000 7f1d4e634640 1 -- start start 2023-06-02T15:30:22.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4e634640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d4806ae40 0x7f1d480befc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4e634640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d480bb0d0 0x7f1d480ba0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4e634640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d48149b10 0x7f1d481e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4e634640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4813cb90 con 0x7f1d4806ae40 2023-06-02T15:30:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4e634640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d480b9c10 con 0x7f1d480bb0d0 2023-06-02T15:30:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4e634640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4813ce00 con 0x7f1d48149b10 2023-06-02T15:30:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4cbd1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d48149b10 0x7f1d481e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d480bb0d0 0x7f1d480ba0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d480bb0d0 0x7f1d480ba0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40458/0 (socket says 172.21.15.132:40458) 2023-06-02T15:30:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4cbd1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d48149b10 0x7f1d481e51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:57552/0 (socket says 172.21.15.132:57552) 2023-06-02T15:30:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d477fe640 1 -- 172.21.15.132:0/3194476796 learned_addr learned my addr 172.21.15.132:0/3194476796 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d47fff640 1 --2- 172.21.15.132:0/3194476796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d4806ae40 0x7f1d480befc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d477fe640 1 -- 172.21.15.132:0/3194476796 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d48149b10 msgr2=0x7f1d481e51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d477fe640 1 --2- 172.21.15.132:0/3194476796 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d48149b10 0x7f1d481e51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d477fe640 1 -- 172.21.15.132:0/3194476796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d4806ae40 msgr2=0x7f1d480befc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d477fe640 1 --2- 172.21.15.132:0/3194476796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d4806ae40 0x7f1d480befc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d477fe640 1 -- 172.21.15.132:0/3194476796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d380094d0 con 0x7f1d480bb0d0 2023-06-02T15:30:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d47fff640 1 --2- 172.21.15.132:0/3194476796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d4806ae40 0x7f1d480befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4cbd1640 1 --2- 172.21.15.132:0/3194476796 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d48149b10 0x7f1d481e51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d477fe640 1 --2- 172.21.15.132:0/3194476796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d480bb0d0 0x7f1d480ba0c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1d3801c8e0 tx=0x7f1d3801ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d44ff9640 1 -- 172.21.15.132:0/3194476796 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d380ba600 con 0x7f1d480bb0d0 2023-06-02T15:30:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d44ff9640 1 -- 172.21.15.132:0/3194476796 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d380ba780 con 0x7f1d480bb0d0 2023-06-02T15:30:22.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4e634640 1 -- 172.21.15.132:0/3194476796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d480b6410 con 0x7f1d480bb0d0 2023-06-02T15:30:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d44ff9640 1 -- 172.21.15.132:0/3194476796 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d380bab30 con 0x7f1d480bb0d0 2023-06-02T15:30:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4e634640 1 -- 172.21.15.132:0/3194476796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d4814cad0 con 0x7f1d480bb0d0 2023-06-02T15:30:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d44ff9640 1 -- 172.21.15.132:0/3194476796 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1d380c4460 con 0x7f1d480bb0d0 2023-06-02T15:30:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d44ff9640 1 -- 172.21.15.132:0/3194476796 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f1d380c3940 con 0x7f1d480bb0d0 2023-06-02T15:30:22.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.574+0000 7f1d4e634640 1 -- 172.21.15.132:0/3194476796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d4814d2d0 con 0x7f1d480bb0d0 2023-06-02T15:30:22.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.578+0000 7f1d44ff9640 1 -- 172.21.15.132:0/3194476796 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1d380b5070 con 0x7f1d480bb0d0 2023-06-02T15:30:22.615 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:22.607+0000 7f82f2bd6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-02T15:30:22.618 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:22.614+0000 7f13fdd62180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-06-02T15:30:22.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.642+0000 7f1d4e634640 1 -- 172.21.15.132:0/3194476796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6284d11a-8e31-42e9-a34b-787229a6bc92", "id": 5} v 0) v1 -- 0x7f1d4814d2d0 con 0x7f1d480bb0d0 2023-06-02T15:30:22.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.650+0000 7f1d44ff9640 1 -- 172.21.15.132:0/3194476796 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6284d11a-8e31-42e9-a34b-787229a6bc92", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1d380c3c20 con 0x7f1d480bb0d0 2023-06-02T15:30:22.656 INFO:teuthology.orchestra.run.smithi132.stdout:5 2023-06-02T15:30:22.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.654+0000 7f1d4e634640 1 -- 172.21.15.132:0/3194476796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d480bb0d0 msgr2=0x7f1d480ba0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.654+0000 7f1d4e634640 1 --2- 172.21.15.132:0/3194476796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d480bb0d0 0x7f1d480ba0c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1d3801c8e0 tx=0x7f1d3801ba50 comp rx=0 tx=0).stop 2023-06-02T15:30:22.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.654+0000 7f1d4e634640 1 -- 172.21.15.132:0/3194476796 shutdown_connections 2023-06-02T15:30:22.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.654+0000 7f1d4e634640 1 --2- 172.21.15.132:0/3194476796 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1d48149b10 0x7f1d481e51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.654+0000 7f1d4e634640 1 --2- 172.21.15.132:0/3194476796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d480bb0d0 0x7f1d480ba0c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.654+0000 7f1d4e634640 1 --2- 172.21.15.132:0/3194476796 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d4806ae40 0x7f1d480befc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.654+0000 7f1d4e634640 1 -- 172.21.15.132:0/3194476796 >> 172.21.15.132:0/3194476796 conn(0x7f1d480bd800 msgr2=0x7f1d480bdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:22.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.654+0000 7f1d4e634640 1 -- 172.21.15.132:0/3194476796 shutdown_connections 2023-06-02T15:30:22.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.654+0000 7f1d4e634640 1 -- 172.21.15.132:0/3194476796 wait complete. 2023-06-02T15:30:22.672 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 420898d9-6763-4c2e-ad6a-452179b91462 6 2023-06-02T15:30:22.697 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:22.694+0000 7f13fdd62180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-06-02T15:30:22.751 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:22.746+0000 7f13fdd62180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-06-02T15:30:22.753 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:22.747+0000 7f82f2bd6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-02T15:30:22.814 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:22.807+0000 7f82f2bd6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-02T15:30:22.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.810+0000 7f596805e640 1 Processor -- start 2023-06-02T15:30:22.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.810+0000 7f596805e640 1 -- start start 2023-06-02T15:30:22.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f596805e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f59600c1250 0x7f59600a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f596805e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1a30 0x7f596014e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f596805e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596014c170 con 0x7f59600c1620 2023-06-02T15:30:22.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f596805e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59600c0af0 con 0x7f59600c1250 2023-06-02T15:30:22.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f596805e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596014bc80 con 0x7f59600c1a30 2023-06-02T15:30:22.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f59665fb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1a30 0x7f596014e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f59655f9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f59600c1620 0x7f59601485c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42122/0 (socket says 172.21.15.132:42122) 2023-06-02T15:30:22.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f59655f9640 1 -- 172.21.15.132:0/745225028 learned_addr learned my addr 172.21.15.132:0/745225028 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-06-02T15:30:22.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f5965dfa640 1 --2- 172.21.15.132:0/745225028 >> v2:172.21.15.78:3300/0 conn(0x7f59600c1250 0x7f59600a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f5964df8640 1 -- 172.21.15.132:0/745225028 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429534482 0 0) 0x7f596014c170 con 0x7f59600c1620 2023-06-02T15:30:22.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f59665fb640 1 -- 172.21.15.132:0/745225028 >> v2:172.21.15.78:3300/0 conn(0x7f59600c1250 msgr2=0x7f59600a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:22.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f59665fb640 1 --2- 172.21.15.132:0/745225028 >> v2:172.21.15.78:3300/0 conn(0x7f59600c1250 0x7f59600a0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f59665fb640 1 -- 172.21.15.132:0/745225028 >> v1:172.21.15.132:6789/0 conn(0x7f59600c1620 legacy=0x7f59601485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f59665fb640 1 -- 172.21.15.132:0/745225028 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59600c0750 con 0x7f59600c1a30 2023-06-02T15:30:22.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f59665fb640 1 --2- 172.21.15.132:0/745225028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1a30 0x7f596014e790 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5958009d90 tx=0x7f595801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f761702fde96cdc3 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:22.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f5964df8640 1 -- 172.21.15.132:0/745225028 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f596014f4e0 con 0x7f59600c1a30 2023-06-02T15:30:22.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f5964df8640 1 -- 172.21.15.132:0/745225028 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59580a5a00 con 0x7f59600c1a30 2023-06-02T15:30:22.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.814+0000 7f5964df8640 1 -- 172.21.15.132:0/745225028 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59580a5d90 con 0x7f59600c1a30 2023-06-02T15:30:22.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- 172.21.15.132:0/745225028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1a30 msgr2=0x7f596014e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 --2- 172.21.15.132:0/745225028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1a30 0x7f596014e790 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5958009d90 tx=0x7f595801c920 comp rx=0 tx=0).stop 2023-06-02T15:30:22.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- 172.21.15.132:0/745225028 shutdown_connections 2023-06-02T15:30:22.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 --2- 172.21.15.132:0/745225028 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1a30 0x7f596014e790 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 --2- 172.21.15.132:0/745225028 >> v2:172.21.15.78:3300/0 conn(0x7f59600c1250 0x7f59600a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- 172.21.15.132:0/745225028 >> 172.21.15.132:0/745225028 conn(0x7f59600a3280 msgr2=0x7f59600a3650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:22.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- 172.21.15.132:0/745225028 shutdown_connections 2023-06-02T15:30:22.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- 172.21.15.132:0/745225028 wait complete. 2023-06-02T15:30:22.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 Processor -- start 2023-06-02T15:30:22.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- start start 2023-06-02T15:30:22.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59600c1250 0x7f5960147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1620 0x7f5960140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59600c1a30 0x7f59601410f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:22.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59601430a0 con 0x7f59600c1a30 2023-06-02T15:30:22.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5960141630 con 0x7f59600c1250 2023-06-02T15:30:22.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5960148000 con 0x7f59600c1620 2023-06-02T15:30:22.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59655f9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1620 0x7f5960140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f5965dfa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59600c1250 0x7f5960147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59655f9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1620 0x7f5960140bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:57566/0 (socket says 172.21.15.132:57566) 2023-06-02T15:30:22.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f5965dfa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59600c1250 0x7f5960147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40472/0 (socket says 172.21.15.132:40472) 2023-06-02T15:30:22.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59655f9640 1 -- 172.21.15.132:0/1838483792 learned_addr learned my addr 172.21.15.132:0/1838483792 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:22.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59665fb640 1 --2- 172.21.15.132:0/1838483792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59600c1a30 0x7f59601410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:22.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59655f9640 1 -- 172.21.15.132:0/1838483792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59600c1250 msgr2=0x7f5960147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59655f9640 1 --2- 172.21.15.132:0/1838483792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59600c1250 0x7f5960147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59655f9640 1 -- 172.21.15.132:0/1838483792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59600c1a30 msgr2=0x7f59601410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59655f9640 1 --2- 172.21.15.132:0/1838483792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59600c1a30 0x7f59601410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59655f9640 1 -- 172.21.15.132:0/1838483792 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5958009a70 con 0x7f59600c1620 2023-06-02T15:30:22.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59655f9640 1 --2- 172.21.15.132:0/1838483792 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1620 0x7f5960140bb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f59500011f0 tx=0x7f595000c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:22.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59567fc640 1 -- 172.21.15.132:0/1838483792 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59500074e0 con 0x7f59600c1620 2023-06-02T15:30:22.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59567fc640 1 -- 172.21.15.132:0/1838483792 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5950007640 con 0x7f59600c1620 2023-06-02T15:30:22.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- 172.21.15.132:0/1838483792 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5960157cc0 con 0x7f59600c1620 2023-06-02T15:30:22.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59567fc640 1 -- 172.21.15.132:0/1838483792 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950004a10 con 0x7f59600c1620 2023-06-02T15:30:22.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- 172.21.15.132:0/1838483792 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5960157b30 con 0x7f59600c1620 2023-06-02T15:30:22.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59567fc640 1 -- 172.21.15.132:0/1838483792 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5950012400 con 0x7f59600c1620 2023-06-02T15:30:22.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f59567fc640 1 -- 172.21.15.132:0/1838483792 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f595001b950 con 0x7f59600c1620 2023-06-02T15:30:22.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.818+0000 7f596805e640 1 -- 172.21.15.132:0/1838483792 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5960157e50 con 0x7f59600c1620 2023-06-02T15:30:22.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.822+0000 7f59567fc640 1 -- 172.21.15.132:0/1838483792 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f5950018070 con 0x7f59600c1620 2023-06-02T15:30:22.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.890+0000 7f596805e640 1 -- 172.21.15.132:0/1838483792 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd new", "uuid": "420898d9-6763-4c2e-ad6a-452179b91462", "id": 6} v 0) v1 -- 0x7f5960073bc0 con 0x7f59600c1620 2023-06-02T15:30:22.893 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:22.890+0000 7f13fdd62180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-06-02T15:30:22.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.898+0000 7f59567fc640 1 -- 172.21.15.132:0/1838483792 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "420898d9-6763-4c2e-ad6a-452179b91462", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f595001bc90 con 0x7f59600c1620 2023-06-02T15:30:22.901 INFO:teuthology.orchestra.run.smithi132.stdout:6 2023-06-02T15:30:22.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.898+0000 7f596805e640 1 -- 172.21.15.132:0/1838483792 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1620 msgr2=0x7f5960140bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:22.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.898+0000 7f596805e640 1 --2- 172.21.15.132:0/1838483792 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1620 0x7f5960140bb0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f59500011f0 tx=0x7f595000c9b0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.898+0000 7f596805e640 1 -- 172.21.15.132:0/1838483792 shutdown_connections 2023-06-02T15:30:22.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.898+0000 7f596805e640 1 --2- 172.21.15.132:0/1838483792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59600c1a30 0x7f59601410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.898+0000 7f596805e640 1 --2- 172.21.15.132:0/1838483792 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59600c1620 0x7f5960140bb0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.898+0000 7f596805e640 1 --2- 172.21.15.132:0/1838483792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59600c1250 0x7f5960147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:22.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.898+0000 7f596805e640 1 -- 172.21.15.132:0/1838483792 >> 172.21.15.132:0/1838483792 conn(0x7f59600a3280 msgr2=0x7f596014a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:22.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.898+0000 7f596805e640 1 -- 172.21.15.132:0/1838483792 shutdown_connections 2023-06-02T15:30:22.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:22.898+0000 7f596805e640 1 -- 172.21.15.132:0/1838483792 wait complete. 2023-06-02T15:30:22.917 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 2c515b77-0cfc-4f0f-9254-642711cc3f19 7 2023-06-02T15:30:22.957 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:22.954+0000 7f13fdd62180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-06-02T15:30:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac5598b640 1 Processor -- start 2023-06-02T15:30:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac5598b640 1 -- start start 2023-06-02T15:30:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac5598b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fac5014eaa0 0x7fac5014f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac5598b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fac500bd950 0x7fac500bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac5598b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac5006dac0 con 0x7fac5006e1f0 2023-06-02T15:30:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac5598b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5014f770 con 0x7fac5014eaa0 2023-06-02T15:30:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac5598b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac5006dda0 con 0x7fac500bd950 2023-06-02T15:30:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac4f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fac500bd950 0x7fac500bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac4f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fac500bd950 0x7fac500bdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40488/0 (socket says 172.21.15.132:40488) 2023-06-02T15:30:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac4f7fe640 1 -- 172.21.15.132:0/3374816102 learned_addr learned my addr 172.21.15.132:0/3374816102 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac4effd640 1 --2- 172.21.15.132:0/3374816102 >> v2:172.21.15.78:3300/0 conn(0x7fac5014eaa0 0x7fac5014f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac4f7fe640 1 -- 172.21.15.132:0/3374816102 >> v2:172.21.15.78:3300/0 conn(0x7fac5014eaa0 msgr2=0x7fac5014f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:23.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac4f7fe640 1 --2- 172.21.15.132:0/3374816102 >> v2:172.21.15.78:3300/0 conn(0x7fac5014eaa0 0x7fac5014f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac4f7fe640 1 -- 172.21.15.132:0/3374816102 >> v1:172.21.15.78:6789/0 conn(0x7fac5006e1f0 legacy=0x7fac50148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:23.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.030+0000 7fac4f7fe640 1 -- 172.21.15.132:0/3374816102 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac500bd430 con 0x7fac500bd950 2023-06-02T15:30:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac4f7fe640 1 --2- 172.21.15.132:0/3374816102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac500bd950 0x7fac500bdd50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac5006ee90 tx=0x7fac4801c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=284d7615c9d1cf5a server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac4dffb640 1 -- 172.21.15.132:0/3374816102 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac480a5870 con 0x7fac500bd950 2023-06-02T15:30:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac4dffb640 1 -- 172.21.15.132:0/3374816102 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac480a59d0 con 0x7fac500bd950 2023-06-02T15:30:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac4dffb640 1 -- 172.21.15.132:0/3374816102 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac480a5d60 con 0x7fac500bd950 2023-06-02T15:30:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac5598b640 1 -- 172.21.15.132:0/3374816102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac500bd950 msgr2=0x7fac500bdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac5598b640 1 --2- 172.21.15.132:0/3374816102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac500bd950 0x7fac500bdd50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fac5006ee90 tx=0x7fac4801c990 comp rx=0 tx=0).stop 2023-06-02T15:30:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac5598b640 1 -- 172.21.15.132:0/3374816102 shutdown_connections 2023-06-02T15:30:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac5598b640 1 --2- 172.21.15.132:0/3374816102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac500bd950 0x7fac500bdd50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac5598b640 1 --2- 172.21.15.132:0/3374816102 >> v2:172.21.15.78:3300/0 conn(0x7fac5014eaa0 0x7fac5014f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac5598b640 1 -- 172.21.15.132:0/3374816102 >> 172.21.15.132:0/3374816102 conn(0x7fac500a3180 msgr2=0x7fac500a3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac5598b640 1 -- 172.21.15.132:0/3374816102 shutdown_connections 2023-06-02T15:30:23.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac5598b640 1 -- 172.21.15.132:0/3374816102 wait complete. 2023-06-02T15:30:23.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac5598b640 1 Processor -- start 2023-06-02T15:30:23.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.034+0000 7fac5598b640 1 -- start start 2023-06-02T15:30:23.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac5598b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac5006e1f0 0x7fac501457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:23.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac5598b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac500bd950 0x7fac500b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:23.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac5598b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac5014eaa0 0x7fac501e87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:23.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac5598b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac501416b0 con 0x7fac500bd950 2023-06-02T15:30:23.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac5598b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac500b7d10 con 0x7fac5014eaa0 2023-06-02T15:30:23.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac5598b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac501453b0 con 0x7fac5006e1f0 2023-06-02T15:30:23.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac5014eaa0 0x7fac501e87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:23.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4effd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac5006e1f0 0x7fac501457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:23.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac5014eaa0 0x7fac501e87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40490/0 (socket says 172.21.15.132:40490) 2023-06-02T15:30:23.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4effd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac5006e1f0 0x7fac501457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.132:57582/0 (socket says 172.21.15.132:57582) 2023-06-02T15:30:23.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4f7fe640 1 -- 172.21.15.132:0/3793779593 learned_addr learned my addr 172.21.15.132:0/3793779593 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-06-02T15:30:23.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4e7fc640 1 --2- 172.21.15.132:0/3793779593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac500bd950 0x7fac500b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:23.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4f7fe640 1 -- 172.21.15.132:0/3793779593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac5006e1f0 msgr2=0x7fac501457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:23.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4f7fe640 1 --2- 172.21.15.132:0/3793779593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac5006e1f0 0x7fac501457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4f7fe640 1 -- 172.21.15.132:0/3793779593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac500bd950 msgr2=0x7fac500b77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:23.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4f7fe640 1 --2- 172.21.15.132:0/3793779593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac500bd950 0x7fac500b77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4f7fe640 1 -- 172.21.15.132:0/3793779593 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac48009b30 con 0x7fac5014eaa0 2023-06-02T15:30:23.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4effd640 1 --2- 172.21.15.132:0/3793779593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac5006e1f0 0x7fac501457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:23.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac4f7fe640 1 --2- 172.21.15.132:0/3793779593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac5014eaa0 0x7fac501e87c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fac480af040 tx=0x7fac48019730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:23.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac47fff640 1 -- 172.21.15.132:0/3793779593 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac480b8670 con 0x7fac5014eaa0 2023-06-02T15:30:23.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac47fff640 1 -- 172.21.15.132:0/3793779593 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac480b87d0 con 0x7fac5014eaa0 2023-06-02T15:30:23.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac5598b640 1 -- 172.21.15.132:0/3793779593 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac50158520 con 0x7fac5014eaa0 2023-06-02T15:30:23.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac47fff640 1 -- 172.21.15.132:0/3793779593 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac480b8b80 con 0x7fac5014eaa0 2023-06-02T15:30:23.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac5598b640 1 -- 172.21.15.132:0/3793779593 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac50158390 con 0x7fac5014eaa0 2023-06-02T15:30:23.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac47fff640 1 -- 172.21.15.132:0/3793779593 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fac480c3460 con 0x7fac5014eaa0 2023-06-02T15:30:23.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac47fff640 1 -- 172.21.15.132:0/3793779593 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fac480b6af0 con 0x7fac5014eaa0 2023-06-02T15:30:23.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.038+0000 7fac5598b640 1 -- 172.21.15.132:0/3793779593 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac501586b0 con 0x7fac5014eaa0 2023-06-02T15:30:23.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.042+0000 7fac47fff640 1 -- 172.21.15.132:0/3793779593 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fac480b6d60 con 0x7fac5014eaa0 2023-06-02T15:30:23.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.110+0000 7fac5598b640 1 -- 172.21.15.132:0/3793779593 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2c515b77-0cfc-4f0f-9254-642711cc3f19", "id": 7} v 0) v1 -- 0x7fac501586b0 con 0x7fac5014eaa0 2023-06-02T15:30:23.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.118+0000 7fac47fff640 1 -- 172.21.15.132:0/3793779593 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c515b77-0cfc-4f0f-9254-642711cc3f19", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac480b6490 con 0x7fac5014eaa0 2023-06-02T15:30:23.122 INFO:teuthology.orchestra.run.smithi132.stdout:7 2023-06-02T15:30:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.118+0000 7fac5598b640 1 -- 172.21.15.132:0/3793779593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac5014eaa0 msgr2=0x7fac501e87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.118+0000 7fac5598b640 1 --2- 172.21.15.132:0/3793779593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac5014eaa0 0x7fac501e87c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fac480af040 tx=0x7fac48019730 comp rx=0 tx=0).stop 2023-06-02T15:30:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.118+0000 7fac5598b640 1 -- 172.21.15.132:0/3793779593 shutdown_connections 2023-06-02T15:30:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.118+0000 7fac5598b640 1 --2- 172.21.15.132:0/3793779593 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac5014eaa0 0x7fac501e87c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.118+0000 7fac5598b640 1 --2- 172.21.15.132:0/3793779593 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fac500bd950 0x7fac500b77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.118+0000 7fac5598b640 1 --2- 172.21.15.132:0/3793779593 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fac5006e1f0 0x7fac501457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.118+0000 7fac5598b640 1 -- 172.21.15.132:0/3793779593 >> 172.21.15.132:0/3793779593 conn(0x7fac500a3180 msgr2=0x7fac50148530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:23.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.118+0000 7fac5598b640 1 -- 172.21.15.132:0/3793779593 shutdown_connections 2023-06-02T15:30:23.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-06-02T15:30:23.118+0000 7fac5598b640 1 -- 172.21.15.132:0/3793779593 wait complete. 2023-06-02T15:30:23.137 INFO:tasks.ceph.osd.0:Restarting daemon 2023-06-02T15:30:23.138 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-06-02T15:30:23.140 INFO:tasks.ceph.osd.0:Started 2023-06-02T15:30:23.140 INFO:tasks.ceph.osd.1:Restarting daemon 2023-06-02T15:30:23.140 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-06-02T15:30:23.142 INFO:tasks.ceph.osd.1:Started 2023-06-02T15:30:23.142 INFO:tasks.ceph.osd.2:Restarting daemon 2023-06-02T15:30:23.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-06-02T15:30:23.144 INFO:tasks.ceph.osd.2:Started 2023-06-02T15:30:23.145 INFO:tasks.ceph.osd.3:Restarting daemon 2023-06-02T15:30:23.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-06-02T15:30:23.147 INFO:tasks.ceph.osd.3:Started 2023-06-02T15:30:23.147 INFO:tasks.ceph.osd.4:Restarting daemon 2023-06-02T15:30:23.148 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-06-02T15:30:23.181 INFO:tasks.ceph.osd.4:Started 2023-06-02T15:30:23.182 INFO:tasks.ceph.osd.5:Restarting daemon 2023-06-02T15:30:23.182 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-06-02T15:30:23.184 INFO:tasks.ceph.osd.5:Started 2023-06-02T15:30:23.185 INFO:tasks.ceph.osd.6:Restarting daemon 2023-06-02T15:30:23.185 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-06-02T15:30:23.187 INFO:tasks.ceph.osd.6:Started 2023-06-02T15:30:23.187 INFO:tasks.ceph.osd.7:Restarting daemon 2023-06-02T15:30:23.188 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-06-02T15:30:23.190 INFO:tasks.ceph.osd.7:Started 2023-06-02T15:30:23.190 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b70567640 1 Processor -- start 2023-06-02T15:30:23.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b70567640 1 -- start start 2023-06-02T15:30:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b70567640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1b680badd0 0x7f1b68070c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:23.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b70567640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b6806f5d0 0x7f1b6806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b70567640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b68148dd0 con 0x7f1b68065550 2023-06-02T15:30:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b70567640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6806ac50 con 0x7f1b6806f5d0 2023-06-02T15:30:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b70567640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b6806aef0 con 0x7f1b680badd0 2023-06-02T15:30:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b6eb04640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b6806f5d0 0x7f1b6806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b6eb04640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b6806f5d0 0x7f1b6806fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44634/0 (socket says 172.21.15.78:44634) 2023-06-02T15:30:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b6eb04640 1 -- 172.21.15.78:0/4176977079 learned_addr learned my addr 172.21.15.78:0/4176977079 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:23.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b6e303640 1 --2- 172.21.15.78:0/4176977079 >> v2:172.21.15.132:3300/0 conn(0x7f1b680badd0 0x7f1b68070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:23.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b6eb04640 1 -- 172.21.15.78:0/4176977079 >> v2:172.21.15.132:3300/0 conn(0x7f1b680badd0 msgr2=0x7f1b68070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:23.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b6eb04640 1 --2- 172.21.15.78:0/4176977079 >> v2:172.21.15.132:3300/0 conn(0x7f1b680badd0 0x7f1b68070c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b6eb04640 1 -- 172.21.15.78:0/4176977079 >> v1:172.21.15.132:6789/0 conn(0x7f1b68065550 legacy=0x7f1b680b9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:23.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.319+0000 7f1b6eb04640 1 -- 172.21.15.78:0/4176977079 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6814c080 con 0x7f1b6806f5d0 2023-06-02T15:30:23.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6eb04640 1 --2- 172.21.15.78:0/4176977079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 0x7f1b6806fa50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b6806dba0 tx=0x7f1b6001ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857769c4afa674bf server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:23.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6d301640 1 -- 172.21.15.78:0/4176977079 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6000b2d0 con 0x7f1b6806f5d0 2023-06-02T15:30:23.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6d301640 1 -- 172.21.15.78:0/4176977079 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6000b430 con 0x7f1b6806f5d0 2023-06-02T15:30:23.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6d301640 1 -- 172.21.15.78:0/4176977079 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b600a7a70 con 0x7f1b6806f5d0 2023-06-02T15:30:23.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- 172.21.15.78:0/4176977079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 msgr2=0x7f1b6806fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:23.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 --2- 172.21.15.78:0/4176977079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 0x7f1b6806fa50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1b6806dba0 tx=0x7f1b6001ebd0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- 172.21.15.78:0/4176977079 shutdown_connections 2023-06-02T15:30:23.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 --2- 172.21.15.78:0/4176977079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 0x7f1b6806fa50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 --2- 172.21.15.78:0/4176977079 >> v2:172.21.15.132:3300/0 conn(0x7f1b680badd0 0x7f1b68070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- 172.21.15.78:0/4176977079 >> 172.21.15.78:0/4176977079 conn(0x7f1b680bd920 msgr2=0x7f1b680bdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:23.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- 172.21.15.78:0/4176977079 shutdown_connections 2023-06-02T15:30:23.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- 172.21.15.78:0/4176977079 wait complete. 2023-06-02T15:30:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 Processor -- start 2023-06-02T15:30:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- start start 2023-06-02T15:30:23.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b68065550 0x7f1b68145d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 0x7f1b68145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b680badd0 0x7f1b681e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b681e69c0 con 0x7f1b6806f5d0 2023-06-02T15:30:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b68146280 con 0x7f1b68065550 2023-06-02T15:30:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b6814cf00 con 0x7f1b680badd0 2023-06-02T15:30:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6db02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 0x7f1b68145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6e303640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b68065550 0x7f1b68145d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6db02640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 0x7f1b68145360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44636/0 (socket says 172.21.15.78:44636) 2023-06-02T15:30:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6db02640 1 -- 172.21.15.78:0/670547035 learned_addr learned my addr 172.21.15.78:0/670547035 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6eb04640 1 --2- 172.21.15.78:0/670547035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b680badd0 0x7f1b681e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6db02640 1 -- 172.21.15.78:0/670547035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b680badd0 msgr2=0x7f1b681e5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6db02640 1 --2- 172.21.15.78:0/670547035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b680badd0 0x7f1b681e5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6db02640 1 -- 172.21.15.78:0/670547035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b68065550 msgr2=0x7f1b68145d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6db02640 1 --2- 172.21.15.78:0/670547035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b68065550 0x7f1b68145d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6db02640 1 -- 172.21.15.78:0/670547035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6000bd40 con 0x7f1b6806f5d0 2023-06-02T15:30:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b6db02640 1 --2- 172.21.15.78:0/670547035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 0x7f1b68145360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c3c0 tx=0x7f1b5800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b5effd640 1 -- 172.21.15.78:0/670547035 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b580052d0 con 0x7f1b6806f5d0 2023-06-02T15:30:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b5effd640 1 -- 172.21.15.78:0/670547035 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b58005430 con 0x7f1b6806f5d0 2023-06-02T15:30:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- 172.21.15.78:0/670547035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b680ba7b0 con 0x7f1b6806f5d0 2023-06-02T15:30:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b5effd640 1 -- 172.21.15.78:0/670547035 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b58003820 con 0x7f1b6806f5d0 2023-06-02T15:30:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b70567640 1 -- 172.21.15.78:0/670547035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b680ba620 con 0x7f1b6806f5d0 2023-06-02T15:30:23.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b5effd640 1 -- 172.21.15.78:0/670547035 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1b58003c80 con 0x7f1b6806f5d0 2023-06-02T15:30:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.323+0000 7f1b5effd640 1 -- 172.21.15.78:0/670547035 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f1b58012af0 con 0x7f1b6806f5d0 2023-06-02T15:30:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.327+0000 7f1b70567640 1 -- 172.21.15.78:0/670547035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b680bb1a0 con 0x7f1b6806f5d0 2023-06-02T15:30:23.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.331+0000 7f1b5effd640 1 -- 172.21.15.78:0/670547035 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1b58017070 con 0x7f1b6806f5d0 2023-06-02T15:30:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.395+0000 7f1b70567640 1 -- 172.21.15.78:0/670547035 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b68073bc0 con 0x7f1b6806f5d0 2023-06-02T15:30:23.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.395+0000 7f1b5effd640 1 -- 172.21.15.78:0/670547035 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f1b58012420 con 0x7f1b6806f5d0 2023-06-02T15:30:23.404 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:23.404 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:23.112370+0000","last_up_change":"0.000000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:23.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.399+0000 7f1b70567640 1 -- 172.21.15.78:0/670547035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 msgr2=0x7f1b68145360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:23.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.399+0000 7f1b70567640 1 --2- 172.21.15.78:0/670547035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 0x7f1b68145360 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1b5800c3c0 tx=0x7f1b5800c880 comp rx=0 tx=0).stop 2023-06-02T15:30:23.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.399+0000 7f1b70567640 1 -- 172.21.15.78:0/670547035 shutdown_connections 2023-06-02T15:30:23.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.399+0000 7f1b70567640 1 --2- 172.21.15.78:0/670547035 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1b680badd0 0x7f1b681e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.399+0000 7f1b70567640 1 --2- 172.21.15.78:0/670547035 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b6806f5d0 0x7f1b68145360 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.399+0000 7f1b70567640 1 --2- 172.21.15.78:0/670547035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b68065550 0x7f1b68145d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:23.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.399+0000 7f1b70567640 1 -- 172.21.15.78:0/670547035 >> 172.21.15.78:0/670547035 conn(0x7f1b680bd920 msgr2=0x7f1b680bdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:23.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.399+0000 7f1b70567640 1 -- 172.21.15.78:0/670547035 shutdown_connections 2023-06-02T15:30:23.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:23.399+0000 7f1b70567640 1 -- 172.21.15.78:0/670547035 wait complete. 2023-06-02T15:30:23.420 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-06-02T15:30:23.420 INFO:tasks.ceph:Waiting for OSDs to come up 2023-06-02T15:30:23.445 INFO:tasks.ceph.mgr.y.smithi078.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-06-02T15:30:23.445 INFO:tasks.ceph.mgr.y.smithi078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-06-02T15:30:23.446 INFO:tasks.ceph.mgr.y.smithi078.stderr: from numpy import show_config as show_numpy_config 2023-06-02T15:30:23.483 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:23.475+0000 7f82f2bd6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-02T15:30:23.559 INFO:tasks.ceph.mgr.x.smithi132.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-06-02T15:30:23.559 INFO:tasks.ceph.mgr.x.smithi132.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-06-02T15:30:23.559 INFO:tasks.ceph.mgr.x.smithi132.stderr: from numpy import show_config as show_numpy_config 2023-06-02T15:30:23.561 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-06-02T15:30:23.558+0000 7f3cc58c0640 -1 Falling back to public interface 2023-06-02T15:30:23.614 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:23.607+0000 7f82f2bd6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-02T15:30:23.616 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:23.610+0000 7f13fdd62180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-06-02T15:30:23.761 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:23.758+0000 7f13fdd62180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-06-02T15:30:23.778 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-02T15:30:23.771+0000 7fa33d555640 -1 Falling back to public interface 2023-06-02T15:30:23.779 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:23.771+0000 7f82f2bd6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-02T15:30:23.794 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-02T15:30:23.787+0000 7fbb3d1a9640 -1 Falling back to public interface 2023-06-02T15:30:23.797 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-02T15:30:23.791+0000 7ff16a9cc640 -1 Falling back to public interface 2023-06-02T15:30:23.805 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-02T15:30:23.799+0000 7f62beabb640 -1 Falling back to public interface 2023-06-02T15:30:23.806 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-06-02T15:30:23.802+0000 7f6f4d335640 -1 Falling back to public interface 2023-06-02T15:30:23.817 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-06-02T15:30:23.814+0000 7f3bc7e13640 -1 Falling back to public interface 2023-06-02T15:30:23.822 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-06-02T15:30:23.818+0000 7fa1abae5640 -1 Falling back to public interface 2023-06-02T15:30:23.846 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:23.839+0000 7f82f2bd6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-02T15:30:23.938 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:23.934+0000 7f13fdd62180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-06-02T15:30:23.967 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:23.959+0000 7f82f2bd6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-02T15:30:24.008 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:24.002+0000 7f13fdd62180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-06-02T15:30:24.140 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:24.138+0000 7f13fdd62180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-06-02T15:30:24.227 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:24.341 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f8d61640 1 Processor -- start 2023-06-02T15:30:24.341 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f8d61640 1 -- start start 2023-06-02T15:30:24.342 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f8d61640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40bbf20 0x7f00f414d070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:24.342 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f8d61640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00f40bad80 0x7f00f40bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:24.342 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f8d61640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f414d5b0 con 0x7f00f40ba9b0 2023-06-02T15:30:24.342 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f8d61640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f40b7b40 con 0x7f00f40bad80 2023-06-02T15:30:24.342 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f8d61640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40b73d0 con 0x7f00f40bbf20 2023-06-02T15:30:24.343 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f1d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40bbf20 0x7f00f414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:24.343 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f2d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00f40bad80 0x7f00f40bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:24.343 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f1d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40bbf20 0x7f00f414d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:45336/0 (socket says 172.21.15.78:45336) 2023-06-02T15:30:24.343 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f1d9b640 1 -- 172.21.15.78:0/205740658 learned_addr learned my addr 172.21.15.78:0/205740658 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:24.343 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f2d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00f40bad80 0x7f00f40bc6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:40322/0 (socket says 172.21.15.78:40322) 2023-06-02T15:30:24.344 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f2d9d640 1 -- 172.21.15.78:0/205740658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40bbf20 msgr2=0x7f00f414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:24.344 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f2d9d640 1 --2- 172.21.15.78:0/205740658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40bbf20 0x7f00f414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:24.344 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f2d9d640 1 -- 172.21.15.78:0/205740658 >> v1:172.21.15.132:6789/0 conn(0x7f00f40ba9b0 legacy=0x7f00f40b6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:24.344 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.335+0000 7f00f2d9d640 1 -- 172.21.15.78:0/205740658 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f40bba90 con 0x7f00f40bad80 2023-06-02T15:30:24.345 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f2d9d640 1 --2- 172.21.15.78:0/205740658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00f40bad80 0x7f00f40bc6a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009d90 tx=0x7f00ec01f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87cfa01e00f5f986 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:24.346 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f159a640 1 -- 172.21.15.78:0/205740658 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0af600 con 0x7f00f40bad80 2023-06-02T15:30:24.346 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f159a640 1 -- 172.21.15.78:0/205740658 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec0ab050 con 0x7f00f40bad80 2023-06-02T15:30:24.346 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f159a640 1 -- 172.21.15.78:0/205740658 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0af980 con 0x7f00f40bad80 2023-06-02T15:30:24.347 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 -- 172.21.15.78:0/205740658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00f40bad80 msgr2=0x7f00f40bc6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:24.347 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 --2- 172.21.15.78:0/205740658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00f40bad80 0x7f00f40bc6a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009d90 tx=0x7f00ec01f130 comp rx=0 tx=0).stop 2023-06-02T15:30:24.347 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 -- 172.21.15.78:0/205740658 shutdown_connections 2023-06-02T15:30:24.347 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 --2- 172.21.15.78:0/205740658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00f40bad80 0x7f00f40bc6a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:24.347 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 --2- 172.21.15.78:0/205740658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40bbf20 0x7f00f414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:24.348 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 -- 172.21.15.78:0/205740658 >> 172.21.15.78:0/205740658 conn(0x7f00f40be560 msgr2=0x7f00f406c990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:24.348 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 -- 172.21.15.78:0/205740658 shutdown_connections 2023-06-02T15:30:24.348 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 -- 172.21.15.78:0/205740658 wait complete. 2023-06-02T15:30:24.350 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 Processor -- start 2023-06-02T15:30:24.350 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 -- start start 2023-06-02T15:30:24.350 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40ba9b0 0x7f00f406cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:24.350 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00f40bad80 0x7f00f40a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:24.350 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00f40bbf20 0x7f00f40a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:24.350 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f41e1770 con 0x7f00f40bbf20 2023-06-02T15:30:24.350 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40a6610 con 0x7f00f40bad80 2023-06-02T15:30:24.351 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f8d61640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f4099660 con 0x7f00f40ba9b0 2023-06-02T15:30:24.351 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.339+0000 7f00f2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00f40bbf20 0x7f00f40a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:24.351 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f2d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00f40bbf20 0x7f00f40a60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50032/0 (socket says 172.21.15.78:50032) 2023-06-02T15:30:24.351 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f2d9d640 1 -- 172.21.15.78:0/3003645715 learned_addr learned my addr 172.21.15.78:0/3003645715 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:24.351 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f259c640 1 --2- 172.21.15.78:0/3003645715 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40ba9b0 0x7f00f406cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:24.351 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f1d9b640 1 --2- 172.21.15.78:0/3003645715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00f40bad80 0x7f00f40a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:24.351 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f2d9d640 1 -- 172.21.15.78:0/3003645715 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40ba9b0 msgr2=0x7f00f406cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:24.352 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f2d9d640 1 --2- 172.21.15.78:0/3003645715 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40ba9b0 0x7f00f406cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:24.352 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f2d9d640 1 -- 172.21.15.78:0/3003645715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00f40bad80 msgr2=0x7f00f40a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:24.352 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f2d9d640 1 --2- 172.21.15.78:0/3003645715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00f40bad80 0x7f00f40a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:24.352 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f2d9d640 1 -- 172.21.15.78:0/3003645715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec009a70 con 0x7f00f40bbf20 2023-06-02T15:30:24.352 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f2d9d640 1 --2- 172.21.15.78:0/3003645715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00f40bbf20 0x7f00f40a60d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f00ec01cd60 tx=0x7f00ec01bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:24.352 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00e2ffd640 1 -- 172.21.15.78:0/3003645715 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec007000 con 0x7f00f40bbf20 2023-06-02T15:30:24.352 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00e2ffd640 1 -- 172.21.15.78:0/3003645715 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec009450 con 0x7f00f40bbf20 2023-06-02T15:30:24.352 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f8d61640 1 -- 172.21.15.78:0/3003645715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f40bb200 con 0x7f00f40bbf20 2023-06-02T15:30:24.353 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00e2ffd640 1 -- 172.21.15.78:0/3003645715 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0ba420 con 0x7f00f40bbf20 2023-06-02T15:30:24.353 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f8d61640 1 -- 172.21.15.78:0/3003645715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f40bd400 con 0x7f00f40bbf20 2023-06-02T15:30:24.353 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00e2ffd640 1 -- 172.21.15.78:0/3003645715 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f00ec0ba8a0 con 0x7f00f40bbf20 2023-06-02T15:30:24.353 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00e2ffd640 1 -- 172.21.15.78:0/3003645715 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f00ec0c2a90 con 0x7f00f40bbf20 2023-06-02T15:30:24.353 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.343+0000 7f00f8d61640 1 -- 172.21.15.78:0/3003645715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00f40bb390 con 0x7f00f40bbf20 2023-06-02T15:30:24.354 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.347+0000 7f00e2ffd640 1 -- 172.21.15.78:0/3003645715 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f00ec0c8060 con 0x7f00f40bbf20 2023-06-02T15:30:24.410 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00f8d61640 1 -- 172.21.15.78:0/3003645715 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f00f41e18b0 con 0x7f00f40bbf20 2023-06-02T15:30:24.411 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00e2ffd640 1 -- 172.21.15.78:0/3003645715 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f00ec0be030 con 0x7f00f40bbf20 2023-06-02T15:30:24.411 INFO:teuthology.misc.health.smithi078.stdout: 2023-06-02T15:30:24.411 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:23.112370+0000","last_up_change":"0.000000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:24.412 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00f8d61640 1 -- 172.21.15.78:0/3003645715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00f40bbf20 msgr2=0x7f00f40a60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:24.412 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00f8d61640 1 --2- 172.21.15.78:0/3003645715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00f40bbf20 0x7f00f40a60d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f00ec01cd60 tx=0x7f00ec01bed0 comp rx=0 tx=0).stop 2023-06-02T15:30:24.412 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00f8d61640 1 -- 172.21.15.78:0/3003645715 shutdown_connections 2023-06-02T15:30:24.413 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00f8d61640 1 --2- 172.21.15.78:0/3003645715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f00f40bbf20 0x7f00f40a60d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:24.413 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00f8d61640 1 --2- 172.21.15.78:0/3003645715 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00f40bad80 0x7f00f40a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:24.413 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00f8d61640 1 --2- 172.21.15.78:0/3003645715 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f00f40ba9b0 0x7f00f406cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:24.413 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00f8d61640 1 -- 172.21.15.78:0/3003645715 >> 172.21.15.78:0/3003645715 conn(0x7f00f40be560 msgr2=0x7f00f40b6290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:24.413 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00f8d61640 1 -- 172.21.15.78:0/3003645715 shutdown_connections 2023-06-02T15:30:24.413 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:24.403+0000 7f00f8d61640 1 -- 172.21.15.78:0/3003645715 wait complete. 2023-06-02T15:30:24.426 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-06-02T15:30:24.560 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:24.551+0000 7f82f2bd6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-02T15:30:24.635 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:24.627+0000 7f82f2bd6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-02T15:30:24.805 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:24.799+0000 7f82f2bd6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-02T15:30:24.858 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:24.854+0000 7f13fdd62180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-06-02T15:30:24.879 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:24.871+0000 7f82f2bd6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-02T15:30:24.932 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:24.926+0000 7f13fdd62180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-06-02T15:30:25.100 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:25.094+0000 7f13fdd62180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-06-02T15:30:25.124 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:25.115+0000 7f82f2bd6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-02T15:30:25.173 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:25.170+0000 7f13fdd62180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-06-02T15:30:25.183 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:25.175+0000 7f82f2bd6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-02T15:30:25.420 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:25.414+0000 7f13fdd62180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-06-02T15:30:25.479 INFO:tasks.ceph.mgr.x.smithi132.stderr:2023-06-02T15:30:25.474+0000 7f13fdd62180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-06-02T15:30:26.230 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:26.223+0000 7f829a69a640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-06-02T15:30:26.231 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-06-02T15:30:26.223+0000 7f829a69a640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-06-02T15:30:27.459 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-06-02T15:30:27.454+0000 7f3cc58c0640 -1 osd.7 0 log_to_monitors true 2023-06-02T15:30:27.574 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-02T15:30:27.567+0000 7fa33d555640 -1 osd.0 0 log_to_monitors true 2023-06-02T15:30:27.616 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-06-02T15:30:27.610+0000 7f6f4d335640 -1 osd.5 0 log_to_monitors true 2023-06-02T15:30:27.708 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-02T15:30:27.699+0000 7fbb3d1a9640 -1 osd.3 0 log_to_monitors true 2023-06-02T15:30:27.719 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-02T15:30:27.711+0000 7ff16a9cc640 -1 osd.2 0 log_to_monitors true 2023-06-02T15:30:27.730 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-06-02T15:30:27.726+0000 7f3bc7e13640 -1 osd.4 0 log_to_monitors true 2023-06-02T15:30:27.735 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-06-02T15:30:27.730+0000 7fa1abae5640 -1 osd.6 0 log_to_monitors true 2023-06-02T15:30:27.790 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-02T15:30:27.783+0000 7f62beabb640 -1 osd.1 0 log_to_monitors true 2023-06-02T15:30:30.374 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-06-02T15:30:30.370+0000 7f3cc1865640 -1 osd.7 0 waiting for initial osdmap 2023-06-02T15:30:30.379 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-06-02T15:30:30.374+0000 7f3bc3db8640 -1 osd.4 0 waiting for initial osdmap 2023-06-02T15:30:30.404 INFO:tasks.ceph.osd.7.smithi132.stderr:2023-06-02T15:30:30.402+0000 7f3cb9698640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-02T15:30:30.405 INFO:tasks.ceph.osd.4.smithi132.stderr:2023-06-02T15:30:30.402+0000 7f3bbbbeb640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-02T15:30:30.412 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-02T15:30:30.403+0000 7f62baa60640 -1 osd.1 0 waiting for initial osdmap 2023-06-02T15:30:30.457 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-06-02T15:30:30.451+0000 7f62b2893640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-02T15:30:30.460 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-06-02T15:30:30.454+0000 7f6f492da640 -1 osd.5 0 waiting for initial osdmap 2023-06-02T15:30:30.478 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-02T15:30:30.471+0000 7ff166971640 -1 osd.2 0 waiting for initial osdmap 2023-06-02T15:30:30.484 INFO:tasks.ceph.osd.5.smithi132.stderr:2023-06-02T15:30:30.482+0000 7f6f4110d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-02T15:30:30.495 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-06-02T15:30:30.490+0000 7fa1a82a1640 -1 osd.6 0 waiting for initial osdmap 2023-06-02T15:30:30.496 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-02T15:30:30.487+0000 7fa3394fa640 -1 osd.0 0 waiting for initial osdmap 2023-06-02T15:30:30.505 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-02T15:30:30.499+0000 7fbb3914e640 -1 osd.3 0 waiting for initial osdmap 2023-06-02T15:30:30.513 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-06-02T15:30:30.507+0000 7ff15e7a4640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-02T15:30:30.521 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-06-02T15:30:30.515+0000 7fa33132d640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-02T15:30:30.521 INFO:tasks.ceph.osd.6.smithi132.stderr:2023-06-02T15:30:30.518+0000 7fa19f8bd640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-02T15:30:30.553 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-06-02T15:30:30.547+0000 7fbb30f81640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-06-02T15:30:31.232 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:31.356 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.347+0000 7f328ca00640 1 Processor -- start 2023-06-02T15:30:31.356 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.347+0000 7f328ca00640 1 -- start start 2023-06-02T15:30:31.357 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.347+0000 7f328ca00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 0x7f32880bc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.357 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.347+0000 7f328ca00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f32880bc7e0 0x7f32880be660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.357 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.347+0000 7f328ca00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32880c0010 con 0x7f3288069b00 2023-06-02T15:30:31.357 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.347+0000 7f328ca00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32880bd120 con 0x7f32880bc7e0 2023-06-02T15:30:31.357 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.347+0000 7f328ca00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32880c04a0 con 0x7f32880bde60 2023-06-02T15:30:31.358 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f3285d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 0x7f32880bc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.358 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f3286d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f32880bc7e0 0x7f32880be660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.358 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f3285d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 0x7f32880bc2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:45446/0 (socket says 172.21.15.78:45446) 2023-06-02T15:30:31.358 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f3285d9b640 1 -- 172.21.15.78:0/1070816026 learned_addr learned my addr 172.21.15.78:0/1070816026 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:31.358 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f328659c640 1 --1- 172.21.15.78:0/1070816026 >> v1:172.21.15.132:6789/0 conn(0x7f3288069b00 0x7f32880c0670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:55336/0 (socket says 172.21.15.78:55336) 2023-06-02T15:30:31.359 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f3285d9b640 1 -- 172.21.15.78:0/1070816026 >> v2:172.21.15.132:3300/0 conn(0x7f32880bc7e0 msgr2=0x7f32880be660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:31.359 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f3285d9b640 1 --2- 172.21.15.78:0/1070816026 >> v2:172.21.15.132:3300/0 conn(0x7f32880bc7e0 0x7f32880be660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.359 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f3285d9b640 1 -- 172.21.15.78:0/1070816026 >> v1:172.21.15.132:6789/0 conn(0x7f3288069b00 legacy=0x7f32880c0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:31.359 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f3285d9b640 1 -- 172.21.15.78:0/1070816026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32880c0d80 con 0x7f32880bde60 2023-06-02T15:30:31.360 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f3285d9b640 1 --2- 172.21.15.78:0/1070816026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 0x7f32880bc2a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3280009e50 tx=0x7f328001c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d55677c06a498a77 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:31.360 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f328559a640 1 -- 172.21.15.78:0/1070816026 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800a57c0 con 0x7f32880bde60 2023-06-02T15:30:31.360 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f328559a640 1 -- 172.21.15.78:0/1070816026 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800a5920 con 0x7f32880bde60 2023-06-02T15:30:31.360 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f328559a640 1 -- 172.21.15.78:0/1070816026 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800a5cb0 con 0x7f32880bde60 2023-06-02T15:30:31.361 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f328ca00640 1 -- 172.21.15.78:0/1070816026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 msgr2=0x7f32880bc2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:31.361 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f328ca00640 1 --2- 172.21.15.78:0/1070816026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 0x7f32880bc2a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3280009e50 tx=0x7f328001c9e0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.361 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f328ca00640 1 -- 172.21.15.78:0/1070816026 shutdown_connections 2023-06-02T15:30:31.361 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f328ca00640 1 --2- 172.21.15.78:0/1070816026 >> v2:172.21.15.132:3300/0 conn(0x7f32880bc7e0 0x7f32880be660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.361 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f328ca00640 1 --2- 172.21.15.78:0/1070816026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 0x7f32880bc2a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.362 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.351+0000 7f328ca00640 1 -- 172.21.15.78:0/1070816026 >> 172.21.15.78:0/1070816026 conn(0x7f32880a3280 msgr2=0x7f32880a3680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:31.362 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 -- 172.21.15.78:0/1070816026 shutdown_connections 2023-06-02T15:30:31.362 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 -- 172.21.15.78:0/1070816026 wait complete. 2023-06-02T15:30:31.364 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 Processor -- start 2023-06-02T15:30:31.364 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 -- start start 2023-06-02T15:30:31.364 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3288069b00 0x7f3288143450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.364 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880bc7e0 0x7f3288143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.364 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 0x7f3288146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.364 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3288071ce0 con 0x7f32880bc7e0 2023-06-02T15:30:31.365 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32881e6d90 con 0x7f3288069b00 2023-06-02T15:30:31.365 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32881e6fa0 con 0x7f32880bde60 2023-06-02T15:30:31.365 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f3285d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880bc7e0 0x7f3288143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.365 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f3285d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880bc7e0 0x7f3288143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50140/0 (socket says 172.21.15.78:50140) 2023-06-02T15:30:31.365 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f3285d9b640 1 -- 172.21.15.78:0/3348589434 learned_addr learned my addr 172.21.15.78:0/3348589434 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:31.365 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328659c640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3288069b00 0x7f3288143450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.365 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f3286d9d640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 0x7f3288146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.366 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f3285d9b640 1 -- 172.21.15.78:0/3348589434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 msgr2=0x7f3288146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:31.366 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f3285d9b640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 0x7f3288146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.366 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f3285d9b640 1 -- 172.21.15.78:0/3348589434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3288069b00 msgr2=0x7f3288143450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:31.366 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f3285d9b640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3288069b00 0x7f3288143450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.366 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f3285d9b640 1 -- 172.21.15.78:0/3348589434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280009b30 con 0x7f32880bc7e0 2023-06-02T15:30:31.366 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f3285d9b640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880bc7e0 0x7f3288143990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f32800af040 tx=0x7f3280019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:31.366 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f327effd640 1 -- 172.21.15.78:0/3348589434 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800bd070 con 0x7f32880bc7e0 2023-06-02T15:30:31.367 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f327effd640 1 -- 172.21.15.78:0/3348589434 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800b8470 con 0x7f32880bc7e0 2023-06-02T15:30:31.367 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 -- 172.21.15.78:0/3348589434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32880bced0 con 0x7f32880bc7e0 2023-06-02T15:30:31.367 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f327effd640 1 -- 172.21.15.78:0/3348589434 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800b8840 con 0x7f32880bc7e0 2023-06-02T15:30:31.367 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 -- 172.21.15.78:0/3348589434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32880bcd40 con 0x7f32880bc7e0 2023-06-02T15:30:31.368 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.355+0000 7f328ca00640 1 -- 172.21.15.78:0/3348589434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3288069ed0 con 0x7f32880bc7e0 2023-06-02T15:30:31.368 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.359+0000 7f327effd640 1 -- 172.21.15.78:0/3348589434 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7f32800b89a0 con 0x7f32880bc7e0 2023-06-02T15:30:31.368 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.359+0000 7f327effd640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3268065b70 0x7f3268068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.368 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.359+0000 7f327effd640 1 -- 172.21.15.78:0/3348589434 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f328011cf20 con 0x7f32880bc7e0 2023-06-02T15:30:31.368 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.359+0000 7f328659c640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3268065b70 0x7f3268068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.368 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.359+0000 7f328659c640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3268065b70 0x7f3268068020 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3270000f70 tx=0x7f3270007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:31.369 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.363+0000 7f327effd640 1 -- 172.21.15.78:0/3348589434 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f32800eb6c0 con 0x7f32880bc7e0 2023-06-02T15:30:31.520 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.511+0000 7f328ca00640 1 -- 172.21.15.78:0/3348589434 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32880bd710 con 0x7f32880bc7e0 2023-06-02T15:30:31.522 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f327effd640 1 -- 172.21.15.78:0/3348589434 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10440 (secure 0 0 0) 0x7f32800eece0 con 0x7f32880bc7e0 2023-06-02T15:30:31.522 INFO:teuthology.misc.health.smithi078.stdout: 2023-06-02T15:30:31.522 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":13,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:31.381228+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:31.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 -- 172.21.15.78:0/3348589434 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3268065b70 msgr2=0x7f3268068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:31.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3268065b70 0x7f3268068020 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3270000f70 tx=0x7f3270007cd0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 -- 172.21.15.78:0/3348589434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880bc7e0 msgr2=0x7f3288143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:31.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880bc7e0 0x7f3288143990 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f32800af040 tx=0x7f3280019780 comp rx=0 tx=0).stop 2023-06-02T15:30:31.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 -- 172.21.15.78:0/3348589434 shutdown_connections 2023-06-02T15:30:31.524 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f32880bde60 0x7f3288146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3268065b70 0x7f3268068020 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880bc7e0 0x7f3288143990 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 --2- 172.21.15.78:0/3348589434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3288069b00 0x7f3288143450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 -- 172.21.15.78:0/3348589434 >> 172.21.15.78:0/3348589434 conn(0x7f32880a3280 msgr2=0x7f3288158850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:31.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 -- 172.21.15.78:0/3348589434 shutdown_connections 2023-06-02T15:30:31.525 INFO:teuthology.misc.health.smithi078.stderr:2023-06-02T15:30:31.515+0000 7f328ca00640 1 -- 172.21.15.78:0/3348589434 wait complete. 2023-06-02T15:30:31.537 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-06-02T15:30:31.538 INFO:tasks.ceph:Creating RBD pool 2023-06-02T15:30:31.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool create rbd 8 2023-06-02T15:30:31.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1f59ee640 1 Processor -- start 2023-06-02T15:30:31.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1f59ee640 1 -- start start 2023-06-02T15:30:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1f59ee640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1f014eaa0 0x7fe1f014f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1f59ee640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1f00bd950 0x7fe1f00bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1f59ee640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f006dac0 con 0x7fe1f006e1f0 2023-06-02T15:30:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1f59ee640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f014f770 con 0x7fe1f014eaa0 2023-06-02T15:30:31.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1f59ee640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f006dda0 con 0x7fe1f00bd950 2023-06-02T15:30:31.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1ee7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe1f006e1f0 0x7fe1f0148570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33024/0 (socket says 172.21.15.78:33024) 2023-06-02T15:30:31.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1eeffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1f014eaa0 0x7fe1f014f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1ee7fc640 1 -- 172.21.15.78:0/378537072 learned_addr learned my addr 172.21.15.78:0/378537072 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:31.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1eeffd640 1 -- 172.21.15.78:0/378537072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1f00bd950 msgr2=0x7fe1f00bdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:31.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1ef7fe640 1 --2- 172.21.15.78:0/378537072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1f00bd950 0x7fe1f00bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1edffb640 1 -- 172.21.15.78:0/378537072 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320885281 0 0) 0x7fe1f006dac0 con 0x7fe1f006e1f0 2023-06-02T15:30:31.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1eeffd640 1 --2- 172.21.15.78:0/378537072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1f00bd950 0x7fe1f00bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1eeffd640 1 -- 172.21.15.78:0/378537072 >> v1:172.21.15.78:6789/0 conn(0x7fe1f006e1f0 legacy=0x7fe1f0148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:31.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1eeffd640 1 -- 172.21.15.78:0/378537072 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00bd430 con 0x7fe1f014eaa0 2023-06-02T15:30:31.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1eeffd640 1 --2- 172.21.15.78:0/378537072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f014eaa0 0x7fe1f014f230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097c0 tx=0x7fe1e001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b966c4ab2e66f1a server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1edffb640 1 -- 172.21.15.78:0/378537072 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00a6040 con 0x7fe1f014eaa0 2023-06-02T15:30:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.647+0000 7fe1edffb640 1 -- 172.21.15.78:0/378537072 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e00aa600 con 0x7fe1f014eaa0 2023-06-02T15:30:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1edffb640 1 -- 172.21.15.78:0/378537072 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e00aa990 con 0x7fe1f014eaa0 2023-06-02T15:30:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- 172.21.15.78:0/378537072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f014eaa0 msgr2=0x7fe1f014f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 --2- 172.21.15.78:0/378537072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f014eaa0 0x7fe1f014f230 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00097c0 tx=0x7fe1e001c480 comp rx=0 tx=0).stop 2023-06-02T15:30:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- 172.21.15.78:0/378537072 shutdown_connections 2023-06-02T15:30:31.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 --2- 172.21.15.78:0/378537072 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1f00bd950 0x7fe1f00bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 --2- 172.21.15.78:0/378537072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f014eaa0 0x7fe1f014f230 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- 172.21.15.78:0/378537072 >> 172.21.15.78:0/378537072 conn(0x7fe1f00a3180 msgr2=0x7fe1f00a3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- 172.21.15.78:0/378537072 shutdown_connections 2023-06-02T15:30:31.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- 172.21.15.78:0/378537072 wait complete. 2023-06-02T15:30:31.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 Processor -- start 2023-06-02T15:30:31.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- start start 2023-06-02T15:30:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f006e1f0 0x7fe1f0141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f00bd950 0x7fe1f01425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1f014eaa0 0x7fe1f0144f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0140450 con 0x7fe1f00bd950 2023-06-02T15:30:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f01454a0 con 0x7fe1f006e1f0 2023-06-02T15:30:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0147860 con 0x7fe1f014eaa0 2023-06-02T15:30:31.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1ee7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f00bd950 0x7fe1f01425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1ee7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f00bd950 0x7fe1f01425a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50158/0 (socket says 172.21.15.78:50158) 2023-06-02T15:30:31.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1ee7fc640 1 -- 172.21.15.78:0/4261699618 learned_addr learned my addr 172.21.15.78:0/4261699618 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:31.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1ee7fc640 1 -- 172.21.15.78:0/4261699618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1f014eaa0 msgr2=0x7fe1f0144f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:31.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1ee7fc640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1f014eaa0 0x7fe1f0144f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1eeffd640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f006e1f0 0x7fe1f0141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1ee7fc640 1 -- 172.21.15.78:0/4261699618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f006e1f0 msgr2=0x7fe1f0141ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:31.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1ee7fc640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f006e1f0 0x7fe1f0141ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:31.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1ee7fc640 1 -- 172.21.15.78:0/4261699618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e0009420 con 0x7fe1f00bd950 2023-06-02T15:30:31.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1ee7fc640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f00bd950 0x7fe1f01425a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40011f0 tx=0x7fe1e400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:31.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1d7fff640 1 -- 172.21.15.78:0/4261699618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e40074e0 con 0x7fe1f00bd950 2023-06-02T15:30:31.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1d7fff640 1 -- 172.21.15.78:0/4261699618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e4007640 con 0x7fe1f00bd950 2023-06-02T15:30:31.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- 172.21.15.78:0/4261699618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f0158520 con 0x7fe1f00bd950 2023-06-02T15:30:31.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1d7fff640 1 -- 172.21.15.78:0/4261699618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e4004a10 con 0x7fe1f00bd950 2023-06-02T15:30:31.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- 172.21.15.78:0/4261699618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f0158390 con 0x7fe1f00bd950 2023-06-02T15:30:31.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.651+0000 7fe1f59ee640 1 -- 172.21.15.78:0/4261699618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f01586b0 con 0x7fe1f00bd950 2023-06-02T15:30:31.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.655+0000 7fe1d7fff640 1 -- 172.21.15.78:0/4261699618 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7fe1e4004b70 con 0x7fe1f00bd950 2023-06-02T15:30:31.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.655+0000 7fe1d7fff640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1dc065b70 0x7fe1dc068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:31.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.655+0000 7fe1d7fff640 1 -- 172.21.15.78:0/4261699618 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7fe1e4082160 con 0x7fe1f00bd950 2023-06-02T15:30:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.655+0000 7fe1eeffd640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1dc065b70 0x7fe1dc068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.655+0000 7fe1eeffd640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1dc065b70 0x7fe1dc068020 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00ae000 tx=0x7fe1e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:31.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.659+0000 7fe1d7fff640 1 -- 172.21.15.78:0/4261699618 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fe1e4050040 con 0x7fe1f00bd950 2023-06-02T15:30:31.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:31.803+0000 7fe1f59ee640 1 -- 172.21.15.78:0/4261699618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fe1f00bc580 con 0x7fe1f00bd950 2023-06-02T15:30:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.391+0000 7fe1d7fff640 1 -- 172.21.15.78:0/4261699618 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v14) v1 ==== 109+0+0 (secure 0 0 0) 0x7fe1e4053660 con 0x7fe1f00bd950 2023-06-02T15:30:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'rbd' created 2023-06-02T15:30:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 -- 172.21.15.78:0/4261699618 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1dc065b70 msgr2=0x7fe1dc068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1dc065b70 0x7fe1dc068020 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00ae000 tx=0x7fe1e0008040 comp rx=0 tx=0).stop 2023-06-02T15:30:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 -- 172.21.15.78:0/4261699618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f00bd950 msgr2=0x7fe1f01425a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f00bd950 0x7fe1f01425a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40011f0 tx=0x7fe1e400c9b0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 -- 172.21.15.78:0/4261699618 shutdown_connections 2023-06-02T15:30:32.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe1f014eaa0 0x7fe1f0144f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1dc065b70 0x7fe1dc068020 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f00bd950 0x7fe1f01425a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 --2- 172.21.15.78:0/4261699618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f006e1f0 0x7fe1f0141ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 -- 172.21.15.78:0/4261699618 >> 172.21.15.78:0/4261699618 conn(0x7fe1f00a3180 msgr2=0x7fe1f00711f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 -- 172.21.15.78:0/4261699618 shutdown_connections 2023-06-02T15:30:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.395+0000 7fe1f59ee640 1 -- 172.21.15.78:0/4261699618 wait complete. 2023-06-02T15:30:32.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-06-02T15:30:32.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f299a643640 1 Processor -- start 2023-06-02T15:30:32.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f299a643640 1 -- start start 2023-06-02T15:30:32.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f299a643640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29940ba100 0x7f299414bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:32.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f299a643640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f299406a900 0x7f299406ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:32.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f299a643640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29940bbc10 0x7f29940bc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:32.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f299a643640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940ba910 con 0x7f299406a900 2023-06-02T15:30:32.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f299a643640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29940bb780 con 0x7f29940bbc10 2023-06-02T15:30:32.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f299a643640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299414c100 con 0x7f29940ba100 2023-06-02T15:30:32.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f29937fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f299406a900 0x7f299406ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:32.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f29937fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f299406a900 0x7f299406ad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50170/0 (socket says 172.21.15.78:50170) 2023-06-02T15:30:32.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f29937fe640 1 -- 172.21.15.78:0/404315971 learned_addr learned my addr 172.21.15.78:0/404315971 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:32.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f2993fff640 1 --2- 172.21.15.78:0/404315971 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29940ba100 0x7f299414bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:32.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f29937fe640 1 -- 172.21.15.78:0/404315971 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29940ba100 msgr2=0x7f299414bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:32.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f29937fe640 1 --2- 172.21.15.78:0/404315971 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29940ba100 0x7f299414bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f29937fe640 1 -- 172.21.15.78:0/404315971 >> v2:172.21.15.132:3300/0 conn(0x7f29940bbc10 msgr2=0x7f29940bc080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-02T15:30:32.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f29937fe640 1 --2- 172.21.15.78:0/404315971 >> v2:172.21.15.132:3300/0 conn(0x7f29940bbc10 0x7f29940bc080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.535+0000 7f29937fe640 1 -- 172.21.15.78:0/404315971 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29940bb120 con 0x7f299406a900 2023-06-02T15:30:32.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f29937fe640 1 --2- 172.21.15.78:0/404315971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f299406a900 0x7f299406ad10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f29940bb310 tx=0x7f298801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6616c2bf287872b server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:32.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f2992ffd640 1 -- 172.21.15.78:0/404315971 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880a89d0 con 0x7f299406a900 2023-06-02T15:30:32.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f2992ffd640 1 -- 172.21.15.78:0/404315971 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29880a8b30 con 0x7f299406a900 2023-06-02T15:30:32.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f2992ffd640 1 -- 172.21.15.78:0/404315971 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880b0440 con 0x7f299406a900 2023-06-02T15:30:32.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 -- 172.21.15.78:0/404315971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f299406a900 msgr2=0x7f299406ad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:32.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 --2- 172.21.15.78:0/404315971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f299406a900 0x7f299406ad10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f29940bb310 tx=0x7f298801ed10 comp rx=0 tx=0).stop 2023-06-02T15:30:32.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 -- 172.21.15.78:0/404315971 shutdown_connections 2023-06-02T15:30:32.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 --2- 172.21.15.78:0/404315971 >> v2:172.21.15.132:3300/0 conn(0x7f29940bbc10 0x7f29940bc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 --2- 172.21.15.78:0/404315971 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f299406a900 0x7f299406ad10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 --2- 172.21.15.78:0/404315971 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29940ba100 0x7f299414bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 -- 172.21.15.78:0/404315971 >> 172.21.15.78:0/404315971 conn(0x7f29940bd750 msgr2=0x7f29940bdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:32.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 -- 172.21.15.78:0/404315971 shutdown_connections 2023-06-02T15:30:32.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 -- 172.21.15.78:0/404315971 wait complete. 2023-06-02T15:30:32.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 Processor -- start 2023-06-02T15:30:32.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.539+0000 7f299a643640 1 -- start start 2023-06-02T15:30:32.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f299a643640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299406a900 0x7f29941d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:32.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f299a643640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29940ba100 0x7f299414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:32.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f299a643640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29940bbc10 0x7f29940b86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:32.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f299a643640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29940b8280 con 0x7f29940bbc10 2023-06-02T15:30:32.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f299a643640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f299414d630 con 0x7f299406a900 2023-06-02T15:30:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f299a643640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29941d5720 con 0x7f29940ba100 2023-06-02T15:30:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2998be0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29940bbc10 0x7f29940b86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2998be0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29940bbc10 0x7f29940b86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50180/0 (socket says 172.21.15.78:50180) 2023-06-02T15:30:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2998be0640 1 -- 172.21.15.78:0/812868717 learned_addr learned my addr 172.21.15.78:0/812868717 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2993fff640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299406a900 0x7f29941d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f29937fe640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29940ba100 0x7f299414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2998be0640 1 -- 172.21.15.78:0/812868717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29940ba100 msgr2=0x7f299414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2998be0640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29940ba100 0x7f299414d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2998be0640 1 -- 172.21.15.78:0/812868717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299406a900 msgr2=0x7f29941d5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2998be0640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299406a900 0x7f29941d5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2998be0640 1 -- 172.21.15.78:0/812868717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29880094d0 con 0x7f29940bbc10 2023-06-02T15:30:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2998be0640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29940bbc10 0x7f29940b86d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f298c00ba10 tx=0x7f298c00bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2990ff9640 1 -- 172.21.15.78:0/812868717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c00cba0 con 0x7f29940bbc10 2023-06-02T15:30:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2990ff9640 1 -- 172.21.15.78:0/812868717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298c00cd00 con 0x7f29940bbc10 2023-06-02T15:30:32.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f299a643640 1 -- 172.21.15.78:0/812868717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29940bab60 con 0x7f29940bbc10 2023-06-02T15:30:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2990ff9640 1 -- 172.21.15.78:0/812868717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298c014680 con 0x7f29940bbc10 2023-06-02T15:30:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f299a643640 1 -- 172.21.15.78:0/812868717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29940ba4d0 con 0x7f29940bbc10 2023-06-02T15:30:32.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f299a643640 1 -- 172.21.15.78:0/812868717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29940bae40 con 0x7f29940bbc10 2023-06-02T15:30:32.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2990ff9640 1 -- 172.21.15.78:0/812868717 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7f298c01c360 con 0x7f29940bbc10 2023-06-02T15:30:32.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2990ff9640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2980065ba0 0x7f2980068050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:32.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2993fff640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2980065ba0 0x7f2980068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:32.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2990ff9640 1 -- 172.21.15.78:0/812868717 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4813+0+0 (secure 0 0 0) 0x7f298c0827b0 con 0x7f29940bbc10 2023-06-02T15:30:32.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.543+0000 7f2993fff640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2980065ba0 0x7f2980068050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f298400a970 tx=0x7f2984008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:32.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.547+0000 7f2990ff9640 1 -- 172.21.15.78:0/812868717 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f298c0505d0 con 0x7f29940bbc10 2023-06-02T15:30:32.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:32.691+0000 7f299a643640 1 -- 172.21.15.78:0/812868717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2994066d20 con 0x7f29940bbc10 2023-06-02T15:30:33.405 INFO:teuthology.orchestra.run.smithi078.stderr:enabled application 'rbd' on pool 'rbd' 2023-06-02T15:30:33.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.395+0000 7f2990ff9640 1 -- 172.21.15.78:0/812868717 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v15) v1 ==== 173+0+0 (secure 0 0 0) 0x7f298c053bf0 con 0x7f29940bbc10 2023-06-02T15:30:33.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.399+0000 7f299a643640 1 -- 172.21.15.78:0/812868717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2980065ba0 msgr2=0x7f2980068050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.399+0000 7f299a643640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2980065ba0 0x7f2980068050 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f298400a970 tx=0x7f2984008040 comp rx=0 tx=0).stop 2023-06-02T15:30:33.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.399+0000 7f299a643640 1 -- 172.21.15.78:0/812868717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29940bbc10 msgr2=0x7f29940b86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.399+0000 7f299a643640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29940bbc10 0x7f29940b86d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f298c00ba10 tx=0x7f298c00bed0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.403+0000 7f299a643640 1 -- 172.21.15.78:0/812868717 shutdown_connections 2023-06-02T15:30:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.403+0000 7f299a643640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2980065ba0 0x7f2980068050 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.403+0000 7f299a643640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f29940bbc10 0x7f29940b86d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.403+0000 7f299a643640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f29940ba100 0x7f299414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.403+0000 7f299a643640 1 --2- 172.21.15.78:0/812868717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f299406a900 0x7f29941d5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.403+0000 7f299a643640 1 -- 172.21.15.78:0/812868717 >> 172.21.15.78:0/812868717 conn(0x7f29940bd750 msgr2=0x7f299406fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:33.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.403+0000 7f299a643640 1 -- 172.21.15.78:0/812868717 shutdown_connections 2023-06-02T15:30:33.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.403+0000 7f299a643640 1 -- 172.21.15.78:0/812868717 wait complete. 2023-06-02T15:30:33.430 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-06-02T15:30:33.430 INFO:tasks.ceph.mds.a:Restarting daemon 2023-06-02T15:30:33.431 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-06-02T15:30:33.433 INFO:tasks.ceph.mds.a:Started 2023-06-02T15:30:33.433 INFO:tasks.ceph.mds.c:Restarting daemon 2023-06-02T15:30:33.433 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-06-02T15:30:33.435 INFO:tasks.ceph.mds.c:Started 2023-06-02T15:30:33.436 INFO:tasks.ceph.mds.b:Restarting daemon 2023-06-02T15:30:33.436 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-06-02T15:30:33.438 INFO:tasks.ceph.mds.b:Started 2023-06-02T15:30:33.439 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-06-02T15:30:33.439 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:33.506 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-06-02T15:30:33.506 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-06-02T15:30:33.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f902ea5f640 1 Processor -- start 2023-06-02T15:30:33.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f902ea5f640 1 -- start start 2023-06-02T15:30:33.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f902ea5f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f902814a190 0x7f90280be780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f902ea5f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280becc0 0x7f9028157020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f902ea5f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90280b4c90 con 0x7f9028149dc0 2023-06-02T15:30:33.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f902ea5f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90280bc7b0 con 0x7f902814a190 2023-06-02T15:30:33.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f902ea5f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90281504f0 con 0x7f90280becc0 2023-06-02T15:30:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f901f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f902814a190 0x7f90280be780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f9027fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9028149dc0 0x7f902814fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33052/0 (socket says 172.21.15.78:33052) 2023-06-02T15:30:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f9027fff640 1 -- 172.21.15.78:0/2665605727 learned_addr learned my addr 172.21.15.78:0/2665605727 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:33.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f902cffc640 1 --2- 172.21.15.78:0/2665605727 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280becc0 0x7f9028157020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f901f7fe640 1 -- 172.21.15.78:0/2665605727 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280becc0 msgr2=0x7f9028157020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f901f7fe640 1 --2- 172.21.15.78:0/2665605727 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280becc0 0x7f9028157020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f901f7fe640 1 -- 172.21.15.78:0/2665605727 >> v1:172.21.15.78:6789/0 conn(0x7f9028149dc0 legacy=0x7f902814fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f901f7fe640 1 -- 172.21.15.78:0/2665605727 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90280bc0a0 con 0x7f902814a190 2023-06-02T15:30:33.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f901f7fe640 1 --2- 172.21.15.78:0/2665605727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 0x7f90280be780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f90100097c0 tx=0x7f901001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4be0d4f5ff60ab server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f90277fe640 1 -- 172.21.15.78:0/2665605727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100ab600 con 0x7f902814a190 2023-06-02T15:30:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f90277fe640 1 -- 172.21.15.78:0/2665605727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90100a7050 con 0x7f902814a190 2023-06-02T15:30:33.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f90277fe640 1 -- 172.21.15.78:0/2665605727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90100ab980 con 0x7f902814a190 2023-06-02T15:30:33.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f902ea5f640 1 -- 172.21.15.78:0/2665605727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 msgr2=0x7f90280be780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.543+0000 7f902ea5f640 1 --2- 172.21.15.78:0/2665605727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 0x7f90280be780 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f90100097c0 tx=0x7f901001c3f0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 -- 172.21.15.78:0/2665605727 shutdown_connections 2023-06-02T15:30:33.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 --2- 172.21.15.78:0/2665605727 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280becc0 0x7f9028157020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 --2- 172.21.15.78:0/2665605727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 0x7f90280be780 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 -- 172.21.15.78:0/2665605727 >> 172.21.15.78:0/2665605727 conn(0x7f90280c2240 msgr2=0x7f90280be070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:33.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 -- 172.21.15.78:0/2665605727 shutdown_connections 2023-06-02T15:30:33.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 -- 172.21.15.78:0/2665605727 wait complete. 2023-06-02T15:30:33.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 Processor -- start 2023-06-02T15:30:33.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 -- start start 2023-06-02T15:30:33.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280becc0 0x7f9028143f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9028149dc0 0x7f90280c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 0x7f90280c0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90280b4880 con 0x7f902814a190 2023-06-02T15:30:33.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902814f4b0 con 0x7f9028149dc0 2023-06-02T15:30:33.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902ea5f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90280c1190 con 0x7f90280becc0 2023-06-02T15:30:33.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902cffc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 0x7f90280c0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902cffc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 0x7f90280c0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50222/0 (socket says 172.21.15.78:50222) 2023-06-02T15:30:33.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902cffc640 1 -- 172.21.15.78:0/2373131838 learned_addr learned my addr 172.21.15.78:0/2373131838 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:33.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f9027fff640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280becc0 0x7f9028143f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f901f7fe640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9028149dc0 0x7f90280c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902cffc640 1 -- 172.21.15.78:0/2373131838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280becc0 msgr2=0x7f9028143f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902cffc640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280becc0 0x7f9028143f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902cffc640 1 -- 172.21.15.78:0/2373131838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9028149dc0 msgr2=0x7f90280c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902cffc640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9028149dc0 0x7f90280c0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902cffc640 1 -- 172.21.15.78:0/2373131838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9010009420 con 0x7f902814a190 2023-06-02T15:30:33.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.547+0000 7f902cffc640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 0x7f90280c0c50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f902000cc30 tx=0x7f902000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:33.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f90257fa640 1 -- 172.21.15.78:0/2373131838 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902000ce40 con 0x7f902814a190 2023-06-02T15:30:33.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f90257fa640 1 -- 172.21.15.78:0/2373131838 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90200039a0 con 0x7f902814a190 2023-06-02T15:30:33.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f90257fa640 1 -- 172.21.15.78:0/2373131838 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020003d30 con 0x7f902814a190 2023-06-02T15:30:33.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f902ea5f640 1 -- 172.21.15.78:0/2373131838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90280b8510 con 0x7f902814a190 2023-06-02T15:30:33.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f902ea5f640 1 -- 172.21.15.78:0/2373131838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90280b8380 con 0x7f902814a190 2023-06-02T15:30:33.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f902ea5f640 1 -- 172.21.15.78:0/2373131838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9028141640 con 0x7f902814a190 2023-06-02T15:30:33.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f90257fa640 1 -- 172.21.15.78:0/2373131838 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7f9020003e90 con 0x7f902814a190 2023-06-02T15:30:33.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f90257fa640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9008065ba0 0x7f9008068050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f90257fa640 1 -- 172.21.15.78:0/2373131838 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f9020083250 con 0x7f902814a190 2023-06-02T15:30:33.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f9027fff640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9008065ba0 0x7f9008068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.551+0000 7f9027fff640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9008065ba0 0x7f9008068050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9018005890 tx=0x7f9018009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:33.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.555+0000 7f90257fa640 1 -- 172.21.15.78:0/2373131838 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f9020050e60 con 0x7f902814a190 2023-06-02T15:30:33.613 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-06-02T15:30:33.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.703+0000 7f902ea5f640 1 -- 172.21.15.78:0/2373131838 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f902806e5b0 con 0x7f902814a190 2023-06-02T15:30:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f90257fa640 1 -- 172.21.15.78:0/2373131838 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+14129 (secure 0 0 0) 0x7f9020054480 con 0x7f902814a190 2023-06-02T15:30:33.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:33.715 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":15,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:33.390390+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:33.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 -- 172.21.15.78:0/2373131838 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9008065ba0 msgr2=0x7f9008068050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9008065ba0 0x7f9008068050 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9018005890 tx=0x7f9018009040 comp rx=0 tx=0).stop 2023-06-02T15:30:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 -- 172.21.15.78:0/2373131838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 msgr2=0x7f90280c0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 0x7f90280c0c50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f902000cc30 tx=0x7f902000a5c0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 -- 172.21.15.78:0/2373131838 shutdown_connections 2023-06-02T15:30:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9008065ba0 0x7f9008068050 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f902814a190 0x7f90280c0c50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9028149dc0 0x7f90280c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 --2- 172.21.15.78:0/2373131838 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f90280becc0 0x7f9028143f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 -- 172.21.15.78:0/2373131838 >> 172.21.15.78:0/2373131838 conn(0x7f90280c2240 msgr2=0x7f902814a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 -- 172.21.15.78:0/2373131838 shutdown_connections 2023-06-02T15:30:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.707+0000 7f902ea5f640 1 -- 172.21.15.78:0/2373131838 wait complete. 2023-06-02T15:30:33.731 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-02T15:30:31.844882+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-02T15:30:33.293644+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-02T15:30:33.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-02T15:30:33.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f6965711640 1 Processor -- start 2023-06-02T15:30:33.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f6965711640 1 -- start start 2023-06-02T15:30:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f6965711640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69600c0570 0x7f69600ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f6965711640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69601485c0 0x7f6960148a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f6965711640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69600a5f30 con 0x7f6960071780 2023-06-02T15:30:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f6965711640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69600c1100 con 0x7f69601485c0 2023-06-02T15:30:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f6965711640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696014bcc0 con 0x7f69600c0570 2023-06-02T15:30:33.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f6957fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6960071780 0x7f69600bc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44622/0 (socket says 172.21.15.78:44622) 2023-06-02T15:30:33.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f6957fff640 1 -- 172.21.15.78:0/4090611982 learned_addr learned my addr 172.21.15.78:0/4090611982 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:33.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695effd640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69600c0570 0x7f69600ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695f7fe640 1 --2- 172.21.15.78:0/4090611982 >> v2:172.21.15.132:3300/0 conn(0x7f69601485c0 0x7f6960148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802508365 0 0) 0x7f69600a5f30 con 0x7f6960071780 2023-06-02T15:30:33.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f694c003530 con 0x7f6960071780 2023-06-02T15:30:33.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3992696076 0 0) 0x7f694c003530 con 0x7f6960071780 2023-06-02T15:30:33.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69600c0570 msgr2=0x7f69600ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:33.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69600c0570 0x7f69600ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 >> v2:172.21.15.132:3300/0 conn(0x7f69601485c0 msgr2=0x7f6960148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:33.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 --2- 172.21.15.78:0/4090611982 >> v2:172.21.15.132:3300/0 conn(0x7f69601485c0 0x7f6960148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696014bfa0 con 0x7f6960071780 2023-06-02T15:30:33.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f6948001680 con 0x7f6960071780 2023-06-02T15:30:33.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 >> v1:172.21.15.78:6789/0 conn(0x7f6960071780 legacy=0x7f69600bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69600c0570 0x7f694c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f694c003f70 0x7f694c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f694c004d10 0x7f694c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696014bcc0 con 0x7f694c004d10 2023-06-02T15:30:33.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694c00b9c0 con 0x7f694c003f70 2023-06-02T15:30:33.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f694c00bb80 con 0x7f69600c0570 2023-06-02T15:30:33.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695f7fe640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f694c004d10 0x7f694c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f6957fff640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f694c003f70 0x7f694c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695effd640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69600c0570 0x7f694c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695f7fe640 1 -- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69600c0570 msgr2=0x7f694c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:33.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695f7fe640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69600c0570 0x7f694c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695f7fe640 1 -- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f694c003f70 msgr2=0x7f694c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:33.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695f7fe640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f694c003f70 0x7f694c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.847+0000 7f695f7fe640 1 -- 172.21.15.78:0/4090611982 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c003530 con 0x7f694c004d10 2023-06-02T15:30:33.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f695f7fe640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f694c004d10 0x7f694c005180 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6958009f90 tx=0x7f695801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb5559a3f38e3677 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:33.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69580a5b60 con 0x7f694c004d10 2023-06-02T15:30:33.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695800f040 con 0x7f694c004d10 2023-06-02T15:30:33.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f695e7fc640 1 -- 172.21.15.78:0/4090611982 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69580ad440 con 0x7f694c004d10 2023-06-02T15:30:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 -- 172.21.15.78:0/4090611982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f694c004d10 msgr2=0x7f694c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 --2- 172.21.15.78:0/4090611982 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f694c004d10 0x7f694c005180 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6958009f90 tx=0x7f695801cc60 comp rx=0 tx=0).stop 2023-06-02T15:30:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f695f7fe640 1 -- 172.21.15.78:0/4090611982 reap_dead start 2023-06-02T15:30:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 -- 172.21.15.78:0/4090611982 shutdown_connections 2023-06-02T15:30:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 -- 172.21.15.78:0/4090611982 >> 172.21.15.78:0/4090611982 conn(0x7f69600a2170 msgr2=0x7f69600a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 -- 172.21.15.78:0/4090611982 shutdown_connections 2023-06-02T15:30:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 -- 172.21.15.78:0/4090611982 wait complete. 2023-06-02T15:30:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 Processor -- start 2023-06-02T15:30:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 -- start start 2023-06-02T15:30:33.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f694c004d10 0x7f69600bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69600bfdc0 0x7f696006c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69600bdf50 0x7f69600b9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696006c710 con 0x7f69600bfdc0 2023-06-02T15:30:33.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69600bf700 con 0x7f69600bdf50 2023-06-02T15:30:33.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6965711640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69601e1bf0 con 0x7f694c004d10 2023-06-02T15:30:33.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6957fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69600bfdc0 0x7f696006c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6957fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69600bfdc0 0x7f696006c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40662/0 (socket says 172.21.15.78:40662) 2023-06-02T15:30:33.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f6957fff640 1 -- 172.21.15.78:0/740315377 learned_addr learned my addr 172.21.15.78:0/740315377 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:33.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.851+0000 7f695effd640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f694c004d10 0x7f69600bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f695f7fe640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69600bdf50 0x7f69600b9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f6957fff640 1 -- 172.21.15.78:0/740315377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f694c004d10 msgr2=0x7f69600bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f6957fff640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f694c004d10 0x7f69600bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f6957fff640 1 -- 172.21.15.78:0/740315377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69600bdf50 msgr2=0x7f69600b9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:33.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f6957fff640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69600bdf50 0x7f69600b9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:33.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f6957fff640 1 -- 172.21.15.78:0/740315377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69600c0940 con 0x7f69600bfdc0 2023-06-02T15:30:33.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f6957fff640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69600bfdc0 0x7f696006c1d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6948011810 tx=0x7f6948011cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:33.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f69577fe640 1 -- 172.21.15.78:0/740315377 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694801a030 con 0x7f69600bfdc0 2023-06-02T15:30:33.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f69577fe640 1 -- 172.21.15.78:0/740315377 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694800fb60 con 0x7f69600bfdc0 2023-06-02T15:30:33.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f6965711640 1 -- 172.21.15.78:0/740315377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69600a61a0 con 0x7f69600bfdc0 2023-06-02T15:30:33.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f69577fe640 1 -- 172.21.15.78:0/740315377 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948015410 con 0x7f69600bfdc0 2023-06-02T15:30:33.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f6965711640 1 -- 172.21.15.78:0/740315377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69600c0ad0 con 0x7f69600bfdc0 2023-06-02T15:30:33.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f6965711640 1 -- 172.21.15.78:0/740315377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69600bfb80 con 0x7f69600bfdc0 2023-06-02T15:30:33.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f69577fe640 1 -- 172.21.15.78:0/740315377 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7f694801d070 con 0x7f69600bfdc0 2023-06-02T15:30:33.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f69577fe640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6940065b70 0x7f6940068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:33.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f69577fe640 1 -- 172.21.15.78:0/740315377 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f694801b070 con 0x7f69600bfdc0 2023-06-02T15:30:33.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f695effd640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6940065b70 0x7f6940068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:33.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.855+0000 7f695effd640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6940065b70 0x7f6940068020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6950009ae0 tx=0x7f6950008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:33.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:33.859+0000 7f69577fe640 1 -- 172.21.15.78:0/740315377 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f6948053a60 con 0x7f69600bfdc0 2023-06-02T15:30:34.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 -- 172.21.15.78:0/740315377 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6960073bc0 con 0x7f69600bfdc0 2023-06-02T15:30:34.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f69577fe640 1 -- 172.21.15.78:0/740315377 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6948001580 con 0x7f69600bfdc0 2023-06-02T15:30:34.010 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-02T15:30:34.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 -- 172.21.15.78:0/740315377 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6940065b70 msgr2=0x7f6940068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6940065b70 0x7f6940068020 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6950009ae0 tx=0x7f6950008040 comp rx=0 tx=0).stop 2023-06-02T15:30:34.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 -- 172.21.15.78:0/740315377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69600bfdc0 msgr2=0x7f696006c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69600bfdc0 0x7f696006c1d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6948011810 tx=0x7f6948011cd0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 -- 172.21.15.78:0/740315377 shutdown_connections 2023-06-02T15:30:34.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69600bdf50 0x7f69600b9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6940065b70 0x7f6940068020 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69600bfdc0 0x7f696006c1d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 --2- 172.21.15.78:0/740315377 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f694c004d10 0x7f69600bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 -- 172.21.15.78:0/740315377 >> 172.21.15.78:0/740315377 conn(0x7f69600a2170 msgr2=0x7f69600a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:34.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 -- 172.21.15.78:0/740315377 shutdown_connections 2023-06-02T15:30:34.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.003+0000 7f6965711640 1 -- 172.21.15.78:0/740315377 wait complete. 2023-06-02T15:30:34.027 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-02T15:30:34.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.139+0000 7f28975e3640 1 Processor -- start 2023-06-02T15:30:34.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.139+0000 7f28975e3640 1 -- start start 2023-06-02T15:30:34.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f28975e3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28900c0570 0x7f28900ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f28975e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2890071780 0x7f28900bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f28975e3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28900a5f30 con 0x7f28901485c0 2023-06-02T15:30:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f28975e3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28900c1100 con 0x7f28900c0570 2023-06-02T15:30:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f28975e3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f289014bcc0 con 0x7f2890071780 2023-06-02T15:30:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f289537f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f28900c0570 0x7f28900ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f2895b80640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f28901485c0 0x7f289014e790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44634/0 (socket says 172.21.15.78:44634) 2023-06-02T15:30:34.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f2895b80640 1 -- 172.21.15.78:0/358443708 learned_addr learned my addr 172.21.15.78:0/358443708 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f2894b7e640 1 --2- 172.21.15.78:0/358443708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2890071780 0x7f28900bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f289537f640 1 -- 172.21.15.78:0/358443708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2890071780 msgr2=0x7f28900bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f289537f640 1 --2- 172.21.15.78:0/358443708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2890071780 0x7f28900bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f289537f640 1 -- 172.21.15.78:0/358443708 >> v1:172.21.15.78:6789/0 conn(0x7f28901485c0 legacy=0x7f289014e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f289537f640 1 -- 172.21.15.78:0/358443708 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f289014bfa0 con 0x7f28900c0570 2023-06-02T15:30:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f2894b7e640 1 --2- 172.21.15.78:0/358443708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2890071780 0x7f28900bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f289537f640 1 --2- 172.21.15.78:0/358443708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 0x7f28900ba640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f288c009dc0 tx=0x7f288c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c604685d8010f4 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f2887fff640 1 -- 172.21.15.78:0/358443708 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0a58d0 con 0x7f28900c0570 2023-06-02T15:30:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f2887fff640 1 -- 172.21.15.78:0/358443708 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288c0a5a30 con 0x7f28900c0570 2023-06-02T15:30:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f2887fff640 1 -- 172.21.15.78:0/358443708 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288c0a5dc0 con 0x7f28900c0570 2023-06-02T15:30:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f28975e3640 1 -- 172.21.15.78:0/358443708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 msgr2=0x7f28900ba640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.143+0000 7f28975e3640 1 --2- 172.21.15.78:0/358443708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 0x7f28900ba640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f288c009dc0 tx=0x7f288c01c900 comp rx=0 tx=0).stop 2023-06-02T15:30:34.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- 172.21.15.78:0/358443708 shutdown_connections 2023-06-02T15:30:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 --2- 172.21.15.78:0/358443708 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2890071780 0x7f28900bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 --2- 172.21.15.78:0/358443708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 0x7f28900ba640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- 172.21.15.78:0/358443708 >> 172.21.15.78:0/358443708 conn(0x7f28900a2170 msgr2=0x7f28900a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- 172.21.15.78:0/358443708 shutdown_connections 2023-06-02T15:30:34.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- 172.21.15.78:0/358443708 wait complete. 2023-06-02T15:30:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 Processor -- start 2023-06-02T15:30:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- start start 2023-06-02T15:30:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2890071780 0x7f28900b9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 0x7f28900b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28901485c0 0x7f289014e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900b5920 con 0x7f28900c0570 2023-06-02T15:30:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28900bfec0 con 0x7f2890071780 2023-06-02T15:30:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28901e8f20 con 0x7f28901485c0 2023-06-02T15:30:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2894b7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 0x7f28900b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2894b7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 0x7f28900b53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40680/0 (socket says 172.21.15.78:40680) 2023-06-02T15:30:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2894b7e640 1 -- 172.21.15.78:0/1538708737 learned_addr learned my addr 172.21.15.78:0/1538708737 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f289537f640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2890071780 0x7f28900b9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2895b80640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28901485c0 0x7f289014e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2894b7e640 1 -- 172.21.15.78:0/1538708737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28901485c0 msgr2=0x7f289014e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2894b7e640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28901485c0 0x7f289014e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2894b7e640 1 -- 172.21.15.78:0/1538708737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2890071780 msgr2=0x7f28900b9ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2894b7e640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2890071780 0x7f28900b9ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2894b7e640 1 -- 172.21.15.78:0/1538708737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288c009a70 con 0x7f28900c0570 2023-06-02T15:30:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2894b7e640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 0x7f28900b53e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f288000c7c0 tx=0x7f288000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2885ffb640 1 -- 172.21.15.78:0/1538708737 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880007a30 con 0x7f28900c0570 2023-06-02T15:30:34.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2885ffb640 1 -- 172.21.15.78:0/1538708737 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2880007b90 con 0x7f28900c0570 2023-06-02T15:30:34.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- 172.21.15.78:0/1538708737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2890148dd0 con 0x7f28900c0570 2023-06-02T15:30:34.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f2885ffb640 1 -- 172.21.15.78:0/1538708737 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000ce70 con 0x7f28900c0570 2023-06-02T15:30:34.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- 172.21.15.78:0/1538708737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28900bc1e0 con 0x7f28900c0570 2023-06-02T15:30:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.147+0000 7f28975e3640 1 -- 172.21.15.78:0/1538708737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28900c0940 con 0x7f28900c0570 2023-06-02T15:30:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.151+0000 7f2885ffb640 1 -- 172.21.15.78:0/1538708737 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7f28800113f0 con 0x7f28900c0570 2023-06-02T15:30:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.151+0000 7f2885ffb640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2874065ba0 0x7f2874068050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.151+0000 7f2885ffb640 1 -- 172.21.15.78:0/1538708737 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f2880083370 con 0x7f28900c0570 2023-06-02T15:30:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.151+0000 7f289537f640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2874065ba0 0x7f2874068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.151+0000 7f289537f640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2874065ba0 0x7f2874068050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f288c0af000 tx=0x7f288c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.155+0000 7f2885ffb640 1 -- 172.21.15.78:0/1538708737 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f2880050f80 con 0x7f28900c0570 2023-06-02T15:30:34.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 -- 172.21.15.78:0/1538708737 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2890073bc0 con 0x7f28900c0570 2023-06-02T15:30:34.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f2885ffb640 1 -- 172.21.15.78:0/1538708737 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7f28800545a0 con 0x7f28900c0570 2023-06-02T15:30:34.310 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-02T15:30:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 -- 172.21.15.78:0/1538708737 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2874065ba0 msgr2=0x7f2874068050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2874065ba0 0x7f2874068050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f288c0af000 tx=0x7f288c0a7070 comp rx=0 tx=0).stop 2023-06-02T15:30:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 -- 172.21.15.78:0/1538708737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 msgr2=0x7f28900b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 0x7f28900b53e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f288000c7c0 tx=0x7f288000cc80 comp rx=0 tx=0).stop 2023-06-02T15:30:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 -- 172.21.15.78:0/1538708737 shutdown_connections 2023-06-02T15:30:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f28901485c0 0x7f289014e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2874065ba0 0x7f2874068050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28900c0570 0x7f28900b53e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 --2- 172.21.15.78:0/1538708737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2890071780 0x7f28900b9ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 -- 172.21.15.78:0/1538708737 >> 172.21.15.78:0/1538708737 conn(0x7f28900a2170 msgr2=0x7f28900a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 -- 172.21.15.78:0/1538708737 shutdown_connections 2023-06-02T15:30:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.303+0000 7f28975e3640 1 -- 172.21.15.78:0/1538708737 wait complete. 2023-06-02T15:30:34.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-02T15:30:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f639e02a640 1 Processor -- start 2023-06-02T15:30:34.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f639e02a640 1 -- start start 2023-06-02T15:30:34.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f639e02a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980bf2b0 0x7f63980bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f639e02a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63980b7fc0 0x7f63981521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f639e02a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63980c0730 con 0x7f639806bd00 2023-06-02T15:30:34.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f639e02a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639806b5f0 con 0x7f63980b7fc0 2023-06-02T15:30:34.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f639e02a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63980c04a0 con 0x7f63980bf2b0 2023-06-02T15:30:34.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f6397fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63980b7fc0 0x7f63981521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f6397fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63980b7fc0 0x7f63981521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40694/0 (socket says 172.21.15.78:40694) 2023-06-02T15:30:34.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f6397fff640 1 -- 172.21.15.78:0/1247500581 learned_addr learned my addr 172.21.15.78:0/1247500581 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:34.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f6396ffd640 1 --2- 172.21.15.78:0/1247500581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980bf2b0 0x7f63980bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f6397fff640 1 -- 172.21.15.78:0/1247500581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980bf2b0 msgr2=0x7f63980bff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:34.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f6397fff640 1 --2- 172.21.15.78:0/1247500581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980bf2b0 0x7f63980bff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f6397fff640 1 -- 172.21.15.78:0/1247500581 >> v1:172.21.15.132:6789/0 conn(0x7f639806bd00 legacy=0x7f6398069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:34.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f6397fff640 1 -- 172.21.15.78:0/1247500581 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63980c0b20 con 0x7f63980b7fc0 2023-06-02T15:30:34.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f6396ffd640 1 --2- 172.21.15.78:0/1247500581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980bf2b0 0x7f63980bff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:34.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f6397fff640 1 --2- 172.21.15.78:0/1247500581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980b7fc0 0x7f63981521c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6390009870 tx=0x7f639001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4429a3ae82cce875 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f63967fc640 1 -- 172.21.15.78:0/1247500581 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900a89b0 con 0x7f63980b7fc0 2023-06-02T15:30:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f63967fc640 1 -- 172.21.15.78:0/1247500581 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63900a8b10 con 0x7f63980b7fc0 2023-06-02T15:30:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.439+0000 7f63967fc640 1 -- 172.21.15.78:0/1247500581 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900a8ea0 con 0x7f63980b7fc0 2023-06-02T15:30:34.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- 172.21.15.78:0/1247500581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980b7fc0 msgr2=0x7f63981521c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 --2- 172.21.15.78:0/1247500581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980b7fc0 0x7f63981521c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6390009870 tx=0x7f639001ecf0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- 172.21.15.78:0/1247500581 shutdown_connections 2023-06-02T15:30:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 --2- 172.21.15.78:0/1247500581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980b7fc0 0x7f63981521c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 --2- 172.21.15.78:0/1247500581 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980bf2b0 0x7f63980bff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- 172.21.15.78:0/1247500581 >> 172.21.15.78:0/1247500581 conn(0x7f63980a6480 msgr2=0x7f63980a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:34.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- 172.21.15.78:0/1247500581 shutdown_connections 2023-06-02T15:30:34.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- 172.21.15.78:0/1247500581 wait complete. 2023-06-02T15:30:34.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 Processor -- start 2023-06-02T15:30:34.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- start start 2023-06-02T15:30:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f639806bd00 0x7f63981d3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980b7fc0 0x7f63980b8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bf2b0 0x7f63981d97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63981e4180 con 0x7f63980bf2b0 2023-06-02T15:30:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63981ce0f0 con 0x7f639806bd00 2023-06-02T15:30:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63980b89a0 con 0x7f63980b7fc0 2023-06-02T15:30:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f6397fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bf2b0 0x7f63981d97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f6397fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bf2b0 0x7f63981d97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40706/0 (socket says 172.21.15.78:40706) 2023-06-02T15:30:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f6397fff640 1 -- 172.21.15.78:0/1612126103 learned_addr learned my addr 172.21.15.78:0/1612126103 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f63977fe640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f639806bd00 0x7f63981d3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f6397fff640 1 -- 172.21.15.78:0/1612126103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980b7fc0 msgr2=0x7f63980b8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f6396ffd640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980b7fc0 0x7f63980b8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f6397fff640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980b7fc0 0x7f63980b8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f6397fff640 1 -- 172.21.15.78:0/1612126103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f639806bd00 msgr2=0x7f63981d3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f6397fff640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f639806bd00 0x7f63981d3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f6397fff640 1 -- 172.21.15.78:0/1612126103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63900094d0 con 0x7f63980bf2b0 2023-06-02T15:30:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f63977fe640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f639806bd00 0x7f63981d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f6397fff640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bf2b0 0x7f63981d97d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f639001d3a0 tx=0x7f639001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f637ffff640 1 -- 172.21.15.78:0/1612126103 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900b0e20 con 0x7f63980bf2b0 2023-06-02T15:30:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f637ffff640 1 -- 172.21.15.78:0/1612126103 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63900bb480 con 0x7f63980bf2b0 2023-06-02T15:30:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- 172.21.15.78:0/1612126103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63980c0d70 con 0x7f63980bf2b0 2023-06-02T15:30:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f637ffff640 1 -- 172.21.15.78:0/1612126103 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63900bb810 con 0x7f63980bf2b0 2023-06-02T15:30:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.443+0000 7f639e02a640 1 -- 172.21.15.78:0/1612126103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63980aa880 con 0x7f63980bf2b0 2023-06-02T15:30:34.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.447+0000 7f639e02a640 1 -- 172.21.15.78:0/1612126103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63980c1310 con 0x7f63980bf2b0 2023-06-02T15:30:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.447+0000 7f637ffff640 1 -- 172.21.15.78:0/1612126103 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7f63900bb970 con 0x7f63980bf2b0 2023-06-02T15:30:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.447+0000 7f637ffff640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6384065b70 0x7f6384068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.447+0000 7f63977fe640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6384065b70 0x7f6384068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.447+0000 7f637ffff640 1 -- 172.21.15.78:0/1612126103 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6390121500 con 0x7f63980bf2b0 2023-06-02T15:30:34.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.447+0000 7f63977fe640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6384065b70 0x7f6384068020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6388007fd0 tx=0x7f6388009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.451+0000 7f637ffff640 1 -- 172.21.15.78:0/1612126103 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f63900ef190 con 0x7f63980bf2b0 2023-06-02T15:30:34.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.651+0000 7f639e02a640 1 -- 172.21.15.78:0/1612126103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63980c1310 con 0x7f63980bf2b0 2023-06-02T15:30:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.651+0000 7f637ffff640 1 -- 172.21.15.78:0/1612126103 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2768 (secure 0 0 0) 0x7f63900f27b0 con 0x7f63980bf2b0 2023-06-02T15:30:34.659 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:34.659 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/4074209272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4074209272},{"type":"v1","addr":"172.21.15.78:6836","nonce":4074209272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/987093145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":987093145},{"type":"v1","addr":"172.21.15.78:6837","nonce":987093145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6833/3115859297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3115859297},{"type":"v1","addr":"172.21.15.132:6833","nonce":3115859297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-06-02T15:30:34.659 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2023-06-02T15:30:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.651+0000 7f639e02a640 1 -- 172.21.15.78:0/1612126103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6384065b70 msgr2=0x7f6384068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.651+0000 7f639e02a640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6384065b70 0x7f6384068020 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6388007fd0 tx=0x7f6388009040 comp rx=0 tx=0).stop 2023-06-02T15:30:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.655+0000 7f639e02a640 1 -- 172.21.15.78:0/1612126103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bf2b0 msgr2=0x7f63981d97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.655+0000 7f639e02a640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bf2b0 0x7f63981d97d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f639001d3a0 tx=0x7f639001ba90 comp rx=0 tx=0).stop 2023-06-02T15:30:34.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.655+0000 7f639e02a640 1 -- 172.21.15.78:0/1612126103 shutdown_connections 2023-06-02T15:30:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.655+0000 7f639e02a640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6384065b70 0x7f6384068020 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.655+0000 7f639e02a640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bf2b0 0x7f63981d97d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.655+0000 7f639e02a640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980b7fc0 0x7f63980b8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.655+0000 7f639e02a640 1 --2- 172.21.15.78:0/1612126103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f639806bd00 0x7f63981d3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.655+0000 7f639e02a640 1 -- 172.21.15.78:0/1612126103 >> 172.21.15.78:0/1612126103 conn(0x7f63980a6480 msgr2=0x7f63981d6520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.655+0000 7f639e02a640 1 -- 172.21.15.78:0/1612126103 shutdown_connections 2023-06-02T15:30:34.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.655+0000 7f639e02a640 1 -- 172.21.15.78:0/1612126103 wait complete. 2023-06-02T15:30:34.677 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:34.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc008abd640 1 Processor -- start 2023-06-02T15:30:34.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc008abd640 1 -- start start 2023-06-02T15:30:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc008abd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0040713b0 0x7fc00414b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc008abd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0040bb0e0 0x7fc00414bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc008abd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc0040bac60 0x7fc00414e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc008abd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0040709a0 con 0x7fc0040bb0e0 2023-06-02T15:30:34.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc008abd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc004070dc0 con 0x7fc0040bac60 2023-06-02T15:30:34.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc008abd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00414c180 con 0x7fc0040713b0 2023-06-02T15:30:34.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fbffbfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0040bb0e0 0x7fc00414bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fbffbfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc0040bb0e0 0x7fc00414bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40730/0 (socket says 172.21.15.78:40730) 2023-06-02T15:30:34.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fbffbfff640 1 -- 172.21.15.78:0/1244744910 learned_addr learned my addr 172.21.15.78:0/1244744910 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:34.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fbffbfff640 1 -- 172.21.15.78:0/1244744910 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0040713b0 msgr2=0x7fc00414b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc002d9d640 1 --2- 172.21.15.78:0/1244744910 >> v2:172.21.15.132:3300/0 conn(0x7fc0040bac60 0x7fc00414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc00259c640 1 --2- 172.21.15.78:0/1244744910 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0040713b0 0x7fc00414b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fbffbfff640 1 --2- 172.21.15.78:0/1244744910 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0040713b0 0x7fc00414b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fbffbfff640 1 -- 172.21.15.78:0/1244744910 >> v2:172.21.15.132:3300/0 conn(0x7fc0040bac60 msgr2=0x7fc00414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fbffbfff640 1 --2- 172.21.15.78:0/1244744910 >> v2:172.21.15.132:3300/0 conn(0x7fc0040bac60 0x7fc00414e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fbffbfff640 1 -- 172.21.15.78:0/1244744910 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004070070 con 0x7fc0040bb0e0 2023-06-02T15:30:34.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fbffbfff640 1 --2- 172.21.15.78:0/1244744910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bb0e0 0x7fc00414bc40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc0040a6bd0 tx=0x7fbfec01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7611848517e21ecc server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc001d9b640 1 -- 172.21.15.78:0/1244744910 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0aa5f0 con 0x7fc0040bb0e0 2023-06-02T15:30:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc001d9b640 1 -- 172.21.15.78:0/1244744910 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0aa750 con 0x7fc0040bb0e0 2023-06-02T15:30:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.787+0000 7fc001d9b640 1 -- 172.21.15.78:0/1244744910 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0aaae0 con 0x7fc0040bb0e0 2023-06-02T15:30:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- 172.21.15.78:0/1244744910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bb0e0 msgr2=0x7fc00414bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 --2- 172.21.15.78:0/1244744910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bb0e0 0x7fc00414bc40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc0040a6bd0 tx=0x7fbfec01c4d0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- 172.21.15.78:0/1244744910 shutdown_connections 2023-06-02T15:30:34.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 --2- 172.21.15.78:0/1244744910 >> v2:172.21.15.132:3300/0 conn(0x7fc0040bac60 0x7fc00414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 --2- 172.21.15.78:0/1244744910 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bb0e0 0x7fc00414bc40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 --2- 172.21.15.78:0/1244744910 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0040713b0 0x7fc00414b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- 172.21.15.78:0/1244744910 >> 172.21.15.78:0/1244744910 conn(0x7fc0040bd920 msgr2=0x7fc0040bdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:34.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- 172.21.15.78:0/1244744910 shutdown_connections 2023-06-02T15:30:34.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- 172.21.15.78:0/1244744910 wait complete. 2023-06-02T15:30:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 Processor -- start 2023-06-02T15:30:34.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- start start 2023-06-02T15:30:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0040713b0 0x7fc0041514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bac60 0x7fc004141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0040bb0e0 0x7fc00413f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc004146c70 con 0x7fc0040bac60 2023-06-02T15:30:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0041415d0 con 0x7fc0040713b0 2023-06-02T15:30:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc004150f90 con 0x7fc0040bb0e0 2023-06-02T15:30:34.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bac60 0x7fc004141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bac60 0x7fc004141090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40738/0 (socket says 172.21.15.78:40738) 2023-06-02T15:30:34.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffbfff640 1 -- 172.21.15.78:0/3086144036 learned_addr learned my addr 172.21.15.78:0/3086144036 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:34.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc00259c640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0040713b0 0x7fc0041514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc002d9d640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0040bb0e0 0x7fc00413f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffbfff640 1 -- 172.21.15.78:0/3086144036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0040bb0e0 msgr2=0x7fc00413f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffbfff640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0040bb0e0 0x7fc00413f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffbfff640 1 -- 172.21.15.78:0/3086144036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0040713b0 msgr2=0x7fc0041514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffbfff640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0040713b0 0x7fc0041514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffbfff640 1 -- 172.21.15.78:0/3086144036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec0094d0 con 0x7fc0040bac60 2023-06-02T15:30:34.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffbfff640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bac60 0x7fc004141090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0ac040 tx=0x7fbfec01ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:34.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffaffd640 1 -- 172.21.15.78:0/3086144036 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0b3800 con 0x7fc0040bac60 2023-06-02T15:30:34.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffaffd640 1 -- 172.21.15.78:0/3086144036 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec0b3960 con 0x7fc0040bac60 2023-06-02T15:30:34.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fbffaffd640 1 -- 172.21.15.78:0/3086144036 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec0b3d10 con 0x7fc0040bac60 2023-06-02T15:30:34.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- 172.21.15.78:0/3086144036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc004071910 con 0x7fc0040bac60 2023-06-02T15:30:34.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.791+0000 7fc008abd640 1 -- 172.21.15.78:0/3086144036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc004071780 con 0x7fc0040bac60 2023-06-02T15:30:34.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.795+0000 7fc008abd640 1 -- 172.21.15.78:0/3086144036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc004073bc0 con 0x7fc0040bac60 2023-06-02T15:30:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.795+0000 7fbffaffd640 1 -- 172.21.15.78:0/3086144036 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7fbfec0c73a0 con 0x7fc0040bac60 2023-06-02T15:30:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.795+0000 7fbffaffd640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbfe4065b70 0x7fbfe4068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.795+0000 7fbffaffd640 1 -- 172.21.15.78:0/3086144036 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fbfec0a7070 con 0x7fc0040bac60 2023-06-02T15:30:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.795+0000 7fc00259c640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbfe4065b70 0x7fbfe4068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:34.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.795+0000 7fc00259c640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbfe4065b70 0x7fbfe4068020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbff4006fd0 tx=0x7fbff4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:34.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.799+0000 7fbffaffd640 1 -- 172.21.15.78:0/3086144036 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fbfec0eb690 con 0x7fc0040bac60 2023-06-02T15:30:34.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.955+0000 7fc008abd640 1 -- 172.21.15.78:0/3086144036 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc00414e500 con 0x7fc0040bac60 2023-06-02T15:30:34.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.955+0000 7fbffaffd640 1 -- 172.21.15.78:0/3086144036 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+14124 (secure 0 0 0) 0x7fbfec0c3090 con 0x7fc0040bac60 2023-06-02T15:30:34.964 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:34.964 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:34.394000+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:34.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 -- 172.21.15.78:0/3086144036 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbfe4065b70 msgr2=0x7fbfe4068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbfe4065b70 0x7fbfe4068020 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbff4006fd0 tx=0x7fbff4008040 comp rx=0 tx=0).stop 2023-06-02T15:30:34.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 -- 172.21.15.78:0/3086144036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bac60 msgr2=0x7fc004141090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bac60 0x7fc004141090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbfec0ac040 tx=0x7fbfec01ad10 comp rx=0 tx=0).stop 2023-06-02T15:30:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 -- 172.21.15.78:0/3086144036 shutdown_connections 2023-06-02T15:30:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc0040bb0e0 0x7fc00413f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbfe4065b70 0x7fbfe4068020 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0040bac60 0x7fc004141090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 --2- 172.21.15.78:0/3086144036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0040713b0 0x7fc0041514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 -- 172.21.15.78:0/3086144036 >> 172.21.15.78:0/3086144036 conn(0x7fc0040bd920 msgr2=0x7fc00414b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 -- 172.21.15.78:0/3086144036 shutdown_connections 2023-06-02T15:30:34.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:34.959+0000 7fc008abd640 1 -- 172.21.15.78:0/3086144036 wait complete. 2023-06-02T15:30:34.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-02T15:30:31.844882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-02T15:30:33.293644+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-06-02T15:30:34.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-02T15:30:35.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.083+0000 7f59cf0e7640 1 Processor -- start 2023-06-02T15:30:35.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.083+0000 7f59cf0e7640 1 -- start start 2023-06-02T15:30:35.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59cf0e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c814c110 0x7f59c8151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59cf0e7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f59c80bea30 0x7f59c8152220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59cf0e7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c80be5f0 con 0x7f59c80c26c0 2023-06-02T15:30:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59cf0e7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c80be8d0 con 0x7f59c80bea30 2023-06-02T15:30:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59cf0e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80bc0b0 con 0x7f59c814c110 2023-06-02T15:30:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59c7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f59c80bea30 0x7f59c8152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59cd684640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f59c80c26c0 0x7f59c80c2b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44638/0 (socket says 172.21.15.78:44638) 2023-06-02T15:30:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59cd684640 1 -- 172.21.15.78:0/1880705750 learned_addr learned my addr 172.21.15.78:0/1880705750 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59cce83640 1 --2- 172.21.15.78:0/1880705750 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c814c110 0x7f59c8151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59c7fff640 1 -- 172.21.15.78:0/1880705750 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c814c110 msgr2=0x7f59c8151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:35.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59c7fff640 1 --2- 172.21.15.78:0/1880705750 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c814c110 0x7f59c8151ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59c7fff640 1 -- 172.21.15.78:0/1880705750 >> v1:172.21.15.78:6789/0 conn(0x7f59c80c26c0 legacy=0x7f59c80c2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59c7fff640 1 -- 172.21.15.78:0/1880705750 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80bbdd0 con 0x7f59c80bea30 2023-06-02T15:30:35.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59c77fe640 1 -- 172.21.15.78:0/1880705750 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202272708 0 0) 0x7f59c80be5f0 con 0x7f59c80c26c0 2023-06-02T15:30:35.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59c7fff640 1 --2- 172.21.15.78:0/1880705750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c80bea30 0x7f59c8152220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f59b40097c0 tx=0x7f59b401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d97c50637b1a763 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:35.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59c77fe640 1 -- 172.21.15.78:0/1880705750 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40ab600 con 0x7f59c80bea30 2023-06-02T15:30:35.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59c77fe640 1 -- 172.21.15.78:0/1880705750 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b40a7050 con 0x7f59c80bea30 2023-06-02T15:30:35.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.087+0000 7f59c77fe640 1 -- 172.21.15.78:0/1880705750 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b40ab980 con 0x7f59c80bea30 2023-06-02T15:30:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- 172.21.15.78:0/1880705750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c80bea30 msgr2=0x7f59c8152220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 --2- 172.21.15.78:0/1880705750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c80bea30 0x7f59c8152220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f59b40097c0 tx=0x7f59b401c3f0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- 172.21.15.78:0/1880705750 shutdown_connections 2023-06-02T15:30:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 --2- 172.21.15.78:0/1880705750 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c80bea30 0x7f59c8152220 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 --2- 172.21.15.78:0/1880705750 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c814c110 0x7f59c8151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- 172.21.15.78:0/1880705750 >> 172.21.15.78:0/1880705750 conn(0x7f59c80a5730 msgr2=0x7f59c80a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- 172.21.15.78:0/1880705750 shutdown_connections 2023-06-02T15:30:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- 172.21.15.78:0/1880705750 wait complete. 2023-06-02T15:30:35.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 Processor -- start 2023-06-02T15:30:35.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- start start 2023-06-02T15:30:35.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c80bea30 0x7f59c8148d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c80c26c0 0x7f59c8155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c814c110 0x7f59c81536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8146ad0 con 0x7f59c814c110 2023-06-02T15:30:35.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c8158290 con 0x7f59c80bea30 2023-06-02T15:30:35.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c81488f0 con 0x7f59c80c26c0 2023-06-02T15:30:35.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cd684640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c814c110 0x7f59c81536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cd684640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c814c110 0x7f59c81536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40762/0 (socket says 172.21.15.78:40762) 2023-06-02T15:30:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cd684640 1 -- 172.21.15.78:0/821098346 learned_addr learned my addr 172.21.15.78:0/821098346 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cce83640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c80bea30 0x7f59c8148d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59c7fff640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c80c26c0 0x7f59c8155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cd684640 1 -- 172.21.15.78:0/821098346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c80c26c0 msgr2=0x7f59c8155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cd684640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c80c26c0 0x7f59c8155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cd684640 1 -- 172.21.15.78:0/821098346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c80bea30 msgr2=0x7f59c8148d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cd684640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c80bea30 0x7f59c8148d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cd684640 1 -- 172.21.15.78:0/821098346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b4009420 con 0x7f59c814c110 2023-06-02T15:30:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cce83640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c80bea30 0x7f59c8148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cd684640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c814c110 0x7f59c81536b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f59c000c7a0 tx=0x7f59c000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59c57fa640 1 -- 172.21.15.78:0/821098346 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000a640 con 0x7f59c814c110 2023-06-02T15:30:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59c57fa640 1 -- 172.21.15.78:0/821098346 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59c000a7a0 con 0x7f59c814c110 2023-06-02T15:30:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- 172.21.15.78:0/821098346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c80718a0 con 0x7f59c814c110 2023-06-02T15:30:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59c57fa640 1 -- 172.21.15.78:0/821098346 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59c000abd0 con 0x7f59c814c110 2023-06-02T15:30:35.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- 172.21.15.78:0/821098346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c815b830 con 0x7f59c814c110 2023-06-02T15:30:35.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.091+0000 7f59cf0e7640 1 -- 172.21.15.78:0/821098346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c8148a60 con 0x7f59c814c110 2023-06-02T15:30:35.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.095+0000 7f59c57fa640 1 -- 172.21.15.78:0/821098346 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7f59c000ad30 con 0x7f59c814c110 2023-06-02T15:30:35.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.095+0000 7f59c57fa640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f59ac065b70 0x7f59ac068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.095+0000 7f59cce83640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f59ac065b70 0x7f59ac068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.095+0000 7f59c57fa640 1 -- 172.21.15.78:0/821098346 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f59c0082650 con 0x7f59c814c110 2023-06-02T15:30:35.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.095+0000 7f59cce83640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f59ac065b70 0x7f59ac068020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00a990 tx=0x7f59bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:35.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.099+0000 7f59c57fa640 1 -- 172.21.15.78:0/821098346 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f59c00502e0 con 0x7f59c814c110 2023-06-02T15:30:35.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.247+0000 7f59cf0e7640 1 -- 172.21.15.78:0/821098346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59c80a6640 con 0x7f59c814c110 2023-06-02T15:30:35.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.247+0000 7f59c57fa640 1 -- 172.21.15.78:0/821098346 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59c00180a0 con 0x7f59c814c110 2023-06-02T15:30:35.256 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-02T15:30:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 -- 172.21.15.78:0/821098346 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f59ac065b70 msgr2=0x7f59ac068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f59ac065b70 0x7f59ac068020 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f59bc00a990 tx=0x7f59bc008040 comp rx=0 tx=0).stop 2023-06-02T15:30:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 -- 172.21.15.78:0/821098346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c814c110 msgr2=0x7f59c81536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c814c110 0x7f59c81536b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f59c000c7a0 tx=0x7f59c000cc60 comp rx=0 tx=0).stop 2023-06-02T15:30:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 -- 172.21.15.78:0/821098346 shutdown_connections 2023-06-02T15:30:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f59ac065b70 0x7f59ac068020 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f59c814c110 0x7f59c81536b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f59c80c26c0 0x7f59c8155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 --2- 172.21.15.78:0/821098346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59c80bea30 0x7f59c8148d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 -- 172.21.15.78:0/821098346 >> 172.21.15.78:0/821098346 conn(0x7f59c80a5730 msgr2=0x7f59c80bf960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:35.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 -- 172.21.15.78:0/821098346 shutdown_connections 2023-06-02T15:30:35.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.251+0000 7f59cf0e7640 1 -- 172.21.15.78:0/821098346 wait complete. 2023-06-02T15:30:35.273 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-02T15:30:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe27e2f9640 1 Processor -- start 2023-06-02T15:30:35.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe27e2f9640 1 -- start start 2023-06-02T15:30:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe27e2f9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2780c19c0 0x7fe2780bf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe27e2f9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2781502a0 0x7fe278150700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe27e2f9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2780c24c0 con 0x7fe2780b5e00 2023-06-02T15:30:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe27e2f9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2780bf0b0 con 0x7fe2780c19c0 2023-06-02T15:30:35.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe27e2f9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2780be410 con 0x7fe2781502a0 2023-06-02T15:30:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe27c896640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2781502a0 0x7fe278150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe277fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2780c19c0 0x7fe2780bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe27c896640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2781502a0 0x7fe278150700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:46058/0 (socket says 172.21.15.78:46058) 2023-06-02T15:30:35.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe27c896640 1 -- 172.21.15.78:0/2384997666 learned_addr learned my addr 172.21.15.78:0/2384997666 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:35.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe277fff640 1 -- 172.21.15.78:0/2384997666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2781502a0 msgr2=0x7fe278150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:35.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe277fff640 1 --2- 172.21.15.78:0/2384997666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2781502a0 0x7fe278150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe277fff640 1 -- 172.21.15.78:0/2384997666 >> v1:172.21.15.132:6789/0 conn(0x7fe2780b5e00 legacy=0x7fe27806e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.391+0000 7fe277fff640 1 -- 172.21.15.78:0/2384997666 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2780c12f0 con 0x7fe2780c19c0 2023-06-02T15:30:35.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe277fff640 1 --2- 172.21.15.78:0/2384997666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2780c19c0 0x7fe2780bf500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe2680097c0 tx=0x7fe26801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80b96584148c33bd server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe276ffd640 1 -- 172.21.15.78:0/2384997666 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680ac640 con 0x7fe2780c19c0 2023-06-02T15:30:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe276ffd640 1 -- 172.21.15.78:0/2384997666 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2680ac7a0 con 0x7fe2780c19c0 2023-06-02T15:30:35.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe276ffd640 1 -- 172.21.15.78:0/2384997666 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680acb30 con 0x7fe2780c19c0 2023-06-02T15:30:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 -- 172.21.15.78:0/2384997666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2780c19c0 msgr2=0x7fe2780bf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 --2- 172.21.15.78:0/2384997666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2780c19c0 0x7fe2780bf500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe2680097c0 tx=0x7fe26801c3c0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 -- 172.21.15.78:0/2384997666 shutdown_connections 2023-06-02T15:30:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 --2- 172.21.15.78:0/2384997666 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2781502a0 0x7fe278150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 --2- 172.21.15.78:0/2384997666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2780c19c0 0x7fe2780bf500 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 -- 172.21.15.78:0/2384997666 >> 172.21.15.78:0/2384997666 conn(0x7fe2780a4290 msgr2=0x7fe2780a4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 -- 172.21.15.78:0/2384997666 shutdown_connections 2023-06-02T15:30:35.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 -- 172.21.15.78:0/2384997666 wait complete. 2023-06-02T15:30:35.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 Processor -- start 2023-06-02T15:30:35.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 -- start start 2023-06-02T15:30:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2780b5e00 0x7fe278148a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2780c19c0 0x7fe278155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2781502a0 0x7fe27814ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27806aca0 con 0x7fe2780b5e00 2023-06-02T15:30:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe278155c90 con 0x7fe2781502a0 2023-06-02T15:30:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.395+0000 7fe27e2f9640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27814e1a0 con 0x7fe2780c19c0 2023-06-02T15:30:35.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe277fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2780b5e00 0x7fe278148a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe277fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2780b5e00 0x7fe278148a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40770/0 (socket says 172.21.15.78:40770) 2023-06-02T15:30:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe277fff640 1 -- 172.21.15.78:0/636254356 learned_addr learned my addr 172.21.15.78:0/636254356 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe27c896640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2781502a0 0x7fe27814ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe2777fe640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2780c19c0 0x7fe278155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe277fff640 1 -- 172.21.15.78:0/636254356 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2780c19c0 msgr2=0x7fe278155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe277fff640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2780c19c0 0x7fe278155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe277fff640 1 -- 172.21.15.78:0/636254356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2781502a0 msgr2=0x7fe27814ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe277fff640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2781502a0 0x7fe27814ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe277fff640 1 -- 172.21.15.78:0/636254356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe268009420 con 0x7fe2780b5e00 2023-06-02T15:30:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe2777fe640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2780c19c0 0x7fe278155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:35.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe277fff640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2780b5e00 0x7fe278148a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe268019ff0 tx=0x7fe268019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:35.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe274ff9640 1 -- 172.21.15.78:0/636254356 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680b5610 con 0x7fe2780b5e00 2023-06-02T15:30:35.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe274ff9640 1 -- 172.21.15.78:0/636254356 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2680b5770 con 0x7fe2780b5e00 2023-06-02T15:30:35.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe27e2f9640 1 -- 172.21.15.78:0/636254356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2780bd020 con 0x7fe2780b5e00 2023-06-02T15:30:35.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe274ff9640 1 -- 172.21.15.78:0/636254356 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2680b5b20 con 0x7fe2780b5e00 2023-06-02T15:30:35.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.399+0000 7fe27e2f9640 1 -- 172.21.15.78:0/636254356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe278150c40 con 0x7fe2780b5e00 2023-06-02T15:30:35.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.403+0000 7fe27e2f9640 1 -- 172.21.15.78:0/636254356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2780bd1b0 con 0x7fe2780b5e00 2023-06-02T15:30:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.403+0000 7fe274ff9640 1 -- 172.21.15.78:0/636254356 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7fe2680b3040 con 0x7fe2780b5e00 2023-06-02T15:30:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.403+0000 7fe274ff9640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe264065b70 0x7fe264068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.403+0000 7fe274ff9640 1 -- 172.21.15.78:0/636254356 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe26811d1a0 con 0x7fe2780b5e00 2023-06-02T15:30:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.403+0000 7fe2777fe640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe264065b70 0x7fe264068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.403+0000 7fe2777fe640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe264065b70 0x7fe264068020 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2780bdc80 tx=0x7fe26c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:35.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.407+0000 7fe274ff9640 1 -- 172.21.15.78:0/636254356 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fe2680ead20 con 0x7fe2780b5e00 2023-06-02T15:30:35.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.559+0000 7fe27e2f9640 1 -- 172.21.15.78:0/636254356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe278073bc0 con 0x7fe2780b5e00 2023-06-02T15:30:35.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe274ff9640 1 -- 172.21.15.78:0/636254356 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe2680ee340 con 0x7fe2780b5e00 2023-06-02T15:30:35.657 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-02T15:30:35.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 -- 172.21.15.78:0/636254356 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe264065b70 msgr2=0x7fe264068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe264065b70 0x7fe264068020 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe2780bdc80 tx=0x7fe26c009040 comp rx=0 tx=0).stop 2023-06-02T15:30:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 -- 172.21.15.78:0/636254356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2780b5e00 msgr2=0x7fe278148a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2780b5e00 0x7fe278148a10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe268019ff0 tx=0x7fe268019160 comp rx=0 tx=0).stop 2023-06-02T15:30:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 -- 172.21.15.78:0/636254356 shutdown_connections 2023-06-02T15:30:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2781502a0 0x7fe27814ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe2780c19c0 0x7fe278155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe264065b70 0x7fe264068020 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 --2- 172.21.15.78:0/636254356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2780b5e00 0x7fe278148a10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 -- 172.21.15.78:0/636254356 >> 172.21.15.78:0/636254356 conn(0x7fe2780a4290 msgr2=0x7fe278072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 -- 172.21.15.78:0/636254356 shutdown_connections 2023-06-02T15:30:35.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.651+0000 7fe27e2f9640 1 -- 172.21.15.78:0/636254356 wait complete. 2023-06-02T15:30:35.677 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-06-02T15:30:35.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f383ddf5640 1 Processor -- start 2023-06-02T15:30:35.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f383ddf5640 1 -- start start 2023-06-02T15:30:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f383ddf5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f383814bf10 0x7f38380c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f383ddf5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383806f0a0 con 0x7f38380c2c20 2023-06-02T15:30:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f383ddf5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3838071b70 con 0x7f38380bd8e0 2023-06-02T15:30:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f383ddf5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38380bd0d0 con 0x7f383814bf10 2023-06-02T15:30:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f38377fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f383814bf10 0x7f38380c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f38377fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f383814bf10 0x7f38380c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40794/0 (socket says 172.21.15.78:40794) 2023-06-02T15:30:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f3836ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f38380c2c20 0x7f383806e210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44654/0 (socket says 172.21.15.78:44654) 2023-06-02T15:30:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f38377fe640 1 -- 172.21.15.78:0/3677742715 learned_addr learned my addr 172.21.15.78:0/3677742715 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f38377fe640 1 -- 172.21.15.78:0/3677742715 >> v1:172.21.15.132:6789/0 conn(0x7f38380bd8e0 legacy=0x7f3838159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f38377fe640 1 -- 172.21.15.78:0/3677742715 >> v1:172.21.15.78:6789/0 conn(0x7f38380c2c20 legacy=0x7f383806e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.783+0000 7f38377fe640 1 -- 172.21.15.78:0/3677742715 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383806f2f0 con 0x7f383814bf10 2023-06-02T15:30:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38377fe640 1 --2- 172.21.15.78:0/3677742715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f383814bf10 0x7f38380c26e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3828009870 tx=0x7f382801c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f22424a97d392002 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38367fc640 1 -- 172.21.15.78:0/3677742715 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38280a8050 con 0x7f383814bf10 2023-06-02T15:30:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38367fc640 1 -- 172.21.15.78:0/3677742715 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38280ac5f0 con 0x7f383814bf10 2023-06-02T15:30:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38367fc640 1 -- 172.21.15.78:0/3677742715 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38280ac980 con 0x7f383814bf10 2023-06-02T15:30:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- 172.21.15.78:0/3677742715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f383814bf10 msgr2=0x7f38380c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 --2- 172.21.15.78:0/3677742715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f383814bf10 0x7f38380c26e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3828009870 tx=0x7f382801c540 comp rx=0 tx=0).stop 2023-06-02T15:30:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- 172.21.15.78:0/3677742715 shutdown_connections 2023-06-02T15:30:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 --2- 172.21.15.78:0/3677742715 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f383814bf10 0x7f38380c26e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- 172.21.15.78:0/3677742715 >> 172.21.15.78:0/3677742715 conn(0x7f38380698f0 msgr2=0x7f3838069cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- 172.21.15.78:0/3677742715 shutdown_connections 2023-06-02T15:30:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- 172.21.15.78:0/3677742715 wait complete. 2023-06-02T15:30:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 Processor -- start 2023-06-02T15:30:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- start start 2023-06-02T15:30:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38380bd8e0 0x7f383814d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38380c2c20 0x7f383806aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f383814bf10 0x7f383806af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383806be90 con 0x7f38380bd8e0 2023-06-02T15:30:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38381e7bc0 con 0x7f383814bf10 2023-06-02T15:30:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383814e4a0 con 0x7f38380c2c20 2023-06-02T15:30:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38380bd8e0 0x7f383814d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38377fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38380bd8e0 0x7f383814d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40796/0 (socket says 172.21.15.78:40796) 2023-06-02T15:30:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38377fe640 1 -- 172.21.15.78:0/1683479923 learned_addr learned my addr 172.21.15.78:0/1683479923 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f3837fff640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f383814bf10 0x7f383806af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38377fe640 1 -- 172.21.15.78:0/1683479923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38380c2c20 msgr2=0x7f383806aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f3836ffd640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38380c2c20 0x7f383806aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38377fe640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38380c2c20 0x7f383806aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38377fe640 1 -- 172.21.15.78:0/1683479923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f383814bf10 msgr2=0x7f383806af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38377fe640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f383814bf10 0x7f383806af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38377fe640 1 -- 172.21.15.78:0/1683479923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38280094d0 con 0x7f38380bd8e0 2023-06-02T15:30:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f3837fff640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f383814bf10 0x7f383806af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f38377fe640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38380bd8e0 0x7f383814d7d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f38280af040 tx=0x7f38280192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f381ffff640 1 -- 172.21.15.78:0/1683479923 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38280b5830 con 0x7f38380bd8e0 2023-06-02T15:30:35.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f381ffff640 1 -- 172.21.15.78:0/1683479923 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38280b5990 con 0x7f38380bd8e0 2023-06-02T15:30:35.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- 172.21.15.78:0/1683479923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383806eab0 con 0x7f38380bd8e0 2023-06-02T15:30:35.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f381ffff640 1 -- 172.21.15.78:0/1683479923 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38280b5d40 con 0x7f38380bd8e0 2023-06-02T15:30:35.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.787+0000 7f383ddf5640 1 -- 172.21.15.78:0/1683479923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383806e920 con 0x7f38380bd8e0 2023-06-02T15:30:35.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.791+0000 7f383ddf5640 1 -- 172.21.15.78:0/1683479923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383806ec40 con 0x7f38380bd8e0 2023-06-02T15:30:35.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.791+0000 7f381ffff640 1 -- 172.21.15.78:0/1683479923 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7f38280b3070 con 0x7f38380bd8e0 2023-06-02T15:30:35.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.791+0000 7f381ffff640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3824065b70 0x7f3824068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:35.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.791+0000 7f381ffff640 1 -- 172.21.15.78:0/1683479923 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f382811d3a0 con 0x7f38380bd8e0 2023-06-02T15:30:35.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.791+0000 7f3836ffd640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3824065b70 0x7f3824068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:35.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.791+0000 7f3836ffd640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3824065b70 0x7f3824068020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f383814e100 tx=0x7f382c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:35.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.795+0000 7f381ffff640 1 -- 172.21.15.78:0/1683479923 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f38280eafa0 con 0x7f38380bd8e0 2023-06-02T15:30:35.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 -- 172.21.15.78:0/1683479923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3838073bc0 con 0x7f38380bd8e0 2023-06-02T15:30:35.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f381ffff640 1 -- 172.21.15.78:0/1683479923 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+126 (secure 0 0 0) 0x7f38280ee5c0 con 0x7f38380bd8e0 2023-06-02T15:30:35.962 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:35.962 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-06-02T15:30:35.962 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-02T15:30:35.963 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-06-02T15:30:35.963 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": "rbd" 2023-06-02T15:30:35.963 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-06-02T15:30:35.963 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-06-02T15:30:35.963 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 2, 2023-06-02T15:30:35.963 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-06-02T15:30:35.963 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-06-02T15:30:35.963 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-06-02T15:30:35.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 -- 172.21.15.78:0/1683479923 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3824065b70 msgr2=0x7f3824068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3824065b70 0x7f3824068020 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f383814e100 tx=0x7f382c009040 comp rx=0 tx=0).stop 2023-06-02T15:30:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 -- 172.21.15.78:0/1683479923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38380bd8e0 msgr2=0x7f383814d7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38380bd8e0 0x7f383814d7d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f38280af040 tx=0x7f38280192e0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 -- 172.21.15.78:0/1683479923 shutdown_connections 2023-06-02T15:30:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f383814bf10 0x7f383806af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f38380c2c20 0x7f383806aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3824065b70 0x7f3824068020 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 --2- 172.21.15.78:0/1683479923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38380bd8e0 0x7f383814d7d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 -- 172.21.15.78:0/1683479923 >> 172.21.15.78:0/1683479923 conn(0x7f38380698f0 msgr2=0x7f383814f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 -- 172.21.15.78:0/1683479923 shutdown_connections 2023-06-02T15:30:35.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:35.955+0000 7f383ddf5640 1 -- 172.21.15.78:0/1683479923 wait complete. 2023-06-02T15:30:35.979 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-06-02T15:30:35.979 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-06-02T15:30:36.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52bd8ea640 1 Processor -- start 2023-06-02T15:30:36.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52bd8ea640 1 -- start start 2023-06-02T15:30:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52bd8ea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52b814f260 0x7f52b80bded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52bd8ea640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52b80be410 0x7f52b8151f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52bd8ea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52b814f630 con 0x7f52b80bc7c0 2023-06-02T15:30:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52bd8ea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52b80b7b00 con 0x7f52b814f260 2023-06-02T15:30:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52bd8ea640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b806dfc0 con 0x7f52b80be410 2023-06-02T15:30:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52b6ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52b814f260 0x7f52b80bded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:36.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52b6ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f52b814f260 0x7f52b80bded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40808/0 (socket says 172.21.15.78:40808) 2023-06-02T15:30:36.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52b6ffd640 1 -- 172.21.15.78:0/342282953 learned_addr learned my addr 172.21.15.78:0/342282953 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:36.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52b6ffd640 1 -- 172.21.15.78:0/342282953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52b80be410 msgr2=0x7f52b8151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:36.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52b6ffd640 1 --2- 172.21.15.78:0/342282953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52b80be410 0x7f52b8151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:36.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52b6ffd640 1 -- 172.21.15.78:0/342282953 >> v1:172.21.15.78:6789/0 conn(0x7f52b80bc7c0 legacy=0x7f52b81524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.083+0000 7f52b6ffd640 1 -- 172.21.15.78:0/342282953 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b814e680 con 0x7f52b814f260 2023-06-02T15:30:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b6ffd640 1 --2- 172.21.15.78:0/342282953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b814f260 0x7f52b80bded0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009870 tx=0x7f52a801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfd8ab53f450e7f8 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:36.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b5ffb640 1 -- 172.21.15.78:0/342282953 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80ac620 con 0x7f52b814f260 2023-06-02T15:30:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b5ffb640 1 -- 172.21.15.78:0/342282953 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a80ac780 con 0x7f52b814f260 2023-06-02T15:30:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b5ffb640 1 -- 172.21.15.78:0/342282953 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a80acb10 con 0x7f52b814f260 2023-06-02T15:30:36.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 -- 172.21.15.78:0/342282953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b814f260 msgr2=0x7f52b80bded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 --2- 172.21.15.78:0/342282953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b814f260 0x7f52b80bded0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009870 tx=0x7f52a801c4b0 comp rx=0 tx=0).stop 2023-06-02T15:30:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 -- 172.21.15.78:0/342282953 shutdown_connections 2023-06-02T15:30:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 --2- 172.21.15.78:0/342282953 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52b80be410 0x7f52b8151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 --2- 172.21.15.78:0/342282953 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b814f260 0x7f52b80bded0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 -- 172.21.15.78:0/342282953 >> 172.21.15.78:0/342282953 conn(0x7f52b806aa00 msgr2=0x7f52b806ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 -- 172.21.15.78:0/342282953 shutdown_connections 2023-06-02T15:30:36.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 -- 172.21.15.78:0/342282953 wait complete. 2023-06-02T15:30:36.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 Processor -- start 2023-06-02T15:30:36.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 -- start start 2023-06-02T15:30:36.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52b80bc7c0 0x7f52b8143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b80be410 0x7f52b814fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52b814f260 0x7f52b8149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b814b1d0 con 0x7f52b80be410 2023-06-02T15:30:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8150770 con 0x7f52b814f260 2023-06-02T15:30:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52bd8ea640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52b8150a50 con 0x7f52b80bc7c0 2023-06-02T15:30:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b80be410 0x7f52b814fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:36.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b80be410 0x7f52b814fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40820/0 (socket says 172.21.15.78:40820) 2023-06-02T15:30:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b67fc640 1 -- 172.21.15.78:0/2051742358 learned_addr learned my addr 172.21.15.78:0/2051742358 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b6ffd640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52b80bc7c0 0x7f52b8143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b77fe640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52b814f260 0x7f52b8149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b67fc640 1 -- 172.21.15.78:0/2051742358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52b80bc7c0 msgr2=0x7f52b8143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b67fc640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52b80bc7c0 0x7f52b8143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b67fc640 1 -- 172.21.15.78:0/2051742358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52b814f260 msgr2=0x7f52b8149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b67fc640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52b814f260 0x7f52b8149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:36.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.087+0000 7f52b67fc640 1 -- 172.21.15.78:0/2051742358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a80094d0 con 0x7f52b80be410 2023-06-02T15:30:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52b67fc640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b80be410 0x7f52b814fcb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f52a000b480 tx=0x7f52a000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52affff640 1 -- 172.21.15.78:0/2051742358 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a0010870 con 0x7f52b80be410 2023-06-02T15:30:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52affff640 1 -- 172.21.15.78:0/2051742358 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a00109d0 con 0x7f52b80be410 2023-06-02T15:30:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52bd8ea640 1 -- 172.21.15.78:0/2051742358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b80bcca0 con 0x7f52b80be410 2023-06-02T15:30:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52affff640 1 -- 172.21.15.78:0/2051742358 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a0010d80 con 0x7f52b80be410 2023-06-02T15:30:36.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52bd8ea640 1 -- 172.21.15.78:0/2051742358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b806e210 con 0x7f52b80be410 2023-06-02T15:30:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52bd8ea640 1 -- 172.21.15.78:0/2051742358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b80b80c0 con 0x7f52b80be410 2023-06-02T15:30:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52affff640 1 -- 172.21.15.78:0/2051742358 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 4) v1 ==== 84766+0+0 (secure 0 0 0) 0x7f52a000f3c0 con 0x7f52b80be410 2023-06-02T15:30:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52affff640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5298065b70 0x7f5298068020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:36.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52affff640 1 -- 172.21.15.78:0/2051742358 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f52a0082e70 con 0x7f52b80be410 2023-06-02T15:30:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52b6ffd640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5298065b70 0x7f5298068020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.091+0000 7f52b6ffd640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5298065b70 0x7f5298068020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f52a80ae000 tx=0x7f52a80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:36.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.095+0000 7f52affff640 1 -- 172.21.15.78:0/2051742358 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f52a0050b00 con 0x7f52b80be410 2023-06-02T15:30:36.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.231+0000 7f52affff640 1 -- 172.21.15.78:0/2051742358 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f52a0050ed0 con 0x7f52b80be410 2023-06-02T15:30:36.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:36.239+0000 7f52bd8ea640 1 -- 172.21.15.78:0/2051742358 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f52b8066d20 con 0x7f52b80be410 2023-06-02T15:30:37.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.231+0000 7f52affff640 1 -- 172.21.15.78:0/2051742358 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f52a005cf40 con 0x7f52b80be410 2023-06-02T15:30:37.241 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-06-02T15:30:37.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.235+0000 7f52bd8ea640 1 -- 172.21.15.78:0/2051742358 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5298065b70 msgr2=0x7f5298068020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:37.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.235+0000 7f52bd8ea640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5298065b70 0x7f5298068020 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f52a80ae000 tx=0x7f52a80a7000 comp rx=0 tx=0).stop 2023-06-02T15:30:37.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.235+0000 7f52bd8ea640 1 -- 172.21.15.78:0/2051742358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b80be410 msgr2=0x7f52b814fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.235+0000 7f52bd8ea640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b80be410 0x7f52b814fcb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f52a000b480 tx=0x7f52a000b940 comp rx=0 tx=0).stop 2023-06-02T15:30:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.235+0000 7f52bd8ea640 1 -- 172.21.15.78:0/2051742358 shutdown_connections 2023-06-02T15:30:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.235+0000 7f52bd8ea640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52b814f260 0x7f52b8149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.235+0000 7f52bd8ea640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5298065b70 0x7f5298068020 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.235+0000 7f52bd8ea640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52b80be410 0x7f52b814fcb0 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f52a000b480 tx=0x7f52a000b940 comp rx=0 tx=0).stop 2023-06-02T15:30:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.235+0000 7f52bd8ea640 1 --2- 172.21.15.78:0/2051742358 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f52b80bc7c0 0x7f52b8143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:37.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.235+0000 7f52bd8ea640 1 -- 172.21.15.78:0/2051742358 >> 172.21.15.78:0/2051742358 conn(0x7f52b806aa00 msgr2=0x7f52b806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:37.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.239+0000 7f52bd8ea640 1 -- 172.21.15.78:0/2051742358 shutdown_connections 2023-06-02T15:30:37.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.243+0000 7f52bd8ea640 1 -- 172.21.15.78:0/2051742358 wait complete. 2023-06-02T15:30:37.270 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-06-02T15:30:37.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f726218b640 1 Processor -- start 2023-06-02T15:30:37.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f726218b640 1 -- start start 2023-06-02T15:30:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f726218b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f725c0bc230 0x7f725c1488d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f726218b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f725c148e10 0x7f725c0a3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f726218b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f725c0a3fa0 0x7f725c14eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f726218b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c0bac80 con 0x7f725c148e10 2023-06-02T15:30:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f726218b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725c0a5320 con 0x7f725c0bc230 2023-06-02T15:30:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f726218b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c14c080 con 0x7f725c0a3fa0 2023-06-02T15:30:37.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f725affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f725c148e10 0x7f725c0a3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:37.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f725affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f725c148e10 0x7f725c0a3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40826/0 (socket says 172.21.15.78:40826) 2023-06-02T15:30:37.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f725affd640 1 -- 172.21.15.78:0/954220487 learned_addr learned my addr 172.21.15.78:0/954220487 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:37.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f725bfff640 1 --2- 172.21.15.78:0/954220487 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f725c0a3fa0 0x7f725c14eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:37.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f725b7fe640 1 --2- 172.21.15.78:0/954220487 >> v2:172.21.15.132:3300/0 conn(0x7f725c0bc230 0x7f725c1488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:37.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f725affd640 1 -- 172.21.15.78:0/954220487 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f725c0a3fa0 msgr2=0x7f725c14eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:37.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f725affd640 1 --2- 172.21.15.78:0/954220487 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f725c0a3fa0 0x7f725c14eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:37.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f725affd640 1 -- 172.21.15.78:0/954220487 >> v2:172.21.15.132:3300/0 conn(0x7f725c0bc230 msgr2=0x7f725c1488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:37.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f725affd640 1 --2- 172.21.15.78:0/954220487 >> v2:172.21.15.132:3300/0 conn(0x7f725c0bc230 0x7f725c1488d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:37.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.391+0000 7f725affd640 1 -- 172.21.15.78:0/954220487 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725c0a5040 con 0x7f725c148e10 2023-06-02T15:30:37.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f725affd640 1 --2- 172.21.15.78:0/954220487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 0x7f725c0a3a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f725c072640 tx=0x7f725001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b982408946ccca0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:37.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f725a7fc640 1 -- 172.21.15.78:0/954220487 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72500ab620 con 0x7f725c148e10 2023-06-02T15:30:37.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f725a7fc640 1 -- 172.21.15.78:0/954220487 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72500ab780 con 0x7f725c148e10 2023-06-02T15:30:37.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f725a7fc640 1 -- 172.21.15.78:0/954220487 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72500abb10 con 0x7f725c148e10 2023-06-02T15:30:37.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 -- 172.21.15.78:0/954220487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 msgr2=0x7f725c0a3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:37.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 --2- 172.21.15.78:0/954220487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 0x7f725c0a3a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f725c072640 tx=0x7f725001c440 comp rx=0 tx=0).stop 2023-06-02T15:30:37.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 -- 172.21.15.78:0/954220487 shutdown_connections 2023-06-02T15:30:37.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 --2- 172.21.15.78:0/954220487 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f725c0a3fa0 0x7f725c14eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:37.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 --2- 172.21.15.78:0/954220487 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 0x7f725c0a3a60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:37.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 --2- 172.21.15.78:0/954220487 >> v2:172.21.15.132:3300/0 conn(0x7f725c0bc230 0x7f725c1488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:37.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 -- 172.21.15.78:0/954220487 >> 172.21.15.78:0/954220487 conn(0x7f725c0c0540 msgr2=0x7f725c0c0940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:37.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 -- 172.21.15.78:0/954220487 shutdown_connections 2023-06-02T15:30:37.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 -- 172.21.15.78:0/954220487 wait complete. 2023-06-02T15:30:37.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 Processor -- start 2023-06-02T15:30:37.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.395+0000 7f726218b640 1 -- start start 2023-06-02T15:30:37.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f726218b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f725c0a3fa0 0x7f725c140b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:37.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f726218b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f725c0bc230 0x7f725c1e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:37.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f726218b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 0x7f725c1e3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:37.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f726218b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c145d20 con 0x7f725c148e10 2023-06-02T15:30:37.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f726218b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725c1eb020 con 0x7f725c0bc230 2023-06-02T15:30:37.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f726218b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725c1e6e10 con 0x7f725c0a3fa0 2023-06-02T15:30:37.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 0x7f725c1e3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:37.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 0x7f725c1e3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40838/0 (socket says 172.21.15.78:40838) 2023-06-02T15:30:37.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725bfff640 1 -- 172.21.15.78:0/1555397964 learned_addr learned my addr 172.21.15.78:0/1555397964 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:37.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725affd640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f725c0bc230 0x7f725c1e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:37.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725b7fe640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f725c0a3fa0 0x7f725c140b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:37.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725bfff640 1 -- 172.21.15.78:0/1555397964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f725c0a3fa0 msgr2=0x7f725c140b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:37.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725bfff640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f725c0a3fa0 0x7f725c140b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:37.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725bfff640 1 -- 172.21.15.78:0/1555397964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f725c0bc230 msgr2=0x7f725c1e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:37.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725bfff640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f725c0bc230 0x7f725c1e72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:37.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725bfff640 1 -- 172.21.15.78:0/1555397964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72500094d0 con 0x7f725c148e10 2023-06-02T15:30:37.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725bfff640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 0x7f725c1e3e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f725400ccf0 tx=0x7f725400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:37.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f7243fff640 1 -- 172.21.15.78:0/1555397964 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254003ba0 con 0x7f725c148e10 2023-06-02T15:30:37.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f7243fff640 1 -- 172.21.15.78:0/1555397964 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7254003d00 con 0x7f725c148e10 2023-06-02T15:30:37.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f726218b640 1 -- 172.21.15.78:0/1555397964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725c0ba8a0 con 0x7f725c148e10 2023-06-02T15:30:37.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f7243fff640 1 -- 172.21.15.78:0/1555397964 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254004240 con 0x7f725c148e10 2023-06-02T15:30:37.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f726218b640 1 -- 172.21.15.78:0/1555397964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f725c0a00e0 con 0x7f725c148e10 2023-06-02T15:30:37.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f726218b640 1 -- 172.21.15.78:0/1555397964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f725c0baa30 con 0x7f725c148e10 2023-06-02T15:30:37.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f7243fff640 1 -- 172.21.15.78:0/1555397964 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f72540043a0 con 0x7f725c148e10 2023-06-02T15:30:37.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f7243fff640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7248065c30 0x7f72480680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:37.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f7243fff640 1 -- 172.21.15.78:0/1555397964 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f7254012070 con 0x7f725c148e10 2023-06-02T15:30:37.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725b7fe640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7248065c30 0x7f72480680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:37.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.399+0000 7f725b7fe640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7248065c30 0x7f72480680e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f724c00a970 tx=0x7f724c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:37.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.403+0000 7f7243fff640 1 -- 172.21.15.78:0/1555397964 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f72540515d0 con 0x7f725c148e10 2023-06-02T15:30:37.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:37.559+0000 7f726218b640 1 -- 172.21.15.78:0/1555397964 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f725c1410b0 con 0x7f725c148e10 2023-06-02T15:30:38.245 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-06-02T15:30:38.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.239+0000 7f7243fff640 1 -- 172.21.15.78:0/1555397964 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f7254054bf0 con 0x7f725c148e10 2023-06-02T15:30:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.247+0000 7f726218b640 1 -- 172.21.15.78:0/1555397964 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7248065c30 msgr2=0x7f72480680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.247+0000 7f726218b640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7248065c30 0x7f72480680e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f724c00a970 tx=0x7f724c008040 comp rx=0 tx=0).stop 2023-06-02T15:30:38.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.247+0000 7f726218b640 1 -- 172.21.15.78:0/1555397964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 msgr2=0x7f725c1e3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.247+0000 7f726218b640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 0x7f725c1e3e60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f725400ccf0 tx=0x7f725400a660 comp rx=0 tx=0).stop 2023-06-02T15:30:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.251+0000 7f726218b640 1 -- 172.21.15.78:0/1555397964 shutdown_connections 2023-06-02T15:30:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.251+0000 7f726218b640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7248065c30 0x7f72480680e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.251+0000 7f726218b640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f725c148e10 0x7f725c1e3e60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.251+0000 7f726218b640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f725c0bc230 0x7f725c1e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.251+0000 7f726218b640 1 --2- 172.21.15.78:0/1555397964 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f725c0a3fa0 0x7f725c140b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.251+0000 7f726218b640 1 -- 172.21.15.78:0/1555397964 >> 172.21.15.78:0/1555397964 conn(0x7f725c0c0540 msgr2=0x7f725c144070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.251+0000 7f726218b640 1 -- 172.21.15.78:0/1555397964 shutdown_connections 2023-06-02T15:30:38.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.251+0000 7f726218b640 1 -- 172.21.15.78:0/1555397964 wait complete. 2023-06-02T15:30:38.290 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-06-02T15:30:38.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.403+0000 7fd6e3a98640 1 Processor -- start 2023-06-02T15:30:38.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.403+0000 7fd6e3a98640 1 -- start start 2023-06-02T15:30:38.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e3a98640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6dc0c0570 0x7fd6dc071780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e3a98640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6dc0badc0 0x7fd6dc0ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e3a98640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6dc0c1060 con 0x7fd6dc0bc6a0 2023-06-02T15:30:38.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e3a98640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6dc0bab80 con 0x7fd6dc0c0570 2023-06-02T15:30:38.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e3a98640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc0a6230 con 0x7fd6dc0badc0 2023-06-02T15:30:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e1033640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6dc0badc0 0x7fd6dc0ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e1834640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6dc0c0570 0x7fd6dc071780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e2035640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd6dc0bc6a0 0x7fd6dc0bb9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:47716/0 (socket says 172.21.15.78:47716) 2023-06-02T15:30:38.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e1834640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6dc0c0570 0x7fd6dc071780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:43084/0 (socket says 172.21.15.78:43084) 2023-06-02T15:30:38.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e2035640 1 -- 172.21.15.78:0/1850617391 learned_addr learned my addr 172.21.15.78:0/1850617391 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:38.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e1834640 1 -- 172.21.15.78:0/1850617391 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6dc0badc0 msgr2=0x7fd6dc0ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:38.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e1834640 1 --2- 172.21.15.78:0/1850617391 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6dc0badc0 0x7fd6dc0ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e1834640 1 -- 172.21.15.78:0/1850617391 >> v1:172.21.15.132:6789/0 conn(0x7fd6dc0bc6a0 legacy=0x7fd6dc0bb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e1834640 1 -- 172.21.15.78:0/1850617391 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6dc0a5f30 con 0x7fd6dc0c0570 2023-06-02T15:30:38.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.407+0000 7fd6e0832640 1 -- 172.21.15.78:0/1850617391 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631157832 0 0) 0x7fd6d40014a0 con 0x7fd6dc0bc6a0 2023-06-02T15:30:38.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e1834640 1 --2- 172.21.15.78:0/1850617391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6dc0c0570 0x7fd6dc071780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0097c0 tx=0x7fd6cc01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e5ec0b063feb762 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:38.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e0832640 1 -- 172.21.15.78:0/1850617391 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0a8970 con 0x7fd6dc0c0570 2023-06-02T15:30:38.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e0832640 1 -- 172.21.15.78:0/1850617391 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6cc0a8ad0 con 0x7fd6dc0c0570 2023-06-02T15:30:38.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e0832640 1 -- 172.21.15.78:0/1850617391 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc0a8e60 con 0x7fd6dc0c0570 2023-06-02T15:30:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 -- 172.21.15.78:0/1850617391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6dc0c0570 msgr2=0x7fd6dc071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 --2- 172.21.15.78:0/1850617391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6dc0c0570 0x7fd6dc071780 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0097c0 tx=0x7fd6cc01ec70 comp rx=0 tx=0).stop 2023-06-02T15:30:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 -- 172.21.15.78:0/1850617391 shutdown_connections 2023-06-02T15:30:38.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 --2- 172.21.15.78:0/1850617391 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6dc0badc0 0x7fd6dc0ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 --2- 172.21.15.78:0/1850617391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6dc0c0570 0x7fd6dc071780 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 -- 172.21.15.78:0/1850617391 >> 172.21.15.78:0/1850617391 conn(0x7fd6dc0a2170 msgr2=0x7fd6dc0a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:38.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 -- 172.21.15.78:0/1850617391 shutdown_connections 2023-06-02T15:30:38.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 -- 172.21.15.78:0/1850617391 wait complete. 2023-06-02T15:30:38.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 Processor -- start 2023-06-02T15:30:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 -- start start 2023-06-02T15:30:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6dc0badc0 0x7fd6dc0b99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6dc0bc6a0 0x7fd6dc06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc0c0570 0x7fd6dc14cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc14f700 con 0x7fd6dc0c0570 2023-06-02T15:30:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc14f4b0 con 0x7fd6dc0badc0 2023-06-02T15:30:38.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e3a98640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6dc13e380 con 0x7fd6dc0bc6a0 2023-06-02T15:30:38.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.411+0000 7fd6e2035640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc0c0570 0x7fd6dc14cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e2035640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc0c0570 0x7fd6dc14cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40848/0 (socket says 172.21.15.78:40848) 2023-06-02T15:30:38.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e2035640 1 -- 172.21.15.78:0/923919548 learned_addr learned my addr 172.21.15.78:0/923919548 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:38.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e1834640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6dc0badc0 0x7fd6dc0b99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e1033640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6dc0bc6a0 0x7fd6dc06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e2035640 1 -- 172.21.15.78:0/923919548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6dc0bc6a0 msgr2=0x7fd6dc06eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e2035640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6dc0bc6a0 0x7fd6dc06eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e2035640 1 -- 172.21.15.78:0/923919548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6dc0badc0 msgr2=0x7fd6dc0b99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e2035640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6dc0badc0 0x7fd6dc0b99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e2035640 1 -- 172.21.15.78:0/923919548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6cc009420 con 0x7fd6dc0c0570 2023-06-02T15:30:38.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e1834640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6dc0badc0 0x7fd6dc0b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:38.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e2035640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc0c0570 0x7fd6dc14cde0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c7a0 tx=0x7fd6d400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:38.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6d27fc640 1 -- 172.21.15.78:0/923919548 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400a640 con 0x7fd6dc0c0570 2023-06-02T15:30:38.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6d27fc640 1 -- 172.21.15.78:0/923919548 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d400a7a0 con 0x7fd6dc0c0570 2023-06-02T15:30:38.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e3a98640 1 -- 172.21.15.78:0/923919548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6dc14bcc0 con 0x7fd6dc0c0570 2023-06-02T15:30:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6d27fc640 1 -- 172.21.15.78:0/923919548 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d400ab50 con 0x7fd6dc0c0570 2023-06-02T15:30:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e3a98640 1 -- 172.21.15.78:0/923919548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6dc0bb1d0 con 0x7fd6dc0c0570 2023-06-02T15:30:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e3a98640 1 -- 172.21.15.78:0/923919548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6dc14bfa0 con 0x7fd6dc0c0570 2023-06-02T15:30:38.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6d27fc640 1 -- 172.21.15.78:0/923919548 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fd6d400acb0 con 0x7fd6dc0c0570 2023-06-02T15:30:38.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6d27fc640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd6c0065c00 0x7fd6c00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6d27fc640 1 -- 172.21.15.78:0/923919548 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5962+0+0 (secure 0 0 0) 0x7fd6d4082910 con 0x7fd6dc0c0570 2023-06-02T15:30:38.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e1834640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd6c0065c00 0x7fd6c00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.415+0000 7fd6e1834640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd6c0065c00 0x7fd6c00680b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0b2000 tx=0x7fd6cc0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:38.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.419+0000 7fd6d27fc640 1 -- 172.21.15.78:0/923919548 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fd6d40501d0 con 0x7fd6dc0c0570 2023-06-02T15:30:38.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.607+0000 7fd6e3a98640 1 -- 172.21.15.78:0/923919548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd6dc1e75d0 con 0x7fd6dc0c0570 2023-06-02T15:30:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.611+0000 7fd6d27fc640 1 -- 172.21.15.78:0/923919548 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd6dc1e75d0 con 0x7fd6dc0c0570 2023-06-02T15:30:38.622 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 3 and data pool 4 2023-06-02T15:30:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.619+0000 7fd6e3a98640 1 -- 172.21.15.78:0/923919548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd6c0065c00 msgr2=0x7fd6c00680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.619+0000 7fd6e3a98640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd6c0065c00 0x7fd6c00680b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0b2000 tx=0x7fd6cc0aa070 comp rx=0 tx=0).stop 2023-06-02T15:30:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.619+0000 7fd6e3a98640 1 -- 172.21.15.78:0/923919548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc0c0570 msgr2=0x7fd6dc14cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.619+0000 7fd6e3a98640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc0c0570 0x7fd6dc14cde0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c7a0 tx=0x7fd6d400cc60 comp rx=0 tx=0).stop 2023-06-02T15:30:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.619+0000 7fd6e3a98640 1 -- 172.21.15.78:0/923919548 shutdown_connections 2023-06-02T15:30:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.619+0000 7fd6e3a98640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd6c0065c00 0x7fd6c00680b0 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0b2000 tx=0x7fd6cc0aa070 comp rx=0 tx=0).stop 2023-06-02T15:30:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.619+0000 7fd6e3a98640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd6dc0c0570 0x7fd6dc14cde0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.619+0000 7fd6e3a98640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd6dc0bc6a0 0x7fd6dc06eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.619+0000 7fd6e3a98640 1 --2- 172.21.15.78:0/923919548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6dc0badc0 0x7fd6dc0b99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.619+0000 7fd6e3a98640 1 -- 172.21.15.78:0/923919548 >> 172.21.15.78:0/923919548 conn(0x7fd6dc0a2170 msgr2=0x7fd6dc149e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:38.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.623+0000 7fd6e3a98640 1 -- 172.21.15.78:0/923919548 shutdown_connections 2023-06-02T15:30:38.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.627+0000 7fd6e3a98640 1 -- 172.21.15.78:0/923919548 wait complete. 2023-06-02T15:30:38.666 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-06-02T15:30:38.667 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-06-02T15:30:38.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.779+0000 7f4eee504640 1 Processor -- start 2023-06-02T15:30:38.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.779+0000 7f4eee504640 1 -- start start 2023-06-02T15:30:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4eee504640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 0x7f4ee8071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4eee504640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ee806f0e0 0x7f4ee80c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4eee504640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee80bc870 con 0x7f4ee8071be0 2023-06-02T15:30:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4eee504640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee8071990 con 0x7f4ee806f0e0 2023-06-02T15:30:38.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4eee504640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee814d3f0 con 0x7f4ee814d020 2023-06-02T15:30:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4eecaa1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ee806f0e0 0x7f4ee80c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4ee7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 0x7f4ee8071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4ee7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 0x7f4ee8071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:46144/0 (socket says 172.21.15.78:46144) 2023-06-02T15:30:38.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4eecaa1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ee806f0e0 0x7f4ee80c26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:43104/0 (socket says 172.21.15.78:43104) 2023-06-02T15:30:38.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4ee7fff640 1 -- 172.21.15.78:0/1160298645 learned_addr learned my addr 172.21.15.78:0/1160298645 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:38.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4ee7fff640 1 -- 172.21.15.78:0/1160298645 >> v2:172.21.15.132:3300/0 conn(0x7f4ee806f0e0 msgr2=0x7f4ee80c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:38.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4ee7fff640 1 --2- 172.21.15.78:0/1160298645 >> v2:172.21.15.132:3300/0 conn(0x7f4ee806f0e0 0x7f4ee80c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4ee7fff640 1 -- 172.21.15.78:0/1160298645 >> v1:172.21.15.132:6789/0 conn(0x7f4ee8071be0 legacy=0x7f4ee80a6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4ee7fff640 1 -- 172.21.15.78:0/1160298645 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee80bcac0 con 0x7f4ee814d020 2023-06-02T15:30:38.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4eecaa1640 1 --2- 172.21.15.78:0/1160298645 >> v2:172.21.15.132:3300/0 conn(0x7f4ee806f0e0 0x7f4ee80c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:38.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.783+0000 7f4ee7fff640 1 --2- 172.21.15.78:0/1160298645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 0x7f4ee8071450 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009870 tx=0x7f4ed801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4dc8b2ea2fcd43e server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee77fe640 1 -- 172.21.15.78:0/1160298645 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80ab650 con 0x7f4ee814d020 2023-06-02T15:30:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee77fe640 1 -- 172.21.15.78:0/1160298645 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed80ab7b0 con 0x7f4ee814d020 2023-06-02T15:30:38.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee77fe640 1 -- 172.21.15.78:0/1160298645 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80abb40 con 0x7f4ee814d020 2023-06-02T15:30:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- 172.21.15.78:0/1160298645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 msgr2=0x7f4ee8071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 --2- 172.21.15.78:0/1160298645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 0x7f4ee8071450 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009870 tx=0x7f4ed801c540 comp rx=0 tx=0).stop 2023-06-02T15:30:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- 172.21.15.78:0/1160298645 shutdown_connections 2023-06-02T15:30:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 --2- 172.21.15.78:0/1160298645 >> v2:172.21.15.132:3300/0 conn(0x7f4ee806f0e0 0x7f4ee80c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 --2- 172.21.15.78:0/1160298645 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 0x7f4ee8071450 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- 172.21.15.78:0/1160298645 >> 172.21.15.78:0/1160298645 conn(0x7f4ee80a5730 msgr2=0x7f4ee80a5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- 172.21.15.78:0/1160298645 shutdown_connections 2023-06-02T15:30:38.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- 172.21.15.78:0/1160298645 wait complete. 2023-06-02T15:30:38.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 Processor -- start 2023-06-02T15:30:38.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- start start 2023-06-02T15:30:38.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee806f0e0 0x7f4ee814a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ee8071be0 0x7f4ee80bf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 0x7f4ee814b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80b8350 con 0x7f4ee806f0e0 2023-06-02T15:30:38.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80bf5d0 con 0x7f4ee8071be0 2023-06-02T15:30:38.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee80b9280 con 0x7f4ee814d020 2023-06-02T15:30:38.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee806f0e0 0x7f4ee814a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee806f0e0 0x7f4ee814a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40854/0 (socket says 172.21.15.78:40854) 2023-06-02T15:30:38.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee7fff640 1 -- 172.21.15.78:0/2070289231 learned_addr learned my addr 172.21.15.78:0/2070289231 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:38.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eecaa1640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 0x7f4ee814b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4edf7fe640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ee8071be0 0x7f4ee80bf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee7fff640 1 -- 172.21.15.78:0/2070289231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 msgr2=0x7f4ee814b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee7fff640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 0x7f4ee814b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee7fff640 1 -- 172.21.15.78:0/2070289231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ee8071be0 msgr2=0x7f4ee80bf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:38.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee7fff640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ee8071be0 0x7f4ee80bf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:38.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee7fff640 1 -- 172.21.15.78:0/2070289231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0009a70 con 0x7f4ee806f0e0 2023-06-02T15:30:38.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4edf7fe640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ee8071be0 0x7f4ee80bf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:38.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee7fff640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee806f0e0 0x7f4ee814a110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ed801cde0 tx=0x7f4ed801ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:38.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee57fa640 1 -- 172.21.15.78:0/2070289231 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80be5f0 con 0x7f4ee806f0e0 2023-06-02T15:30:38.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee57fa640 1 -- 172.21.15.78:0/2070289231 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed80be750 con 0x7f4ee806f0e0 2023-06-02T15:30:38.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- 172.21.15.78:0/2070289231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ed80094d0 con 0x7f4ee806f0e0 2023-06-02T15:30:38.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4ee57fa640 1 -- 172.21.15.78:0/2070289231 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80beac0 con 0x7f4ee806f0e0 2023-06-02T15:30:38.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.787+0000 7f4eee504640 1 -- 172.21.15.78:0/2070289231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee8159720 con 0x7f4ee806f0e0 2023-06-02T15:30:38.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.791+0000 7f4eee504640 1 -- 172.21.15.78:0/2070289231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee8159590 con 0x7f4ee806f0e0 2023-06-02T15:30:38.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.791+0000 7f4ee57fa640 1 -- 172.21.15.78:0/2070289231 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f4ed80b43f0 con 0x7f4ee806f0e0 2023-06-02T15:30:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.791+0000 7f4ee57fa640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4ec8065c00 0x7f4ec80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.791+0000 7f4ee57fa640 1 -- 172.21.15.78:0/2070289231 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f4ed811e6b0 con 0x7f4ee806f0e0 2023-06-02T15:30:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.791+0000 7f4edf7fe640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4ec8065c00 0x7f4ec80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:38.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.791+0000 7f4edf7fe640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4ec8065c00 0x7f4ec80680b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ee81e9060 tx=0x7f4ed0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:38.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.795+0000 7f4ee57fa640 1 -- 172.21.15.78:0/2070289231 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f4ed80ebf10 con 0x7f4ee806f0e0 2023-06-02T15:30:38.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:38.955+0000 7f4eee504640 1 -- 172.21.15.78:0/2070289231 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f4ee81598b0 con 0x7f4ee806f0e0 2023-06-02T15:30:39.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4ee57fa640 1 -- 172.21.15.78:0/2070289231 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f4ed80ef530 con 0x7f4ee806f0e0 2023-06-02T15:30:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 -- 172.21.15.78:0/2070289231 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4ec8065c00 msgr2=0x7f4ec80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4ec8065c00 0x7f4ec80680b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4ee81e9060 tx=0x7f4ed0009040 comp rx=0 tx=0).stop 2023-06-02T15:30:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 -- 172.21.15.78:0/2070289231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee806f0e0 msgr2=0x7f4ee814a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:39.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee806f0e0 0x7f4ee814a110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4ed801cde0 tx=0x7f4ed801ad80 comp rx=0 tx=0).stop 2023-06-02T15:30:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 -- 172.21.15.78:0/2070289231 shutdown_connections 2023-06-02T15:30:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4ee814d020 0x7f4ee814b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ee8071be0 0x7f4ee80bf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4ec8065c00 0x7f4ec80680b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 --2- 172.21.15.78:0/2070289231 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee806f0e0 0x7f4ee814a110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 -- 172.21.15.78:0/2070289231 >> 172.21.15.78:0/2070289231 conn(0x7f4ee80a5730 msgr2=0x7f4ee80c2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 -- 172.21.15.78:0/2070289231 shutdown_connections 2023-06-02T15:30:39.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.631+0000 7f4eee504640 1 -- 172.21.15.78:0/2070289231 wait complete. 2023-06-02T15:30:39.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-06-02T15:30:39.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.787+0000 7f999f714640 1 Processor -- start 2023-06-02T15:30:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.787+0000 7f999f714640 1 -- start start 2023-06-02T15:30:39.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.787+0000 7f999f714640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9998149c60 0x7f99980ba400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.787+0000 7f999f714640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980a20b0 0x7f99980a2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.787+0000 7f999f714640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99980b9b90 con 0x7f99980b9ed0 2023-06-02T15:30:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.787+0000 7f999f714640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99980bb3f0 con 0x7f9998149c60 2023-06-02T15:30:39.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.787+0000 7f999f714640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f999814d0b0 con 0x7f99980a20b0 2023-06-02T15:30:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999d4b0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9998149c60 0x7f99980ba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999dcb1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980a20b0 0x7f99980a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999d4b0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9998149c60 0x7f99980ba400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:43116/0 (socket says 172.21.15.78:43116) 2023-06-02T15:30:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999dcb1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980a20b0 0x7f99980a2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:46164/0 (socket says 172.21.15.78:46164) 2023-06-02T15:30:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999d4b0640 1 -- 172.21.15.78:0/1839320167 learned_addr learned my addr 172.21.15.78:0/1839320167 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:39.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999dcb1640 1 -- 172.21.15.78:0/1839320167 >> v2:172.21.15.132:3300/0 conn(0x7f9998149c60 msgr2=0x7f99980ba400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:39.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999dcb1640 1 --2- 172.21.15.78:0/1839320167 >> v2:172.21.15.132:3300/0 conn(0x7f9998149c60 0x7f99980ba400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:39.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999dcb1640 1 -- 172.21.15.78:0/1839320167 >> v1:172.21.15.132:6789/0 conn(0x7f99980b9ed0 legacy=0x7f99980b8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:39.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999dcb1640 1 -- 172.21.15.78:0/1839320167 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99980b9820 con 0x7f99980a20b0 2023-06-02T15:30:39.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999d4b0640 1 --2- 172.21.15.78:0/1839320167 >> v2:172.21.15.132:3300/0 conn(0x7f9998149c60 0x7f99980ba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:39.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.791+0000 7f999dcb1640 1 --2- 172.21.15.78:0/1839320167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980a20b0 0x7f99980a2530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9990009d90 tx=0x7f999001f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=508fda7c666436b9 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:39.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f998ffff640 1 -- 172.21.15.78:0/1839320167 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99900af600 con 0x7f99980a20b0 2023-06-02T15:30:39.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f998ffff640 1 -- 172.21.15.78:0/1839320167 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99900ab050 con 0x7f99980a20b0 2023-06-02T15:30:39.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f998ffff640 1 -- 172.21.15.78:0/1839320167 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99900af980 con 0x7f99980a20b0 2023-06-02T15:30:39.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 -- 172.21.15.78:0/1839320167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980a20b0 msgr2=0x7f99980a2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:39.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 --2- 172.21.15.78:0/1839320167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980a20b0 0x7f99980a2530 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9990009d90 tx=0x7f999001f130 comp rx=0 tx=0).stop 2023-06-02T15:30:39.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 -- 172.21.15.78:0/1839320167 shutdown_connections 2023-06-02T15:30:39.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 --2- 172.21.15.78:0/1839320167 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980a20b0 0x7f99980a2530 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:39.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 --2- 172.21.15.78:0/1839320167 >> v2:172.21.15.132:3300/0 conn(0x7f9998149c60 0x7f99980ba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:39.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 -- 172.21.15.78:0/1839320167 >> 172.21.15.78:0/1839320167 conn(0x7f99980c04a0 msgr2=0x7f99980c08a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:39.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 -- 172.21.15.78:0/1839320167 shutdown_connections 2023-06-02T15:30:39.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 -- 172.21.15.78:0/1839320167 wait complete. 2023-06-02T15:30:39.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 Processor -- start 2023-06-02T15:30:39.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 -- start start 2023-06-02T15:30:39.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99980a20b0 0x7f99980a3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:39.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980b9ed0 0x7f99981e6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:39.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998149c60 0x7f99981e7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:39.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99980a15a0 con 0x7f9998149c60 2023-06-02T15:30:39.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99981e7c20 con 0x7f99980a20b0 2023-06-02T15:30:39.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99980a12c0 con 0x7f99980b9ed0 2023-06-02T15:30:39.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999dcb1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998149c60 0x7f99981e7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:39.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999dcb1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998149c60 0x7f99981e7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40870/0 (socket says 172.21.15.78:40870) 2023-06-02T15:30:39.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999dcb1640 1 -- 172.21.15.78:0/3972424063 learned_addr learned my addr 172.21.15.78:0/3972424063 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:39.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999ccaf640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980b9ed0 0x7f99981e6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:39.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999dcb1640 1 -- 172.21.15.78:0/3972424063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980b9ed0 msgr2=0x7f99981e6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:39.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999dcb1640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980b9ed0 0x7f99981e6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:39.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999dcb1640 1 -- 172.21.15.78:0/3972424063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99980a20b0 msgr2=0x7f99980a3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999dcb1640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99980a20b0 0x7f99980a3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999dcb1640 1 -- 172.21.15.78:0/3972424063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99940094d0 con 0x7f9998149c60 2023-06-02T15:30:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999dcb1640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998149c60 0x7f99981e7160 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99900b2040 tx=0x7f999001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f998dffb640 1 -- 172.21.15.78:0/3972424063 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990009450 con 0x7f9998149c60 2023-06-02T15:30:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f998dffb640 1 -- 172.21.15.78:0/3972424063 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99900b9410 con 0x7f9998149c60 2023-06-02T15:30:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.795+0000 7f999f714640 1 -- 172.21.15.78:0/3972424063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9990009a70 con 0x7f9998149c60 2023-06-02T15:30:39.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.799+0000 7f998dffb640 1 -- 172.21.15.78:0/3972424063 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99900b97c0 con 0x7f9998149c60 2023-06-02T15:30:39.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.799+0000 7f999f714640 1 -- 172.21.15.78:0/3972424063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f999814d350 con 0x7f9998149c60 2023-06-02T15:30:39.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.799+0000 7f999f714640 1 -- 172.21.15.78:0/3972424063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99980b94f0 con 0x7f9998149c60 2023-06-02T15:30:39.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.799+0000 7f998dffb640 1 -- 172.21.15.78:0/3972424063 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f99900b6050 con 0x7f9998149c60 2023-06-02T15:30:39.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.799+0000 7f998dffb640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f997c065c00 0x7f997c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:39.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.799+0000 7f998dffb640 1 -- 172.21.15.78:0/3972424063 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 6288+0+0 (secure 0 0 0) 0x7f9990121940 con 0x7f9998149c60 2023-06-02T15:30:39.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.799+0000 7f999d4b0640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f997c065c00 0x7f997c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:39.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.799+0000 7f999d4b0640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f997c065c00 0x7f997c0680b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9994006f50 tx=0x7f9994006ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:39.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.803+0000 7f998dffb640 1 -- 172.21.15.78:0/3972424063 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f99900ef030 con 0x7f9998149c60 2023-06-02T15:30:39.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:39.955+0000 7f999f714640 1 -- 172.21.15.78:0/3972424063 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f99980b83d0 con 0x7f9998149c60 2023-06-02T15:30:41.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.647+0000 7f998dffb640 1 -- 172.21.15.78:0/3972424063 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f99900b4100 con 0x7f9998149c60 2023-06-02T15:30:41.659 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data_ec' created 2023-06-02T15:30:41.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.659+0000 7f999f714640 1 -- 172.21.15.78:0/3972424063 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f997c065c00 msgr2=0x7f997c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:41.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.659+0000 7f999f714640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f997c065c00 0x7f997c0680b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9994006f50 tx=0x7f9994006ea0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.659+0000 7f999f714640 1 -- 172.21.15.78:0/3972424063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998149c60 msgr2=0x7f99981e7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:41.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.659+0000 7f999f714640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998149c60 0x7f99981e7160 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f99900b2040 tx=0x7f999001bed0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.663+0000 7f999f714640 1 -- 172.21.15.78:0/3972424063 shutdown_connections 2023-06-02T15:30:41.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.663+0000 7f999f714640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f997c065c00 0x7f997c0680b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.663+0000 7f999f714640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9998149c60 0x7f99981e7160 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.663+0000 7f999f714640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f99980b9ed0 0x7f99981e6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.663+0000 7f999f714640 1 --2- 172.21.15.78:0/3972424063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99980a20b0 0x7f99980a3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.663+0000 7f999f714640 1 -- 172.21.15.78:0/3972424063 >> 172.21.15.78:0/3972424063 conn(0x7f99980c04a0 msgr2=0x7f9998147500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:41.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.663+0000 7f999f714640 1 -- 172.21.15.78:0/3972424063 shutdown_connections 2023-06-02T15:30:41.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.663+0000 7f999f714640 1 -- 172.21.15.78:0/3972424063 wait complete. 2023-06-02T15:30:41.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-06-02T15:30:41.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff740739640 1 Processor -- start 2023-06-02T15:30:41.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff740739640 1 -- start start 2023-06-02T15:30:41.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff740739640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff73806bcb0 0x7ff7380c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:41.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff740739640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7380c2a40 con 0x7ff7380c11e0 2023-06-02T15:30:41.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff740739640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff73806b870 con 0x7ff7380bf150 2023-06-02T15:30:41.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff740739640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff738152a20 con 0x7ff73806bcb0 2023-06-02T15:30:41.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73e4d5640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff7380c11e0 0x7ff7380c0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44670/0 (socket says 172.21.15.78:44670) 2023-06-02T15:30:41.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73e4d5640 1 -- 172.21.15.78:0/3167894716 learned_addr learned my addr 172.21.15.78:0/3167894716 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:41.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398944788 0 0) 0x7ff734001120 con 0x7ff7380c11e0 2023-06-02T15:30:41.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff724003530 con 0x7ff7380c11e0 2023-06-02T15:30:41.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73dcd4640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff73806bcb0 0x7ff7380c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:41.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3129169321 0 0) 0x7ff724003530 con 0x7ff7380c11e0 2023-06-02T15:30:41.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff73806bcb0 msgr2=0x7ff7380c15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:41.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff73806bcb0 0x7ff7380c15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 >> v1:172.21.15.132:6789/0 conn(0x7ff7380bf150 legacy=0x7ff7380a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:41.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380aa540 con 0x7ff7380c11e0 2023-06-02T15:30:41.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7ff734001810 con 0x7ff7380c11e0 2023-06-02T15:30:41.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 >> v1:172.21.15.78:6789/0 conn(0x7ff7380c11e0 legacy=0x7ff7380c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:41.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7240039b0 0x7ff724003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:41.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 0x7ff724004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff73806bcb0 0x7ff7240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff738152a20 con 0x7ff7240047d0 2023-06-02T15:30:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72400bb50 con 0x7ff7240039b0 2023-06-02T15:30:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72400bd10 con 0x7ff73806bcb0 2023-06-02T15:30:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73dcd4640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 0x7ff724004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73e4d5640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7240039b0 0x7ff724003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73ecd6640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff73806bcb0 0x7ff7240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:41.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73dcd4640 1 -- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff73806bcb0 msgr2=0x7ff7240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:41.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73dcd4640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff73806bcb0 0x7ff7240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73dcd4640 1 -- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7240039b0 msgr2=0x7ff724003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:41.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73dcd4640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7240039b0 0x7ff724003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.811+0000 7ff73dcd4640 1 -- 172.21.15.78:0/3167894716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff724003530 con 0x7ff7240047d0 2023-06-02T15:30:41.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff73dcd4640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 0x7ff724004c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff72800ba30 tx=0x7ff72801c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a45461cf2e73e896 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:41.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280ac670 con 0x7ff7240047d0 2023-06-02T15:30:41.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7280ac7d0 con 0x7ff7240047d0 2023-06-02T15:30:41.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff73d4d3640 1 -- 172.21.15.78:0/3167894716 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7280acb80 con 0x7ff7240047d0 2023-06-02T15:30:41.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff740739640 1 -- 172.21.15.78:0/3167894716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 msgr2=0x7ff724004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:41.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff740739640 1 --2- 172.21.15.78:0/3167894716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 0x7ff724004c40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff72800ba30 tx=0x7ff72801c5c0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff73ecd6640 1 -- 172.21.15.78:0/3167894716 reap_dead start 2023-06-02T15:30:41.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff740739640 1 -- 172.21.15.78:0/3167894716 shutdown_connections 2023-06-02T15:30:41.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff740739640 1 -- 172.21.15.78:0/3167894716 >> 172.21.15.78:0/3167894716 conn(0x7ff7380c47d0 msgr2=0x7ff7380c4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:41.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff740739640 1 -- 172.21.15.78:0/3167894716 shutdown_connections 2023-06-02T15:30:41.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff740739640 1 -- 172.21.15.78:0/3167894716 wait complete. 2023-06-02T15:30:41.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff740739640 1 Processor -- start 2023-06-02T15:30:41.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.815+0000 7ff740739640 1 -- start start 2023-06-02T15:30:41.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff740739640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 0x7ff7381da530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:41.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff740739640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7380be380 0x7ff7381e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:41.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff740739640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7381e7a40 0x7ff7381d94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:41.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff740739640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7381e7eb0 con 0x7ff7240047d0 2023-06-02T15:30:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff740739640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7381daa70 con 0x7ff7381e7a40 2023-06-02T15:30:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff740739640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380bde30 con 0x7ff7380be380 2023-06-02T15:30:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73e4d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 0x7ff7381da530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73e4d5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 0x7ff7381da530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40890/0 (socket says 172.21.15.78:40890) 2023-06-02T15:30:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73e4d5640 1 -- 172.21.15.78:0/4000164046 learned_addr learned my addr 172.21.15.78:0/4000164046 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73dcd4640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7380be380 0x7ff7381e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:41.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73ecd6640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7381e7a40 0x7ff7381d94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73e4d5640 1 -- 172.21.15.78:0/4000164046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7380be380 msgr2=0x7ff7381e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73e4d5640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7380be380 0x7ff7381e7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73e4d5640 1 -- 172.21.15.78:0/4000164046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7381e7a40 msgr2=0x7ff7381d94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73e4d5640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7381e7a40 0x7ff7381d94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73e4d5640 1 -- 172.21.15.78:0/4000164046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380c15b0 con 0x7ff7240047d0 2023-06-02T15:30:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73ecd6640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7381e7a40 0x7ff7381d94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73e4d5640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 0x7ff7381da530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff73400e850 tx=0x7ff73400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:41.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff72effd640 1 -- 172.21.15.78:0/4000164046 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73400c8d0 con 0x7ff7240047d0 2023-06-02T15:30:41.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff72effd640 1 -- 172.21.15.78:0/4000164046 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73400ca30 con 0x7ff7240047d0 2023-06-02T15:30:41.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff740739640 1 -- 172.21.15.78:0/4000164046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7380c26d0 con 0x7ff7240047d0 2023-06-02T15:30:41.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff72effd640 1 -- 172.21.15.78:0/4000164046 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73400cdc0 con 0x7ff7240047d0 2023-06-02T15:30:41.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff740739640 1 -- 172.21.15.78:0/4000164046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7380c1740 con 0x7ff7240047d0 2023-06-02T15:30:41.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff740739640 1 -- 172.21.15.78:0/4000164046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff73804dd40 con 0x7ff7240047d0 2023-06-02T15:30:41.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff72effd640 1 -- 172.21.15.78:0/4000164046 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7ff73401d460 con 0x7ff7240047d0 2023-06-02T15:30:41.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff72effd640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff71c065c00 0x7ff71c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:41.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff72effd640 1 -- 172.21.15.78:0/4000164046 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6781+0+0 (secure 0 0 0) 0x7ff734083540 con 0x7ff7240047d0 2023-06-02T15:30:41.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73dcd4640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff71c065c00 0x7ff71c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:41.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.819+0000 7ff73dcd4640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff71c065c00 0x7ff71c0680b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7280b0000 tx=0x7ff7280b7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:41.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.823+0000 7ff72effd640 1 -- 172.21.15.78:0/4000164046 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7ff734050a40 con 0x7ff7240047d0 2023-06-02T15:30:41.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:41.975+0000 7ff740739640 1 -- 172.21.15.78:0/4000164046 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7ff7380c2a40 con 0x7ff7240047d0 2023-06-02T15:30:42.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.651+0000 7ff72effd640 1 -- 172.21.15.78:0/4000164046 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff7380c2a40 con 0x7ff7240047d0 2023-06-02T15:30:42.662 INFO:teuthology.orchestra.run.smithi078.stderr:set pool 5 allow_ec_overwrites to true 2023-06-02T15:30:42.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.659+0000 7ff740739640 1 -- 172.21.15.78:0/4000164046 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff71c065c00 msgr2=0x7ff71c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:42.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.659+0000 7ff740739640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff71c065c00 0x7ff71c0680b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff7280b0000 tx=0x7ff7280b7040 comp rx=0 tx=0).stop 2023-06-02T15:30:42.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.659+0000 7ff740739640 1 -- 172.21.15.78:0/4000164046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 msgr2=0x7ff7381da530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:42.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.659+0000 7ff740739640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 0x7ff7381da530 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff73400e850 tx=0x7ff73400ed10 comp rx=0 tx=0).stop 2023-06-02T15:30:42.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.663+0000 7ff740739640 1 -- 172.21.15.78:0/4000164046 shutdown_connections 2023-06-02T15:30:42.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.663+0000 7ff740739640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7381e7a40 0x7ff7381d94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:42.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.663+0000 7ff740739640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff7380be380 0x7ff7381e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:42.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.663+0000 7ff740739640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff71c065c00 0x7ff71c0680b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:42.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.663+0000 7ff740739640 1 --2- 172.21.15.78:0/4000164046 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7240047d0 0x7ff7381da530 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:42.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.663+0000 7ff740739640 1 -- 172.21.15.78:0/4000164046 >> 172.21.15.78:0/4000164046 conn(0x7ff7380c47d0 msgr2=0x7ff7381485a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:42.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.663+0000 7ff740739640 1 -- 172.21.15.78:0/4000164046 shutdown_connections 2023-06-02T15:30:42.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.663+0000 7ff740739640 1 -- 172.21.15.78:0/4000164046 wait complete. 2023-06-02T15:30:42.713 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-06-02T15:30:42.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7e93c640 1 Processor -- start 2023-06-02T15:30:42.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7e93c640 1 -- start start 2023-06-02T15:30:42.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7e93c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faa7806e410 0x7faa78157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:42.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7e93c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa78149dd0 con 0x7faa780be910 2023-06-02T15:30:42.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7e93c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7814f900 con 0x7faa78149a00 2023-06-02T15:30:42.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7e93c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa781502a0 con 0x7faa7806e410 2023-06-02T15:30:42.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa777fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7faa780be910 0x7faa7814c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44674/0 (socket says 172.21.15.78:44674) 2023-06-02T15:30:42.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa777fe640 1 -- 172.21.15.78:0/3890884837 learned_addr learned my addr 172.21.15.78:0/3890884837 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:42.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7ced9640 1 --2- 172.21.15.78:0/3890884837 >> v2:172.21.15.132:3300/0 conn(0x7faa7806e410 0x7faa78157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:42.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230235266 0 0) 0x7faa78149dd0 con 0x7faa780be910 2023-06-02T15:30:42.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa60003530 con 0x7faa780be910 2023-06-02T15:30:42.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 364581980 0 0) 0x7faa60003530 con 0x7faa780be910 2023-06-02T15:30:42.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 >> v2:172.21.15.132:3300/0 conn(0x7faa7806e410 msgr2=0x7faa78157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:42.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 --2- 172.21.15.78:0/3890884837 >> v2:172.21.15.132:3300/0 conn(0x7faa7806e410 0x7faa78157ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:42.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 >> v1:172.21.15.132:6789/0 conn(0x7faa78149a00 legacy=0x7faa780a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:42.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7814fbe0 con 0x7faa780be910 2023-06-02T15:30:42.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7faa6c001680 con 0x7faa780be910 2023-06-02T15:30:42.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 >> v1:172.21.15.78:6789/0 conn(0x7faa780be910 legacy=0x7faa7814c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:42.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa600039f0 0x7faa60003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:42.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa600047d0 0x7faa60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:42.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:42.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa781502a0 con 0x7faa600051d0 2023-06-02T15:30:42.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6000c110 con 0x7faa600047d0 2023-06-02T15:30:42.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa6000c2d0 con 0x7faa600039f0 2023-06-02T15:30:42.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7ced9640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:42.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa777fe640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa600047d0 0x7faa60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:42.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa77fff640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa600039f0 0x7faa60003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:42.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7ced9640 1 -- 172.21.15.78:0/3890884837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa600039f0 msgr2=0x7faa60003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:42.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7ced9640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa600039f0 0x7faa60003e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:42.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7ced9640 1 -- 172.21.15.78:0/3890884837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa600047d0 msgr2=0x7faa60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:42.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7ced9640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa600047d0 0x7faa60004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:42.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.827+0000 7faa7ced9640 1 -- 172.21.15.78:0/3890884837 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60003530 con 0x7faa600051d0 2023-06-02T15:30:42.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7ced9640 1 -- 172.21.15.78:0/3890884837 reap_dead start 2023-06-02T15:30:42.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7ced9640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa6000b990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa70009f90 tx=0x7faa7001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfdbf58d047bfd server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:42.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70003ba0 con 0x7faa600051d0 2023-06-02T15:30:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7000f040 con 0x7faa600051d0 2023-06-02T15:30:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa76ffd640 1 -- 172.21.15.78:0/3890884837 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa700a5960 con 0x7faa600051d0 2023-06-02T15:30:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 -- 172.21.15.78:0/3890884837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 msgr2=0x7faa6000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa6000b990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faa70009f90 tx=0x7faa7001cc60 comp rx=0 tx=0).stop 2023-06-02T15:30:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 -- 172.21.15.78:0/3890884837 shutdown_connections 2023-06-02T15:30:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 --2- 172.21.15.78:0/3890884837 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa6000b990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 -- 172.21.15.78:0/3890884837 >> 172.21.15.78:0/3890884837 conn(0x7faa780a3180 msgr2=0x7faa780a3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:42.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 -- 172.21.15.78:0/3890884837 shutdown_connections 2023-06-02T15:30:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 -- 172.21.15.78:0/3890884837 wait complete. 2023-06-02T15:30:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 Processor -- start 2023-06-02T15:30:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 -- start start 2023-06-02T15:30:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa780bd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa780ba840 0x7faa78146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa78146f50 0x7faa7814bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:42.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780ba650 con 0x7faa600051d0 2023-06-02T15:30:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa780b9ee0 con 0x7faa780ba840 2023-06-02T15:30:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.831+0000 7faa7e93c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780bd580 con 0x7faa78146f50 2023-06-02T15:30:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa77fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa780bd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa77fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa780bd040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40910/0 (socket says 172.21.15.78:40910) 2023-06-02T15:30:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa77fff640 1 -- 172.21.15.78:0/1279722210 learned_addr learned my addr 172.21.15.78:0/1279722210 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa77fff640 1 -- 172.21.15.78:0/1279722210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa78146f50 msgr2=0x7faa7814bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa77fff640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa78146f50 0x7faa7814bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:42.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa77fff640 1 -- 172.21.15.78:0/1279722210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa780ba840 msgr2=0x7faa78146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa77fff640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa780ba840 0x7faa78146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa77fff640 1 -- 172.21.15.78:0/1279722210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa781506c0 con 0x7faa600051d0 2023-06-02T15:30:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa77fff640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa780bd040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa6800d520 tx=0x7faa6800d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa74ff9640 1 -- 172.21.15.78:0/1279722210 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa68005480 con 0x7faa600051d0 2023-06-02T15:30:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa74ff9640 1 -- 172.21.15.78:0/1279722210 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa68003620 con 0x7faa600051d0 2023-06-02T15:30:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa7e93c640 1 -- 172.21.15.78:0/1279722210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa7814fec0 con 0x7faa600051d0 2023-06-02T15:30:42.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa74ff9640 1 -- 172.21.15.78:0/1279722210 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa680039b0 con 0x7faa600051d0 2023-06-02T15:30:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa7e93c640 1 -- 172.21.15.78:0/1279722210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa780c0270 con 0x7faa600051d0 2023-06-02T15:30:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa7e93c640 1 -- 172.21.15.78:0/1279722210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa78073bc0 con 0x7faa600051d0 2023-06-02T15:30:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa74ff9640 1 -- 172.21.15.78:0/1279722210 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7faa68003b10 con 0x7faa600051d0 2023-06-02T15:30:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa74ff9640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faa64065c00 0x7faa640680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa74ff9640 1 -- 172.21.15.78:0/1279722210 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6781+0+0 (secure 0 0 0) 0x7faa68083590 con 0x7faa600051d0 2023-06-02T15:30:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa777fe640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faa64065c00 0x7faa640680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:42.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.835+0000 7faa777fe640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faa64065c00 0x7faa640680b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa6c004880 tx=0x7faa6c000fa0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:42.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:42.839+0000 7faa74ff9640 1 -- 172.21.15.78:0/1279722210 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7faa68050970 con 0x7faa600051d0 2023-06-02T15:30:43.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.023+0000 7faa7e93c640 1 -- 172.21.15.78:0/1279722210 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7faa780c0030 con 0x7faa600051d0 2023-06-02T15:30:43.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa74ff9640 1 -- 172.21.15.78:0/1279722210 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7faa680528a0 con 0x7faa600051d0 2023-06-02T15:30:43.042 INFO:teuthology.orchestra.run.smithi078.stderr:added data pool 5 to fsmap 2023-06-02T15:30:43.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 -- 172.21.15.78:0/1279722210 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faa64065c00 msgr2=0x7faa640680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faa64065c00 0x7faa640680b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faa6c004880 tx=0x7faa6c000fa0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 -- 172.21.15.78:0/1279722210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 msgr2=0x7faa780bd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa780bd040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7faa6800d520 tx=0x7faa6800d9e0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 -- 172.21.15.78:0/1279722210 shutdown_connections 2023-06-02T15:30:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7faa78146f50 0x7faa7814bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa780ba840 0x7faa78146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faa64065c00 0x7faa640680b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 --2- 172.21.15.78:0/1279722210 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faa600051d0 0x7faa780bd040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 -- 172.21.15.78:0/1279722210 >> 172.21.15.78:0/1279722210 conn(0x7faa780a3180 msgr2=0x7faa780a3550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:43.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 -- 172.21.15.78:0/1279722210 shutdown_connections 2023-06-02T15:30:43.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.035+0000 7faa7e93c640 1 -- 172.21.15.78:0/1279722210 wait complete. 2023-06-02T15:30:43.061 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-02T15:30:43.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f734adcd640 1 Processor -- start 2023-06-02T15:30:43.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f734adcd640 1 -- start start 2023-06-02T15:30:43.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f734adcd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f734406bd00 0x7f73440bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f734adcd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f73440bf2b0 0x7f7344069f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f734adcd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73440c0730 con 0x7f73440b7fc0 2023-06-02T15:30:43.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f734adcd640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f734406b5f0 con 0x7f734406bd00 2023-06-02T15:30:43.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f734adcd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73440c04a0 con 0x7f73440bf2b0 2023-06-02T15:30:43.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f7348b69640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f734406bd00 0x7f73440bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f734936a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f73440b7fc0 0x7f73440c2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44690/0 (socket says 172.21.15.78:44690) 2023-06-02T15:30:43.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f734936a640 1 -- 172.21.15.78:0/1917129303 learned_addr learned my addr 172.21.15.78:0/1917129303 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:43.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.167+0000 7f7343fff640 1 --2- 172.21.15.78:0/1917129303 >> v2:172.21.15.132:3300/0 conn(0x7f73440bf2b0 0x7f7344069f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f7348b69640 1 -- 172.21.15.78:0/1917129303 >> v2:172.21.15.132:3300/0 conn(0x7f73440bf2b0 msgr2=0x7f7344069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:43.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f7348b69640 1 --2- 172.21.15.78:0/1917129303 >> v2:172.21.15.132:3300/0 conn(0x7f73440bf2b0 0x7f7344069f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f7348b69640 1 -- 172.21.15.78:0/1917129303 >> v1:172.21.15.78:6789/0 conn(0x7f73440b7fc0 legacy=0x7f73440c2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f7348b69640 1 -- 172.21.15.78:0/1917129303 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73440c0b20 con 0x7f734406bd00 2023-06-02T15:30:43.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f73437fe640 1 -- 172.21.15.78:0/1917129303 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 595954221 0 0) 0x7f73440c0730 con 0x7f73440b7fc0 2023-06-02T15:30:43.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f7348b69640 1 --2- 172.21.15.78:0/1917129303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f734406bd00 0x7f73440bff60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73440c3be0 tx=0x7f733401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdf2cb614644d0c7 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f73437fe640 1 -- 172.21.15.78:0/1917129303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340ab600 con 0x7f734406bd00 2023-06-02T15:30:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f73437fe640 1 -- 172.21.15.78:0/1917129303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73340a7050 con 0x7f734406bd00 2023-06-02T15:30:43.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f73437fe640 1 -- 172.21.15.78:0/1917129303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73340ab980 con 0x7f734406bd00 2023-06-02T15:30:43.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f734adcd640 1 -- 172.21.15.78:0/1917129303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f734406bd00 msgr2=0x7f73440bff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f734adcd640 1 --2- 172.21.15.78:0/1917129303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f734406bd00 0x7f73440bff60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f73440c3be0 tx=0x7f733401c460 comp rx=0 tx=0).stop 2023-06-02T15:30:43.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f734adcd640 1 -- 172.21.15.78:0/1917129303 shutdown_connections 2023-06-02T15:30:43.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f734adcd640 1 --2- 172.21.15.78:0/1917129303 >> v2:172.21.15.132:3300/0 conn(0x7f73440bf2b0 0x7f7344069f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f734adcd640 1 --2- 172.21.15.78:0/1917129303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f734406bd00 0x7f73440bff60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f734adcd640 1 -- 172.21.15.78:0/1917129303 >> 172.21.15.78:0/1917129303 conn(0x7f73440a6480 msgr2=0x7f73440a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:43.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f734adcd640 1 -- 172.21.15.78:0/1917129303 shutdown_connections 2023-06-02T15:30:43.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.171+0000 7f734adcd640 1 -- 172.21.15.78:0/1917129303 wait complete. 2023-06-02T15:30:43.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 Processor -- start 2023-06-02T15:30:43.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 -- start start 2023-06-02T15:30:43.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f734406bd00 0x7f7344154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73440b7fc0 0x7f7344099e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440bf2b0 0x7f73441e6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73441e6480 con 0x7f73440bf2b0 2023-06-02T15:30:43.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7344155f40 con 0x7f73440b7fc0 2023-06-02T15:30:43.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734409a380 con 0x7f734406bd00 2023-06-02T15:30:43.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734936a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440bf2b0 0x7f73441e6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734936a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440bf2b0 0x7f73441e6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40928/0 (socket says 172.21.15.78:40928) 2023-06-02T15:30:43.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734936a640 1 -- 172.21.15.78:0/224154293 learned_addr learned my addr 172.21.15.78:0/224154293 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:43.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f7348b69640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f734406bd00 0x7f7344154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f7343fff640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73440b7fc0 0x7f7344099e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734936a640 1 -- 172.21.15.78:0/224154293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f734406bd00 msgr2=0x7f7344154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734936a640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f734406bd00 0x7f7344154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734936a640 1 -- 172.21.15.78:0/224154293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73440b7fc0 msgr2=0x7f7344099e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734936a640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73440b7fc0 0x7f7344099e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734936a640 1 -- 172.21.15.78:0/224154293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7334009420 con 0x7f73440bf2b0 2023-06-02T15:30:43.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734936a640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440bf2b0 0x7f73441e6e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f733c00c810 tx=0x7f733c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:43.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f73417fa640 1 -- 172.21.15.78:0/224154293 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c00a640 con 0x7f73440bf2b0 2023-06-02T15:30:43.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f73417fa640 1 -- 172.21.15.78:0/224154293 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733c00a7c0 con 0x7f73440bf2b0 2023-06-02T15:30:43.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 -- 172.21.15.78:0/224154293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734406c0d0 con 0x7f73440bf2b0 2023-06-02T15:30:43.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f73417fa640 1 -- 172.21.15.78:0/224154293 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733c00ab70 con 0x7f73440bf2b0 2023-06-02T15:30:43.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 -- 172.21.15.78:0/224154293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73440c1310 con 0x7f73440bf2b0 2023-06-02T15:30:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.175+0000 7f734adcd640 1 -- 172.21.15.78:0/224154293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f734406c260 con 0x7f73440bf2b0 2023-06-02T15:30:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.179+0000 7f73417fa640 1 -- 172.21.15.78:0/224154293 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f733c00acd0 con 0x7f73440bf2b0 2023-06-02T15:30:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.179+0000 7f73417fa640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7330065c00 0x7f73300680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.179+0000 7f73417fa640 1 -- 172.21.15.78:0/224154293 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f733c082f50 con 0x7f73440bf2b0 2023-06-02T15:30:43.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.179+0000 7f7348b69640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7330065c00 0x7f73300680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.179+0000 7f7348b69640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7330065c00 0x7f73300680b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f73340ad000 tx=0x7f7334008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:43.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.183+0000 7f73417fa640 1 -- 172.21.15.78:0/224154293 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f733c0503a0 con 0x7f73440bf2b0 2023-06-02T15:30:43.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.367+0000 7f734adcd640 1 -- 172.21.15.78:0/224154293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73441560e0 con 0x7f73440bf2b0 2023-06-02T15:30:43.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f73417fa640 1 -- 172.21.15.78:0/224154293 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3888 (secure 0 0 0) 0x7f733c018070 con 0x7f73440bf2b0 2023-06-02T15:30:43.377 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:43.377 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/4074209272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4074209272},{"type":"v1","addr":"172.21.15.78:6836","nonce":4074209272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/987093145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":987093145},{"type":"v1","addr":"172.21.15.78:6837","nonce":987093145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-02T15:30:38.611635+0000","modified":"2023-06-02T15:30:43.029755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/3115859297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3115859297},{"type":"v1","addr":"172.21.15.132:6833","nonce":3115859297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-02T15:30:43.378 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 7 2023-06-02T15:30:43.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f734adcd640 1 -- 172.21.15.78:0/224154293 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7330065c00 msgr2=0x7f73300680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f734adcd640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7330065c00 0x7f73300680b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f73340ad000 tx=0x7f7334008040 comp rx=0 tx=0).stop 2023-06-02T15:30:43.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f734adcd640 1 -- 172.21.15.78:0/224154293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440bf2b0 msgr2=0x7f73441e6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f734adcd640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440bf2b0 0x7f73441e6e50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f733c00c810 tx=0x7f733c00ccd0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f734adcd640 1 -- 172.21.15.78:0/224154293 shutdown_connections 2023-06-02T15:30:43.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f734adcd640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7330065c00 0x7f73300680b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f734adcd640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73440bf2b0 0x7f73441e6e50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f734adcd640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73440b7fc0 0x7f7344099e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f734adcd640 1 --2- 172.21.15.78:0/224154293 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f734406bd00 0x7f7344154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.371+0000 7f734adcd640 1 -- 172.21.15.78:0/224154293 >> 172.21.15.78:0/224154293 conn(0x7f73440a6480 msgr2=0x7f7344158980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:43.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.375+0000 7f734adcd640 1 -- 172.21.15.78:0/224154293 shutdown_connections 2023-06-02T15:30:43.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.375+0000 7f734adcd640 1 -- 172.21.15.78:0/224154293 wait complete. 2023-06-02T15:30:43.397 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:43.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.507+0000 7f4845c95640 1 Processor -- start 2023-06-02T15:30:43.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.507+0000 7f4845c95640 1 -- start start 2023-06-02T15:30:43.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f4845c95640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4840149e00 0x7f48400a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f4845c95640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48400ba880 0x7f48400a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f4845c95640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48400bb0e0 con 0x7f48400a2930 2023-06-02T15:30:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f4845c95640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484014a1d0 con 0x7f4840149e00 2023-06-02T15:30:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f4845c95640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48400a61d0 con 0x7f48400ba880 2023-06-02T15:30:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4840149e00 0x7f48400a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4840149e00 0x7f48400a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40932/0 (socket says 172.21.15.78:40932) 2023-06-02T15:30:43.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483f7fe640 1 -- 172.21.15.78:0/2905709912 learned_addr learned my addr 172.21.15.78:0/2905709912 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483f7fe640 1 -- 172.21.15.78:0/2905709912 >> v2:172.21.15.132:3300/0 conn(0x7f48400ba880 msgr2=0x7f48400a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483f7fe640 1 --2- 172.21.15.78:0/2905709912 >> v2:172.21.15.132:3300/0 conn(0x7f48400ba880 0x7f48400a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483f7fe640 1 -- 172.21.15.78:0/2905709912 >> v1:172.21.15.132:6789/0 conn(0x7f48400a2930 legacy=0x7f484014fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:43.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483f7fe640 1 -- 172.21.15.78:0/2905709912 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48400a3810 con 0x7f4840149e00 2023-06-02T15:30:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483f7fe640 1 --2- 172.21.15.78:0/2905709912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 0x7f48400a5bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f48400bcf20 tx=0x7f483001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae68026ba38714d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483e7fc640 1 -- 172.21.15.78:0/2905709912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300ab600 con 0x7f4840149e00 2023-06-02T15:30:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483e7fc640 1 -- 172.21.15.78:0/2905709912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48300a7050 con 0x7f4840149e00 2023-06-02T15:30:43.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.511+0000 7f483e7fc640 1 -- 172.21.15.78:0/2905709912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48300ab980 con 0x7f4840149e00 2023-06-02T15:30:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- 172.21.15.78:0/2905709912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 msgr2=0x7f48400a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 --2- 172.21.15.78:0/2905709912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 0x7f48400a5bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f48400bcf20 tx=0x7f483001c4c0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- 172.21.15.78:0/2905709912 shutdown_connections 2023-06-02T15:30:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 --2- 172.21.15.78:0/2905709912 >> v2:172.21.15.132:3300/0 conn(0x7f48400ba880 0x7f48400a23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 --2- 172.21.15.78:0/2905709912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 0x7f48400a5bd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- 172.21.15.78:0/2905709912 >> 172.21.15.78:0/2905709912 conn(0x7f48400bcf50 msgr2=0x7f48400bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- 172.21.15.78:0/2905709912 shutdown_connections 2023-06-02T15:30:43.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- 172.21.15.78:0/2905709912 wait complete. 2023-06-02T15:30:43.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 Processor -- start 2023-06-02T15:30:43.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- start start 2023-06-02T15:30:43.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48400a2930 0x7f4840146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48400ba880 0x7f48400be9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 0x7f48400beee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400c0b50 con 0x7f4840149e00 2023-06-02T15:30:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48400be7f0 con 0x7f48400ba880 2023-06-02T15:30:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48400be080 con 0x7f48400a2930 2023-06-02T15:30:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 0x7f48400beee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 0x7f48400beee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:40938/0 (socket says 172.21.15.78:40938) 2023-06-02T15:30:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483ffff640 1 -- 172.21.15.78:0/2089124483 learned_addr learned my addr 172.21.15.78:0/2089124483 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:43.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483f7fe640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48400a2930 0x7f4840146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483ffff640 1 -- 172.21.15.78:0/2089124483 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48400a2930 msgr2=0x7f4840146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483ffff640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48400a2930 0x7f4840146c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483ffff640 1 -- 172.21.15.78:0/2089124483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48400ba880 msgr2=0x7f48400be9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483effd640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48400ba880 0x7f48400be9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483ffff640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48400ba880 0x7f48400be9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483ffff640 1 -- 172.21.15.78:0/2089124483 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48300094d0 con 0x7f4840149e00 2023-06-02T15:30:43.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483f7fe640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48400a2930 0x7f4840146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:43.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483effd640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48400ba880 0x7f48400be9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:43.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f483ffff640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 0x7f48400beee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f483800c780 tx=0x7f483800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:43.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4837fff640 1 -- 172.21.15.78:0/2089124483 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4838003d90 con 0x7f4840149e00 2023-06-02T15:30:43.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4837fff640 1 -- 172.21.15.78:0/2089124483 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483800ce90 con 0x7f4840149e00 2023-06-02T15:30:43.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- 172.21.15.78:0/2089124483 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4840150ad0 con 0x7f4840149e00 2023-06-02T15:30:43.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4837fff640 1 -- 172.21.15.78:0/2089124483 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48380052b0 con 0x7f4840149e00 2023-06-02T15:30:43.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.515+0000 7f4845c95640 1 -- 172.21.15.78:0/2089124483 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4840150940 con 0x7f4840149e00 2023-06-02T15:30:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.519+0000 7f4845c95640 1 -- 172.21.15.78:0/2089124483 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4840159700 con 0x7f4840149e00 2023-06-02T15:30:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.519+0000 7f4837fff640 1 -- 172.21.15.78:0/2089124483 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f4838005410 con 0x7f4840149e00 2023-06-02T15:30:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.519+0000 7f4837fff640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4820065c00 0x7f48200680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.519+0000 7f4837fff640 1 -- 172.21.15.78:0/2089124483 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4838082f70 con 0x7f4840149e00 2023-06-02T15:30:43.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.519+0000 7f483f7fe640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4820065c00 0x7f48200680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.519+0000 7f483f7fe640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4820065c00 0x7f48200680b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48300ad000 tx=0x7f4830008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:43.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.523+0000 7f4837fff640 1 -- 172.21.15.78:0/2089124483 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f48380503b0 con 0x7f4840149e00 2023-06-02T15:30:43.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.675+0000 7f4845c95640 1 -- 172.21.15.78:0/2089124483 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4840073bc0 con 0x7f4840149e00 2023-06-02T15:30:43.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4837fff640 1 -- 172.21.15.78:0/2089124483 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f4838017070 con 0x7f4840149e00 2023-06-02T15:30:43.686 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:43.686 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:43.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 -- 172.21.15.78:0/2089124483 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4820065c00 msgr2=0x7f48200680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4820065c00 0x7f48200680b0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f48300ad000 tx=0x7f4830008040 comp rx=0 tx=0).stop 2023-06-02T15:30:43.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 -- 172.21.15.78:0/2089124483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 msgr2=0x7f48400beee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 0x7f48400beee0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f483800c780 tx=0x7f483800cc40 comp rx=0 tx=0).stop 2023-06-02T15:30:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 -- 172.21.15.78:0/2089124483 shutdown_connections 2023-06-02T15:30:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4820065c00 0x7f48200680b0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4840149e00 0x7f48400beee0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48400ba880 0x7f48400be9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 --2- 172.21.15.78:0/2089124483 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f48400a2930 0x7f4840146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 -- 172.21.15.78:0/2089124483 >> 172.21.15.78:0/2089124483 conn(0x7f48400bcf50 msgr2=0x7f4840142be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:43.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 -- 172.21.15.78:0/2089124483 shutdown_connections 2023-06-02T15:30:43.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.679+0000 7f4845c95640 1 -- 172.21.15.78:0/2089124483 wait complete. 2023-06-02T15:30:43.705 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:43.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad289b640 1 Processor -- start 2023-06-02T15:30:43.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad289b640 1 -- start start 2023-06-02T15:30:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad289b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc06cc00 0x7f2acc0bda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad289b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2acc14ea10 con 0x7f2acc09fc70 2023-06-02T15:30:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad289b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2acc14ecf0 con 0x7f2acc144c80 2023-06-02T15:30:43.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad289b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0a1da0 con 0x7f2acc06cc00 2023-06-02T15:30:43.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acb7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2acc09fc70 0x7f2acc144570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44782/0 (socket says 172.21.15.78:44782) 2023-06-02T15:30:43.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acb7fe640 1 -- 172.21.15.78:0/3467826491 learned_addr learned my addr 172.21.15.78:0/3467826491 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:43.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338021294 0 0) 0x7f2acc14ea10 con 0x7f2acc09fc70 2023-06-02T15:30:43.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ab4003450 con 0x7f2acc09fc70 2023-06-02T15:30:43.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acbfff640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc06cc00 0x7f2acc0bda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 501520639 0 0) 0x7f2ab4003450 con 0x7f2acc09fc70 2023-06-02T15:30:43.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc06cc00 msgr2=0x7f2acc0bda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:43.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc06cc00 0x7f2acc0bda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 >> v1:172.21.15.132:6789/0 conn(0x7f2acc144c80 legacy=0x7f2acc14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc0bc7e0 con 0x7f2acc09fc70 2023-06-02T15:30:43.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f2ac0001680 con 0x7f2acc09fc70 2023-06-02T15:30:43.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acbfff640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc06cc00 0x7f2acc0bda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:43.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 >> v1:172.21.15.78:6789/0 conn(0x7f2acc09fc70 legacy=0x7f2acc144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc06cc00 0x7f2ab4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab4004090 0x7f2ab400a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 0x7f2ab400d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc0a1da0 con 0x7f2ab400b0d0 2023-06-02T15:30:43.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab400de10 con 0x7f2ab4004090 2023-06-02T15:30:43.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab400dfd0 con 0x7f2acc06cc00 2023-06-02T15:30:43.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad0e38640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 0x7f2ab400d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acbfff640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc06cc00 0x7f2ab4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acb7fe640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab4004090 0x7f2ab400a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad0e38640 1 -- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc06cc00 msgr2=0x7f2ab4003aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:43.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad0e38640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc06cc00 0x7f2ab4003aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad0e38640 1 -- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab4004090 msgr2=0x7f2ab400a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:43.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad0e38640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ab4004090 0x7f2ab400a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2ad0e38640 1 -- 172.21.15.78:0/3467826491 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ab4003450 con 0x7f2ab400b0d0 2023-06-02T15:30:43.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.811+0000 7f2acbfff640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc06cc00 0x7f2ab4003aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:43.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad0e38640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 0x7f2ab400d530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4001e40 tx=0x7f2ac401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34be60d4aac7f92 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:43.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4003b80 con 0x7f2ab400b0d0 2023-06-02T15:30:43.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ac4003ce0 con 0x7f2ab400b0d0 2023-06-02T15:30:43.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2acaffd640 1 -- 172.21.15.78:0/3467826491 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4005310 con 0x7f2ab400b0d0 2023-06-02T15:30:43.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 -- 172.21.15.78:0/3467826491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 msgr2=0x7f2ab400d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 --2- 172.21.15.78:0/3467826491 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 0x7f2ab400d530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4001e40 tx=0x7f2ac401c740 comp rx=0 tx=0).stop 2023-06-02T15:30:43.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad0e38640 1 -- 172.21.15.78:0/3467826491 reap_dead start 2023-06-02T15:30:43.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 -- 172.21.15.78:0/3467826491 shutdown_connections 2023-06-02T15:30:43.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 -- 172.21.15.78:0/3467826491 >> 172.21.15.78:0/3467826491 conn(0x7f2acc0bcf50 msgr2=0x7f2acc0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:43.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 -- 172.21.15.78:0/3467826491 shutdown_connections 2023-06-02T15:30:43.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 -- 172.21.15.78:0/3467826491 wait complete. 2023-06-02T15:30:43.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 Processor -- start 2023-06-02T15:30:43.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 -- start start 2023-06-02T15:30:43.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 0x7f2acc146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2acc0b9ae0 0x7f2acc0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc071b10 0x7f2acc1e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc1eab80 con 0x7f2ab400b0d0 2023-06-02T15:30:43.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc14a950 con 0x7f2acc0b9ae0 2023-06-02T15:30:43.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2ad289b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2acc071f80 con 0x7f2acc071b10 2023-06-02T15:30:43.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2acbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 0x7f2acc146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2acbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 0x7f2acc146bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53282/0 (socket says 172.21.15.78:53282) 2023-06-02T15:30:43.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.815+0000 7f2acbfff640 1 -- 172.21.15.78:0/1630561230 learned_addr learned my addr 172.21.15.78:0/1630561230 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:43.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2acb7fe640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2acc0b9ae0 0x7f2acc0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2ad0e38640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc071b10 0x7f2acc1e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2acbfff640 1 -- 172.21.15.78:0/1630561230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc071b10 msgr2=0x7f2acc1e69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2acbfff640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc071b10 0x7f2acc1e69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2acbfff640 1 -- 172.21.15.78:0/1630561230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2acc0b9ae0 msgr2=0x7f2acc0715d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2acbfff640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2acc0b9ae0 0x7f2acc0715d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2acbfff640 1 -- 172.21.15.78:0/1630561230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2acc14b7c0 con 0x7f2ab400b0d0 2023-06-02T15:30:43.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2acbfff640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 0x7f2acc146bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2abc010890 tx=0x7f2abc010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:43.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2ac8ff9640 1 -- 172.21.15.78:0/1630561230 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00eb60 con 0x7f2ab400b0d0 2023-06-02T15:30:43.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2ac8ff9640 1 -- 172.21.15.78:0/1630561230 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2abc00c050 con 0x7f2ab400b0d0 2023-06-02T15:30:43.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2ad289b640 1 -- 172.21.15.78:0/1630561230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2acc14b630 con 0x7f2ab400b0d0 2023-06-02T15:30:43.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2ac8ff9640 1 -- 172.21.15.78:0/1630561230 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2abc00eee0 con 0x7f2ab400b0d0 2023-06-02T15:30:43.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2ad289b640 1 -- 172.21.15.78:0/1630561230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2acc0a5860 con 0x7f2ab400b0d0 2023-06-02T15:30:43.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2ad289b640 1 -- 172.21.15.78:0/1630561230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2acc073bc0 con 0x7f2ab400b0d0 2023-06-02T15:30:43.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2ac8ff9640 1 -- 172.21.15.78:0/1630561230 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f2abc015470 con 0x7f2ab400b0d0 2023-06-02T15:30:43.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2ac8ff9640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2ab8065c30 0x7f2ab80680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:43.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2acb7fe640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2ab8065c30 0x7f2ab80680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:43.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2ac8ff9640 1 -- 172.21.15.78:0/1630561230 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2abc084060 con 0x7f2ab400b0d0 2023-06-02T15:30:43.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.819+0000 7f2acb7fe640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2ab8065c30 0x7f2ab80680e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00010f0 tx=0x7f2ac0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:43.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.823+0000 7f2ac8ff9640 1 -- 172.21.15.78:0/1630561230 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f2abc051540 con 0x7f2ab400b0d0 2023-06-02T15:30:43.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.971+0000 7f2ad289b640 1 -- 172.21.15.78:0/1630561230 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2acc0ba4c0 con 0x7f2ab400b0d0 2023-06-02T15:30:43.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ac8ff9640 1 -- 172.21.15.78:0/1630561230 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f2abc054b60 con 0x7f2ab400b0d0 2023-06-02T15:30:43.982 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:43.982 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 -- 172.21.15.78:0/1630561230 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2ab8065c30 msgr2=0x7f2ab80680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2ab8065c30 0x7f2ab80680e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00010f0 tx=0x7f2ac0009040 comp rx=0 tx=0).stop 2023-06-02T15:30:43.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 -- 172.21.15.78:0/1630561230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 msgr2=0x7f2acc146bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:43.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 0x7f2acc146bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2abc010890 tx=0x7f2abc010d50 comp rx=0 tx=0).stop 2023-06-02T15:30:43.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 -- 172.21.15.78:0/1630561230 shutdown_connections 2023-06-02T15:30:43.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2acc071b10 0x7f2acc1e69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2acc0b9ae0 0x7f2acc0715d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2ab8065c30 0x7f2ab80680e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 --2- 172.21.15.78:0/1630561230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2ab400b0d0 0x7f2acc146bd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:43.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 -- 172.21.15.78:0/1630561230 >> 172.21.15.78:0/1630561230 conn(0x7f2acc0bcf50 msgr2=0x7f2acc0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:43.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 -- 172.21.15.78:0/1630561230 shutdown_connections 2023-06-02T15:30:43.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:43.975+0000 7f2ad289b640 1 -- 172.21.15.78:0/1630561230 wait complete. 2023-06-02T15:30:44.012 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-02T15:30:44.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.115+0000 7fa96d516640 1 Processor -- start 2023-06-02T15:30:44.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.115+0000 7fa96d516640 1 -- start start 2023-06-02T15:30:44.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa96d516640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa96814f330 0x7fa96814bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa96d516640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa96814ba90 con 0x7fa9680bc1c0 2023-06-02T15:30:44.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa96d516640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9680a47b0 con 0x7fa9680a0020 2023-06-02T15:30:44.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa96d516640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa96814f7c0 con 0x7fa96814f330 2023-06-02T15:30:44.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa966ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa9680bc1c0 0x7fa9680a40a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44786/0 (socket says 172.21.15.78:44786) 2023-06-02T15:30:44.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa966ffd640 1 -- 172.21.15.78:0/1902100787 learned_addr learned my addr 172.21.15.78:0/1902100787 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793363443 0 0) 0x7fa96814ba90 con 0x7fa9680bc1c0 2023-06-02T15:30:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa954003530 con 0x7fa9680bc1c0 2023-06-02T15:30:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa95e7fc640 1 --2- 172.21.15.78:0/1902100787 >> v2:172.21.15.132:3300/0 conn(0x7fa96814f330 0x7fa96814bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3059198249 0 0) 0x7fa954003530 con 0x7fa9680bc1c0 2023-06-02T15:30:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 >> v2:172.21.15.132:3300/0 conn(0x7fa96814f330 msgr2=0x7fa96814bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 --2- 172.21.15.78:0/1902100787 >> v2:172.21.15.132:3300/0 conn(0x7fa96814f330 0x7fa96814bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 >> v1:172.21.15.132:6789/0 conn(0x7fa9680a0020 legacy=0x7fa9681487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96814b440 con 0x7fa9680bc1c0 2023-06-02T15:30:44.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fa958001680 con 0x7fa9680bc1c0 2023-06-02T15:30:44.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 >> v1:172.21.15.78:6789/0 conn(0x7fa9680bc1c0 legacy=0x7fa9680a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 --2- 172.21.15.78:0/1902100787 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa954003980 0x7fa954003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 --2- 172.21.15.78:0/1902100787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa954004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 --2- 172.21.15.78:0/1902100787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9540051f0 0x7fa95400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96814f7c0 con 0x7fa9540047d0 2023-06-02T15:30:44.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95400c130 con 0x7fa9540051f0 2023-06-02T15:30:44.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa95400c2f0 con 0x7fa954003980 2023-06-02T15:30:44.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa95e7fc640 1 --2- 172.21.15.78:0/1902100787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa954004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa95e7fc640 1 -- 172.21.15.78:0/1902100787 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa954003980 msgr2=0x7fa954003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa95e7fc640 1 --2- 172.21.15.78:0/1902100787 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa954003980 0x7fa954003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa95e7fc640 1 -- 172.21.15.78:0/1902100787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9540051f0 msgr2=0x7fa95400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9677fe640 1 --2- 172.21.15.78:0/1902100787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9540051f0 0x7fa95400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa95e7fc640 1 --2- 172.21.15.78:0/1902100787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9540051f0 0x7fa95400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa95e7fc640 1 -- 172.21.15.78:0/1902100787 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa954003530 con 0x7fa9540047d0 2023-06-02T15:30:44.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9677fe640 1 -- 172.21.15.78:0/1902100787 reap_dead start 2023-06-02T15:30:44.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa95e7fc640 1 --2- 172.21.15.78:0/1902100787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa954004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa95000ba00 tx=0x7fa95001c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23acb7f1b2393b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500af620 con 0x7fa9540047d0 2023-06-02T15:30:44.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9500af780 con 0x7fa9540047d0 2023-06-02T15:30:44.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.119+0000 7fa9667fc640 1 -- 172.21.15.78:0/1902100787 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9500afb30 con 0x7fa9540047d0 2023-06-02T15:30:44.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- 172.21.15.78:0/1902100787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 msgr2=0x7fa954004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 --2- 172.21.15.78:0/1902100787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa954004c40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa95000ba00 tx=0x7fa95001c640 comp rx=0 tx=0).stop 2023-06-02T15:30:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- 172.21.15.78:0/1902100787 shutdown_connections 2023-06-02T15:30:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 --2- 172.21.15.78:0/1902100787 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa954004c40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- 172.21.15.78:0/1902100787 >> 172.21.15.78:0/1902100787 conn(0x7fa9680bcf50 msgr2=0x7fa9680bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- 172.21.15.78:0/1902100787 shutdown_connections 2023-06-02T15:30:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- 172.21.15.78:0/1902100787 wait complete. 2023-06-02T15:30:44.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 Processor -- start 2023-06-02T15:30:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- start start 2023-06-02T15:30:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa9680be080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680c0fa0 0x7fa968140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa96814e510 0x7fa9681e2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680c0130 con 0x7fa9540047d0 2023-06-02T15:30:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680a24e0 con 0x7fa96814e510 2023-06-02T15:30:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680bf5f0 con 0x7fa9680c0fa0 2023-06-02T15:30:44.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa966ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa9680be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa966ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa9680be080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53296/0 (socket says 172.21.15.78:53296) 2023-06-02T15:30:44.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa966ffd640 1 -- 172.21.15.78:0/543218768 learned_addr learned my addr 172.21.15.78:0/543218768 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:44.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa9677fe640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa96814e510 0x7fa9681e2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa95e7fc640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680c0fa0 0x7fa968140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa966ffd640 1 -- 172.21.15.78:0/543218768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680c0fa0 msgr2=0x7fa968140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa966ffd640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680c0fa0 0x7fa968140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa966ffd640 1 -- 172.21.15.78:0/543218768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa96814e510 msgr2=0x7fa9681e2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa966ffd640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa96814e510 0x7fa9681e2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa966ffd640 1 -- 172.21.15.78:0/543218768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680a44b0 con 0x7fa9540047d0 2023-06-02T15:30:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa966ffd640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa9680be080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c7a0 tx=0x7fa95800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa95ffff640 1 -- 172.21.15.78:0/543218768 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9580074e0 con 0x7fa9540047d0 2023-06-02T15:30:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa95ffff640 1 -- 172.21.15.78:0/543218768 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958007640 con 0x7fa9540047d0 2023-06-02T15:30:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- 172.21.15.78:0/543218768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa968148fe0 con 0x7fa9540047d0 2023-06-02T15:30:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa95ffff640 1 -- 172.21.15.78:0/543218768 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa958004a10 con 0x7fa9540047d0 2023-06-02T15:30:44.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.123+0000 7fa96d516640 1 -- 172.21.15.78:0/543218768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9680bca00 con 0x7fa9540047d0 2023-06-02T15:30:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.127+0000 7fa96d516640 1 -- 172.21.15.78:0/543218768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa968073bc0 con 0x7fa9540047d0 2023-06-02T15:30:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.127+0000 7fa95ffff640 1 -- 172.21.15.78:0/543218768 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fa958004b70 con 0x7fa9540047d0 2023-06-02T15:30:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.127+0000 7fa95ffff640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa948065c30 0x7fa9480680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.127+0000 7fa95ffff640 1 -- 172.21.15.78:0/543218768 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa958082a80 con 0x7fa9540047d0 2023-06-02T15:30:44.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.127+0000 7fa95e7fc640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa948065c30 0x7fa9480680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.127+0000 7fa95e7fc640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa948065c30 0x7fa9480680e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa9500b0000 tx=0x7fa9500046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.131+0000 7fa95ffff640 1 -- 172.21.15.78:0/543218768 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fa95804a6e0 con 0x7fa9540047d0 2023-06-02T15:30:44.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:30:44.198 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:30:44.200 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:30:44.203 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:30:44.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.303+0000 7fa96d516640 1 -- 172.21.15.78:0/543218768 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9680bf8f0 con 0x7fa9540047d0 2023-06-02T15:30:44.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa95ffff640 1 -- 172.21.15.78:0/543218768 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3888 (secure 0 0 0) 0x7fa958018090 con 0x7fa9540047d0 2023-06-02T15:30:44.313 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:44.313 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/4074209272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4074209272},{"type":"v1","addr":"172.21.15.78:6836","nonce":4074209272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/987093145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":987093145},{"type":"v1","addr":"172.21.15.78:6837","nonce":987093145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-02T15:30:38.611635+0000","modified":"2023-06-02T15:30:43.029755+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/3115859297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3115859297},{"type":"v1","addr":"172.21.15.132:6833","nonce":3115859297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-06-02T15:30:44.314 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 7 2023-06-02T15:30:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 -- 172.21.15.78:0/543218768 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa948065c30 msgr2=0x7fa9480680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa948065c30 0x7fa9480680e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa9500b0000 tx=0x7fa9500046d0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 -- 172.21.15.78:0/543218768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 msgr2=0x7fa9680be080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa9680be080 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa95800c7a0 tx=0x7fa95800cc60 comp rx=0 tx=0).stop 2023-06-02T15:30:44.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 -- 172.21.15.78:0/543218768 shutdown_connections 2023-06-02T15:30:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa96814e510 0x7fa9681e2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680c0fa0 0x7fa968140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa948065c30 0x7fa9480680e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 --2- 172.21.15.78:0/543218768 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa9540047d0 0x7fa9680be080 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 -- 172.21.15.78:0/543218768 >> 172.21.15.78:0/543218768 conn(0x7fa9680bcf50 msgr2=0x7fa968147b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 -- 172.21.15.78:0/543218768 shutdown_connections 2023-06-02T15:30:44.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.307+0000 7fa96d516640 1 -- 172.21.15.78:0/543218768 wait complete. 2023-06-02T15:30:44.571 INFO:tasks.ceph.mds.b.smithi132.stderr:2023-06-02T15:30:44.565+0000 7f07f33c6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-02T15:30:44.631 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-02T15:30:38.611635+0000', 'modified': '2023-06-02T15:30:43.029755+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6833/3115859297', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6832', 'nonce': 3115859297}, {'type': 'v1', 'addr': '172.21.15.132:6833', 'nonce': 3115859297}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-06-02T15:30:44.632 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-02T15:30:44.632 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-02T15:30:44.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c730f640 1 Processor -- start 2023-06-02T15:30:44.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c730f640 1 -- start start 2023-06-02T15:30:44.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c730f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00bcb60 0x7f80c0157d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c730f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c014ce40 con 0x7f80c00bb0d0 2023-06-02T15:30:44.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c730f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80c0149ee0 con 0x7f80c0149b10 2023-06-02T15:30:44.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c730f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c014c550 con 0x7f80c00bcb60 2023-06-02T15:30:44.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c48aa640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f80c00bb0d0 0x7f80c00bc450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44802/0 (socket says 172.21.15.78:44802) 2023-06-02T15:30:44.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c48aa640 1 -- 172.21.15.78:0/1416082711 learned_addr learned my addr 172.21.15.78:0/1416082711 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:44.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2558497360 0 0) 0x7f80c014ce40 con 0x7f80c00bb0d0 2023-06-02T15:30:44.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80ac003530 con 0x7f80c00bb0d0 2023-06-02T15:30:44.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c58ac640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00bcb60 0x7f80c0157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3121385101 0 0) 0x7f80ac003530 con 0x7f80c00bb0d0 2023-06-02T15:30:44.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00bcb60 msgr2=0x7f80c0157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00bcb60 0x7f80c0157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 >> v1:172.21.15.132:6789/0 conn(0x7f80c0149b10 legacy=0x7f80c006a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c014c7f0 con 0x7f80c00bb0d0 2023-06-02T15:30:44.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f80b0001680 con 0x7f80c00bb0d0 2023-06-02T15:30:44.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 >> v1:172.21.15.78:6789/0 conn(0x7f80c00bb0d0 legacy=0x7f80c00bc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80ac003a20 0x7f80ac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 0x7f80ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00bcb60 0x7f80ac005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c014c550 con 0x7f80ac0047d0 2023-06-02T15:30:44.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac00bbe0 con 0x7f80ac003a20 2023-06-02T15:30:44.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80ac00bda0 con 0x7f80c00bcb60 2023-06-02T15:30:44.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c48aa640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 0x7f80ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c50ab640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80ac003a20 0x7f80ac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c58ac640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00bcb60 0x7f80ac005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c48aa640 1 -- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00bcb60 msgr2=0x7f80ac005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c48aa640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00bcb60 0x7f80ac005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c48aa640 1 -- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80ac003a20 msgr2=0x7f80ac003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c48aa640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80ac003a20 0x7f80ac003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.759+0000 7f80c48aa640 1 -- 172.21.15.78:0/1416082711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac003530 con 0x7f80ac0047d0 2023-06-02T15:30:44.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80c48aa640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 0x7f80ac004c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f80b0001ec0 tx=0x7f80b001cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7535f413fd808a41 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00058e0 con 0x7f80ac0047d0 2023-06-02T15:30:44.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b0005a40 con 0x7f80ac0047d0 2023-06-02T15:30:44.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80b7fff640 1 -- 172.21.15.78:0/1416082711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0005df0 con 0x7f80ac0047d0 2023-06-02T15:30:44.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80c730f640 1 -- 172.21.15.78:0/1416082711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 msgr2=0x7f80ac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80c730f640 1 --2- 172.21.15.78:0/1416082711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 0x7f80ac004c40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f80b0001ec0 tx=0x7f80b001cbe0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80c58ac640 1 -- 172.21.15.78:0/1416082711 reap_dead start 2023-06-02T15:30:44.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80c730f640 1 -- 172.21.15.78:0/1416082711 shutdown_connections 2023-06-02T15:30:44.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80c730f640 1 -- 172.21.15.78:0/1416082711 >> 172.21.15.78:0/1416082711 conn(0x7f80c00bd800 msgr2=0x7f80c00bdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:44.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80c730f640 1 -- 172.21.15.78:0/1416082711 shutdown_connections 2023-06-02T15:30:44.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80c730f640 1 -- 172.21.15.78:0/1416082711 wait complete. 2023-06-02T15:30:44.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80c730f640 1 Processor -- start 2023-06-02T15:30:44.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.763+0000 7f80c730f640 1 -- start start 2023-06-02T15:30:44.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c730f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 0x7f80c01e4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c730f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00be950 0x7f80c00b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c730f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c00b88b0 0x7f80c00b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c730f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c014deb0 con 0x7f80ac0047d0 2023-06-02T15:30:44.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c730f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c01e5780 con 0x7f80c00b88b0 2023-06-02T15:30:44.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c730f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c00ba4b0 con 0x7f80c00be950 2023-06-02T15:30:44.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c50ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 0x7f80c01e4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c50ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 0x7f80c01e4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53316/0 (socket says 172.21.15.78:53316) 2023-06-02T15:30:44.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c50ab640 1 -- 172.21.15.78:0/1119905458 learned_addr learned my addr 172.21.15.78:0/1119905458 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:44.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c48aa640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00be950 0x7f80c00b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c58ac640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c00b88b0 0x7f80c00b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c50ab640 1 -- 172.21.15.78:0/1119905458 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00be950 msgr2=0x7f80c00b9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c50ab640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00be950 0x7f80c00b9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c50ab640 1 -- 172.21.15.78:0/1119905458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c00b88b0 msgr2=0x7f80c00b9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c50ab640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c00b88b0 0x7f80c00b9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c50ab640 1 -- 172.21.15.78:0/1119905458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c00b6410 con 0x7f80ac0047d0 2023-06-02T15:30:44.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c50ab640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 0x7f80c01e4ec0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f80b800e8d0 tx=0x7f80b800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80b5ffb640 1 -- 172.21.15.78:0/1119905458 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8003b90 con 0x7f80ac0047d0 2023-06-02T15:30:44.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80b5ffb640 1 -- 172.21.15.78:0/1119905458 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8003cf0 con 0x7f80ac0047d0 2023-06-02T15:30:44.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c730f640 1 -- 172.21.15.78:0/1119905458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c014cad0 con 0x7f80ac0047d0 2023-06-02T15:30:44.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80b5ffb640 1 -- 172.21.15.78:0/1119905458 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8005310 con 0x7f80ac0047d0 2023-06-02T15:30:44.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c730f640 1 -- 172.21.15.78:0/1119905458 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c006b010 con 0x7f80ac0047d0 2023-06-02T15:30:44.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80b5ffb640 1 -- 172.21.15.78:0/1119905458 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f80b8005470 con 0x7f80ac0047d0 2023-06-02T15:30:44.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80b5ffb640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f80a4065c30 0x7f80a40680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c48aa640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f80a4065c30 0x7f80a40680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80b5ffb640 1 -- 172.21.15.78:0/1119905458 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f80b80837b0 con 0x7f80ac0047d0 2023-06-02T15:30:44.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80c48aa640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f80a4065c30 0x7f80a40680e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80b00aa000 tx=0x7f80b0001a10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80ca431000 1 Processor -- start 2023-06-02T15:30:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.767+0000 7f80ca431000 1 -- start start 2023-06-02T15:30:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89241b20 0x555d89207740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89207c80 0x555d89208050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89208590 0x555d89208960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d890d2a20 con 0x555d89241b20 2023-06-02T15:30:44.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d8900c680 con 0x555d89207c80 2023-06-02T15:30:44.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d8905f920 con 0x555d89208590 2023-06-02T15:30:44.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c50ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89241b20 0x555d89207740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c50ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89241b20 0x555d89207740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53324/0 (socket says 172.21.15.78:53324) 2023-06-02T15:30:44.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c50ab640 1 -- 172.21.15.78:0/2603275003 learned_addr learned my addr 172.21.15.78:0/2603275003 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:44.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c48aa640 1 --2- 172.21.15.78:0/2603275003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89207c80 0x555d89208050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c50ab640 1 -- 172.21.15.78:0/2603275003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89208590 msgr2=0x555d89208960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c50ab640 1 --2- 172.21.15.78:0/2603275003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89208590 0x555d89208960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c50ab640 1 -- 172.21.15.78:0/2603275003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89207c80 msgr2=0x555d89208050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c50ab640 1 --2- 172.21.15.78:0/2603275003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89207c80 0x555d89208050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c50ab640 1 -- 172.21.15.78:0/2603275003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d8901e1b0 con 0x555d89241b20 2023-06-02T15:30:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c48aa640 1 --2- 172.21.15.78:0/2603275003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89207c80 0x555d89208050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:44.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c50ab640 1 --2- 172.21.15.78:0/2603275003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89241b20 0x555d89207740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f80b8001340 tx=0x7f80b8003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfceda18eba2ae server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80aaffd640 1 -- 172.21.15.78:0/2603275003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8005720 con 0x555d89241b20 2023-06-02T15:30:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80aaffd640 1 -- 172.21.15.78:0/2603275003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8051060 con 0x555d89241b20 2023-06-02T15:30:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80aaffd640 1 -- 172.21.15.78:0/2603275003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8005880 con 0x555d89241b20 2023-06-02T15:30:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- 172.21.15.78:0/2603275003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89241b20 msgr2=0x555d89207740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 --2- 172.21.15.78:0/2603275003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89241b20 0x555d89207740 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f80b8001340 tx=0x7f80b8003f60 comp rx=0 tx=0).stop 2023-06-02T15:30:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- 172.21.15.78:0/2603275003 shutdown_connections 2023-06-02T15:30:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 --2- 172.21.15.78:0/2603275003 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89208590 0x555d89208960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 --2- 172.21.15.78:0/2603275003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89207c80 0x555d89208050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 --2- 172.21.15.78:0/2603275003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89241b20 0x555d89207740 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- 172.21.15.78:0/2603275003 >> 172.21.15.78:0/2603275003 conn(0x555d89104350 msgr2=0x555d89211780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- 172.21.15.78:0/2603275003 shutdown_connections 2023-06-02T15:30:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- 172.21.15.78:0/2603275003 wait complete. 2023-06-02T15:30:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- start start 2023-06-02T15:30:44.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 Processor -- start 2023-06-02T15:30:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 0x555d8920df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89208590 0x555d8920e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89241b20 0x555d8920e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89058a60 con 0x555d89208590 2023-06-02T15:30:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d88ff85a0 con 0x555d89241b20 2023-06-02T15:30:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d88ff8260 con 0x555d89207c80 2023-06-02T15:30:44.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80ca431000 10 client.0 _ll_register_callbacks cb 0x555d891f6d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-02T15:30:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c48aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89208590 0x555d8920e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c48aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89208590 0x555d8920e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53340/0 (socket says 172.21.15.78:53340) 2023-06-02T15:30:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c48aa640 1 -- 172.21.15.78:0/2394130395 learned_addr learned my addr 172.21.15.78:0/2394130395 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c50ab640 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 0x555d8920df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c58ac640 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89241b20 0x555d8920e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c48aa640 1 -- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 msgr2=0x555d8920df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c48aa640 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 0x555d8920df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c48aa640 1 -- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89241b20 msgr2=0x555d8920e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c48aa640 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89241b20 0x555d8920e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.771+0000 7f80c48aa640 1 -- 172.21.15.78:0/2394130395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c006b010 con 0x555d89208590 2023-06-02T15:30:44.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80c48aa640 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89208590 0x555d8920e470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f80b001ca10 tx=0x7f80b0019980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32eed716f15d50 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f809ffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-06-02T15:30:44.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f809ffff640 1 -- 172.21.15.78:0/2394130395 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00b3070 con 0x555d89208590 2023-06-02T15:30:44.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f809ffff640 1 -- 172.21.15.78:0/2394130395 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f80b00a5aa0 con 0x555d89208590 2023-06-02T15:30:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 -- 172.21.15.78:0/2394130395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d890573b0 con 0x555d89208590 2023-06-02T15:30:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f809ffff640 1 -- 172.21.15.78:0/2394130395 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80b00a5c60 con 0x555d89208590 2023-06-02T15:30:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 10 client.4389 fetch_fsmap learned FSMap version 7 2023-06-02T15:30:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 -- 172.21.15.78:0/2394130395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555d88d55890 con 0x555d89208590 2023-06-02T15:30:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f809ffff640 1 -- 172.21.15.78:0/2394130395 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d890573b0 con 0x555d89208590 2023-06-02T15:30:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f809ffff640 1 -- 172.21.15.78:0/2394130395 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f80b00c2070 con 0x555d89208590 2023-06-02T15:30:44.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 10 client.4389 fetch_fsmap finished waiting for FSMap version 7 2023-06-02T15:30:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 10 client.4389 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-02T15:30:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 20 client.4389 populate_metadata read hostname 'smithi078' 2023-06-02T15:30:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x555d89258560 0x555d8925a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 4 client.4389 mds_command: new command op to 4273 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-02T15:30:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 -- 172.21.15.78:0/2394130395 --> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d890880a0 con 0x555d89258560 2023-06-02T15:30:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80c50ab640 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x555d89258560 0x555d8925a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f809ffff640 10 client.4389 ms_handle_connect on v2:172.21.15.132:6832/3115859297 2023-06-02T15:30:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80c50ab640 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x555d89258560 0x555d8925a940 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1239b5ffccd0f059 server_cookie=19154b1d2599311 in_seq=0 out_seq=0 2023-06-02T15:30:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f809ffff640 1 -- 172.21.15.78:0/2394130395 <== mds.0 v2:172.21.15.132:6832/3115859297 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x555d890880a0 con 0x555d89258560 2023-06-02T15:30:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f809ffff640 10 client.4389 handle_command_reply: tid=0 2023-06-02T15:30:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 client.4389 shutdown 2023-06-02T15:30:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 -- 172.21.15.78:0/2394130395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89208590 msgr2=0x555d8920e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89208590 0x555d8920e470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f80b001ca10 tx=0x7f80b0019980 comp rx=0 tx=0).stop 2023-06-02T15:30:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 -- 172.21.15.78:0/2394130395 shutdown_connections 2023-06-02T15:30:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x555d89258560 0x555d8925a940 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89241b20 0x555d8920e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89208590 0x555d8920e470 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f809ffff640 0 client.4389 ms_handle_reset on v2:172.21.15.132:6832/3115859297 2023-06-02T15:30:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 --2- 172.21.15.78:0/2394130395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 0x555d8920df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 -- 172.21.15.78:0/2394130395 >> 172.21.15.78:0/2394130395 conn(0x555d89104350 msgr2=0x555d89244810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:44.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 -- 172.21.15.78:0/2394130395 shutdown_connections 2023-06-02T15:30:44.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 1 -- 172.21.15.78:0/2394130395 wait complete. 2023-06-02T15:30:44.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.775+0000 7f80ca431000 20 client.4389 trim_cache size 0 max 16384 2023-06-02T15:30:44.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ca431000 1 Processor -- start 2023-06-02T15:30:44.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ca431000 1 -- start start 2023-06-02T15:30:44.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ca431000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d89209f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ca431000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89207c80 0x555d89258930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ca431000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89208590 0x555d89258e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ca431000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d88d16940 con 0x555d89104350 2023-06-02T15:30:44.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ca431000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d88d561b0 con 0x555d89207c80 2023-06-02T15:30:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ca431000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d89056270 con 0x555d89208590 2023-06-02T15:30:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80c50ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d89209f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80c50ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d89209f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53354/0 (socket says 172.21.15.78:53354) 2023-06-02T15:30:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80c50ab640 1 -- 172.21.15.78:0/4106896389 learned_addr learned my addr 172.21.15.78:0/4106896389 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80c50ab640 1 -- 172.21.15.78:0/4106896389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89208590 msgr2=0x555d89258e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80c50ab640 1 --2- 172.21.15.78:0/4106896389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89208590 0x555d89258e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80c50ab640 1 -- 172.21.15.78:0/4106896389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89207c80 msgr2=0x555d89258930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80c50ab640 1 --2- 172.21.15.78:0/4106896389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89207c80 0x555d89258930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80c50ab640 1 -- 172.21.15.78:0/4106896389 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d8901e460 con 0x555d89104350 2023-06-02T15:30:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80c50ab640 1 --2- 172.21.15.78:0/4106896389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d89209f80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f80b8050e50 tx=0x7f80b8057040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3813370e0abad0dd server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ab7fe640 1 -- 172.21.15.78:0/4106896389 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8081040 con 0x555d89104350 2023-06-02T15:30:44.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ab7fe640 1 -- 172.21.15.78:0/4106896389 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8050c90 con 0x555d89104350 2023-06-02T15:30:44.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.791+0000 7f80ab7fe640 1 -- 172.21.15.78:0/4106896389 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8051060 con 0x555d89104350 2023-06-02T15:30:44.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- 172.21.15.78:0/4106896389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 msgr2=0x555d89209f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 --2- 172.21.15.78:0/4106896389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d89209f80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f80b8050e50 tx=0x7f80b8057040 comp rx=0 tx=0).stop 2023-06-02T15:30:44.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- 172.21.15.78:0/4106896389 shutdown_connections 2023-06-02T15:30:44.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 --2- 172.21.15.78:0/4106896389 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89208590 0x555d89258e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 --2- 172.21.15.78:0/4106896389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89207c80 0x555d89258930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 --2- 172.21.15.78:0/4106896389 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d89209f80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- 172.21.15.78:0/4106896389 >> 172.21.15.78:0/4106896389 conn(0x555d89207680 msgr2=0x555d89209870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:44.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- 172.21.15.78:0/4106896389 shutdown_connections 2023-06-02T15:30:44.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- 172.21.15.78:0/4106896389 wait complete. 2023-06-02T15:30:44.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- start start 2023-06-02T15:30:44.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 Processor -- start 2023-06-02T15:30:44.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d8926c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 0x555d8926c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89208590 0x555d8926cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d89113020 con 0x555d89104350 2023-06-02T15:30:44.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d88f90450 con 0x555d89208590 2023-06-02T15:30:44.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d89059310 con 0x555d89207c80 2023-06-02T15:30:44.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 10 client.0 _ll_register_callbacks cb 0x555d88ff92f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-02T15:30:44.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c50ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d8926c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c50ab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d8926c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53358/0 (socket says 172.21.15.78:53358) 2023-06-02T15:30:44.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c50ab640 1 -- 172.21.15.78:0/2549322806 learned_addr learned my addr 172.21.15.78:0/2549322806 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:44.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c48aa640 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 0x555d8926c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c58ac640 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89208590 0x555d8926cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c50ab640 1 -- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 msgr2=0x555d8926c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c50ab640 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 0x555d8926c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c50ab640 1 -- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89208590 msgr2=0x555d8926cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c50ab640 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89208590 0x555d8926cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c50ab640 1 -- 172.21.15.78:0/2549322806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d8901e1b0 con 0x555d89104350 2023-06-02T15:30:44.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c48aa640 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 0x555d8926c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:44.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c50ab640 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d8926c1d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f80b800c4b0 tx=0x7f80b80014b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a686fe7d37423f23 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f809ffff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-06-02T15:30:44.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f809ffff640 1 -- 172.21.15.78:0/2549322806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8081040 con 0x555d89104350 2023-06-02T15:30:44.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f809ffff640 1 -- 172.21.15.78:0/2549322806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f80b8051060 con 0x555d89104350 2023-06-02T15:30:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- 172.21.15.78:0/2549322806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d89013c00 con 0x555d89104350 2023-06-02T15:30:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f809ffff640 1 -- 172.21.15.78:0/2549322806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80b801abe0 con 0x555d89104350 2023-06-02T15:30:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 10 client.4395 fetch_fsmap learned FSMap version 7 2023-06-02T15:30:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- 172.21.15.78:0/2549322806 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x555d89003ce0 con 0x555d89104350 2023-06-02T15:30:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f809ffff640 1 -- 172.21.15.78:0/2549322806 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d89013c00 con 0x555d89104350 2023-06-02T15:30:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f809ffff640 1 -- 172.21.15.78:0/2549322806 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 7) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f80b8058b70 con 0x555d89104350 2023-06-02T15:30:44.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 10 client.4395 fetch_fsmap finished waiting for FSMap version 7 2023-06-02T15:30:44.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 10 client.4395 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-02T15:30:44.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 20 client.4395 populate_metadata read hostname 'smithi078' 2023-06-02T15:30:44.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x555d89241b20 0x555d8926d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 4 client.4395 mds_command: new command op to 4273 tid=0[{"prefix": "status"}] 2023-06-02T15:30:44.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80ca431000 1 -- 172.21.15.78:0/2549322806 --> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555d89051ae0 con 0x555d89241b20 2023-06-02T15:30:44.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.795+0000 7f80c48aa640 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x555d89241b20 0x555d8926d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f809ffff640 10 client.4395 ms_handle_connect on v2:172.21.15.132:6832/3115859297 2023-06-02T15:30:44.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c48aa640 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x555d89241b20 0x555d8926d190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4e97310a1607136 server_cookie=4585a249faae154d in_seq=0 out_seq=0 2023-06-02T15:30:44.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f809ffff640 1 -- 172.21.15.78:0/2549322806 <== mds.0 v2:172.21.15.132:6832/3115859297 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x555d89051ae0 con 0x555d89241b20 2023-06-02T15:30:44.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f809ffff640 10 client.4395 handle_command_reply: tid=0 2023-06-02T15:30:44.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 client.4395 shutdown 2023-06-02T15:30:44.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 -- 172.21.15.78:0/2549322806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 msgr2=0x555d8926c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d8926c1d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f80b800c4b0 tx=0x7f80b80014b0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 -- 172.21.15.78:0/2549322806 shutdown_connections 2023-06-02T15:30:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x555d89241b20 0x555d8926d190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d89208590 0x555d8926cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f809ffff640 0 client.4395 ms_handle_reset on v2:172.21.15.132:6832/3115859297 2023-06-02T15:30:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x555d89207c80 0x555d8926c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 --2- 172.21.15.78:0/2549322806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555d89104350 0x555d8926c1d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 -- 172.21.15.78:0/2549322806 >> 172.21.15.78:0/2549322806 conn(0x555d89207680 msgr2=0x555d8925a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:44.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 -- 172.21.15.78:0/2549322806 shutdown_connections 2023-06-02T15:30:44.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 1 -- 172.21.15.78:0/2549322806 wait complete. 2023-06-02T15:30:44.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80ca431000 20 client.4395 trim_cache size 0 max 16384 2023-06-02T15:30:44.821 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-02T15:30:44.821 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "9af8d860-9431-412c-b8a4-990228d6b597", 2023-06-02T15:30:44.822 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-06-02T15:30:44.822 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4273, 2023-06-02T15:30:44.822 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-06-02T15:30:44.822 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-06-02T15:30:44.822 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-06-02T15:30:44.822 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 6.1854673099999999, 2023-06-02T15:30:44.823 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 7, 2023-06-02T15:30:44.823 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 25, 2023-06-02T15:30:44.823 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 24, 2023-06-02T15:30:44.823 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 11.189977679 2023-06-02T15:30:44.824 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-02T15:30:44.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 -- 172.21.15.78:0/1119905458 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f80a4065c30 msgr2=0x7f80a40680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f80a4065c30 0x7f80a40680e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80b00aa000 tx=0x7f80b0001a10 comp rx=0 tx=0).stop 2023-06-02T15:30:44.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 -- 172.21.15.78:0/1119905458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 msgr2=0x7f80c01e4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 0x7f80c01e4ec0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f80b800e8d0 tx=0x7f80b800ed90 comp rx=0 tx=0).stop 2023-06-02T15:30:44.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 -- 172.21.15.78:0/1119905458 shutdown_connections 2023-06-02T15:30:44.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80c00b88b0 0x7f80c00b9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f80c00be950 0x7f80c00b9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f80a4065c30 0x7f80a40680e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 --2- 172.21.15.78:0/1119905458 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80ac0047d0 0x7f80c01e4ec0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 -- 172.21.15.78:0/1119905458 >> 172.21.15.78:0/1119905458 conn(0x7f80c00bd800 msgr2=0x7f80c0141df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 -- 172.21.15.78:0/1119905458 shutdown_connections 2023-06-02T15:30:44.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.799+0000 7f80c730f640 1 -- 172.21.15.78:0/1119905458 wait complete. 2023-06-02T15:30:44.829 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-02T15:30:44.830 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-02T15:30:44.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-02T15:30:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.935+0000 7fbf2f419640 1 Processor -- start 2023-06-02T15:30:44.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.935+0000 7fbf2f419640 1 -- start start 2023-06-02T15:30:44.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.935+0000 7fbf2f419640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbf280bc1c0 0x7fbf2814bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.935+0000 7fbf2f419640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbf2814f330 0x7fbf280a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.935+0000 7fbf2f419640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf2814ba90 con 0x7fbf280a0020 2023-06-02T15:30:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.935+0000 7fbf2f419640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2814f7c0 con 0x7fbf280bc1c0 2023-06-02T15:30:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.935+0000 7fbf2f419640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf2814b440 con 0x7fbf2814f330 2023-06-02T15:30:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2d1b5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbf280bc1c0 0x7fbf2814bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2d1b5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbf280bc1c0 0x7fbf2814bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53372/0 (socket says 172.21.15.78:53372) 2023-06-02T15:30:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2d1b5640 1 -- 172.21.15.78:0/276701111 learned_addr learned my addr 172.21.15.78:0/276701111 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2c9b4640 1 --2- 172.21.15.78:0/276701111 >> v2:172.21.15.132:3300/0 conn(0x7fbf2814f330 0x7fbf280a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2d1b5640 1 -- 172.21.15.78:0/276701111 >> v2:172.21.15.132:3300/0 conn(0x7fbf2814f330 msgr2=0x7fbf280a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2d1b5640 1 --2- 172.21.15.78:0/276701111 >> v2:172.21.15.132:3300/0 conn(0x7fbf2814f330 0x7fbf280a40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2d1b5640 1 -- 172.21.15.78:0/276701111 >> v1:172.21.15.132:6789/0 conn(0x7fbf280a0020 legacy=0x7fbf281487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:44.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2d1b5640 1 -- 172.21.15.78:0/276701111 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf2814b720 con 0x7fbf280bc1c0 2023-06-02T15:30:44.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2d1b5640 1 --2- 172.21.15.78:0/276701111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 0x7fbf2814bf20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbf28072110 tx=0x7fbf2401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1096beb4ef2a11fd server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf1ffff640 1 -- 172.21.15.78:0/276701111 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf240ab600 con 0x7fbf280bc1c0 2023-06-02T15:30:44.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf1ffff640 1 -- 172.21.15.78:0/276701111 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf240a7050 con 0x7fbf280bc1c0 2023-06-02T15:30:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf1ffff640 1 -- 172.21.15.78:0/276701111 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf240ab980 con 0x7fbf280bc1c0 2023-06-02T15:30:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2f419640 1 -- 172.21.15.78:0/276701111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 msgr2=0x7fbf2814bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2f419640 1 --2- 172.21.15.78:0/276701111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 0x7fbf2814bf20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbf28072110 tx=0x7fbf2401c430 comp rx=0 tx=0).stop 2023-06-02T15:30:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2f419640 1 -- 172.21.15.78:0/276701111 shutdown_connections 2023-06-02T15:30:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2f419640 1 --2- 172.21.15.78:0/276701111 >> v2:172.21.15.132:3300/0 conn(0x7fbf2814f330 0x7fbf280a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2f419640 1 --2- 172.21.15.78:0/276701111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 0x7fbf2814bf20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2f419640 1 -- 172.21.15.78:0/276701111 >> 172.21.15.78:0/276701111 conn(0x7fbf280bcf50 msgr2=0x7fbf280bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:44.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2f419640 1 -- 172.21.15.78:0/276701111 shutdown_connections 2023-06-02T15:30:44.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.939+0000 7fbf2f419640 1 -- 172.21.15.78:0/276701111 wait complete. 2023-06-02T15:30:44.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 Processor -- start 2023-06-02T15:30:44.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 -- start start 2023-06-02T15:30:44.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf280a0020 0x7fbf2814da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 0x7fbf28070630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2814f330 0x7fbf28070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2814e510 con 0x7fbf280bc1c0 2023-06-02T15:30:44.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2814df60 con 0x7fbf280a0020 2023-06-02T15:30:44.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf28141bb0 con 0x7fbf2814f330 2023-06-02T15:30:44.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2c9b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 0x7fbf28070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2c9b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 0x7fbf28070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53380/0 (socket says 172.21.15.78:53380) 2023-06-02T15:30:44.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2c9b4640 1 -- 172.21.15.78:0/801598379 learned_addr learned my addr 172.21.15.78:0/801598379 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:44.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2d1b5640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf280a0020 0x7fbf2814da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2d9b6640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2814f330 0x7fbf28070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2c9b4640 1 -- 172.21.15.78:0/801598379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2814f330 msgr2=0x7fbf28070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2c9b4640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2814f330 0x7fbf28070b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2c9b4640 1 -- 172.21.15.78:0/801598379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf280a0020 msgr2=0x7fbf2814da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2c9b4640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf280a0020 0x7fbf2814da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2c9b4640 1 -- 172.21.15.78:0/801598379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf240094d0 con 0x7fbf280bc1c0 2023-06-02T15:30:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2c9b4640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 0x7fbf28070630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800c7f0 tx=0x7fbf1800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf1dffb640 1 -- 172.21.15.78:0/801598379 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18004220 con 0x7fbf280bc1c0 2023-06-02T15:30:44.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf1dffb640 1 -- 172.21.15.78:0/801598379 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf18004380 con 0x7fbf280bc1c0 2023-06-02T15:30:44.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 -- 172.21.15.78:0/801598379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf280bcb90 con 0x7fbf280bc1c0 2023-06-02T15:30:44.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf1dffb640 1 -- 172.21.15.78:0/801598379 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf18003840 con 0x7fbf280bc1c0 2023-06-02T15:30:44.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 -- 172.21.15.78:0/801598379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf280bca00 con 0x7fbf280bc1c0 2023-06-02T15:30:44.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf2f419640 1 -- 172.21.15.78:0/801598379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf280a45e0 con 0x7fbf280bc1c0 2023-06-02T15:30:44.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf1dffb640 1 -- 172.21.15.78:0/801598379 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fbf18003bb0 con 0x7fbf280bc1c0 2023-06-02T15:30:44.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.943+0000 7fbf1dffb640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbf0c065c30 0x7fbf0c0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:44.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.947+0000 7fbf2d1b5640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbf0c065c30 0x7fbf0c0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:44.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.947+0000 7fbf1dffb640 1 -- 172.21.15.78:0/801598379 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbf180836d0 con 0x7fbf280bc1c0 2023-06-02T15:30:44.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.947+0000 7fbf2d1b5640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbf0c065c30 0x7fbf0c0680e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf2806e8f0 tx=0x7fbf24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:44.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:44.951+0000 7fbf1dffb640 1 -- 172.21.15.78:0/801598379 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fbf18050a80 con 0x7fbf280bc1c0 2023-06-02T15:30:45.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.131+0000 7fbf2f419640 1 -- 172.21.15.78:0/801598379 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbf28073bc0 con 0x7fbf280bc1c0 2023-06-02T15:30:45.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.131+0000 7fbf1dffb640 1 -- 172.21.15.78:0/801598379 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbf1801e070 con 0x7fbf280bc1c0 2023-06-02T15:30:45.141 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-02T15:30:45.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 -- 172.21.15.78:0/801598379 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbf0c065c30 msgr2=0x7fbf0c0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:45.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbf0c065c30 0x7fbf0c0680e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbf2806e8f0 tx=0x7fbf24008040 comp rx=0 tx=0).stop 2023-06-02T15:30:45.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 -- 172.21.15.78:0/801598379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 msgr2=0x7fbf28070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:45.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 0x7fbf28070630 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbf1800c7f0 tx=0x7fbf1800ccb0 comp rx=0 tx=0).stop 2023-06-02T15:30:45.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 -- 172.21.15.78:0/801598379 shutdown_connections 2023-06-02T15:30:45.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbf2814f330 0x7fbf28070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:45.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbf0c065c30 0x7fbf0c0680e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:45.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbf280bc1c0 0x7fbf28070630 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:45.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 --2- 172.21.15.78:0/801598379 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf280a0020 0x7fbf2814da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:45.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 -- 172.21.15.78:0/801598379 >> 172.21.15.78:0/801598379 conn(0x7fbf280bcf50 msgr2=0x7fbf28149e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:45.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 -- 172.21.15.78:0/801598379 shutdown_connections 2023-06-02T15:30:45.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:45.135+0000 7fbf2f419640 1 -- 172.21.15.78:0/801598379 wait complete. 2023-06-02T15:30:45.158 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-06-02T15:30:45.158 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-02T15:30:45.158 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2023-06-02T15:30:45.158 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-06-02T15:30:45.159 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-06-02T15:30:45.159 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-06-02T15:30:45.159 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-02T15:30:45.159 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-02T15:30:45.160 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-06-02T15:30:45.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.160 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2023-06-02T15:30:45.166 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-02T15:30:45.167 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-02T15:30:45.167 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-06-02T15:30:45.167 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:30:45.167 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-06-02T15:30:45.167 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:30:45.167 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-02T15:30:45.168 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2023-06-02T15:30:45.168 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2023-06-02T15:30:45.168 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-02T15:30:45.168 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2023-06-02T15:30:45.168 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2023-06-02T15:30:45.168 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-02T15:30:45.169 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2023-06-02T15:30:45.169 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-02T15:30:45.169 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2023-06-02T15:30:45.169 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-02T15:30:45.169 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42371sec preferred_lft 42371sec 2023-06-02T15:30:45.169 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2023-06-02T15:30:45.170 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:30:45.170 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-02T15:30:45.170 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:36:21:50:76 brd ff:ff:ff:ff:ff:ff 2023-06-02T15:30:45.170 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-02T15:30:45.170 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:30:45.171 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-02T15:30:45.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.171 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-06-02T15:30:45.172 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-06-02T15:30:45.172 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2023-06-02T15:30:45.172 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2023-06-02T15:30:45.172 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2023-06-02T15:30:45.173 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-02T15:30:45.173 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-06-02T15:30:45.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.254 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-02T15:30:45.312 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-06-02T15:30:45.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.314 DEBUG:teuthology.orchestra.run.smithi150:> route 2023-06-02T15:30:45.371 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2023-06-02T15:30:45.371 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-02T15:30:45.371 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-02T15:30:45.372 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-02T15:30:45.372 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-02T15:30:45.372 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-02T15:30:45.372 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-02T15:30:45.372 INFO:teuthology.orchestra.run.smithi150.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-02T15:30:45.372 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-02T15:30:45.373 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-02T15:30:45.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.373 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-06-02T15:30:45.374 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-06-02T15:30:45.374 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-02T15:30:45.374 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-02T15:30:45.375 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-02T15:30:45.375 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-06-02T15:30:45.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.444 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-06-02T15:30:45.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.491 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2023-06-02T15:30:45.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.539 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-06-02T15:30:45.539 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-06-02T15:30:45.540 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-02T15:30:45.540 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-06-02T15:30:45.540 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-06-02T15:30:45.607 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-06-02T15:30:45.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.608 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-06-02T15:30:45.608 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-06-02T15:30:45.608 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-06-02T15:30:45.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-02T15:30:45.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-06-02T15:30:45.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-06-02T15:30:45.609 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-06-02T15:30:45.610 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-06-02T15:30:45.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.720 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-06-02T15:30:45.720 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-06-02T15:30:45.721 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2023-06-02T15:30:45.721 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2023-06-02T15:30:45.721 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-06-02T15:30:45.740 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-06-02T15:30:45.741 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-02T15:30:45.741 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-06-02T15:30:45.786 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-06-02T15:30:45.786 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-02T15:30:45.787 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-06-02T15:30:45.834 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-06-02T15:30:45.891 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-02T15:30:45.891 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-02T15:30:45.945 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-02T15:30:45.946 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-02T15:30:45.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:45.947 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-06-02T15:30:45.994 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-02T15:30:45.995 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-06-02T15:30:46.040 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-06-02T15:30:46.054 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-02T15:30:46.055 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-02T15:30:46.107 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-02T15:30:46.108 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-02T15:30:46.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:46.109 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-06-02T15:30:46.134 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi150.stderr:2023-06-02T15:30:46.127+0000 7f223a724580 -1 init, newargv = 0x55bf577f0c50 newargc=15 2023-06-02T15:30:46.134 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi150.stderr:ceph-fuse[32299]: starting ceph client 2023-06-02T15:30:46.144 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi150.stderr:ceph-fuse[32299]: starting fuse 2023-06-02T15:30:47.239 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-06-02T15:30:47.256 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-02T15:30:47.257 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-02T15:30:47.310 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-02T15:30:47.311 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-02T15:30:47.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:47.313 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-06-02T15:30:47.359 INFO:teuthology.orchestra.run.smithi150.stdout:45 2023-06-02T15:30:47.360 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-02T15:30:47.361 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-02T15:30:47.361 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2023-06-02T15:30:47.362 DEBUG:teuthology.orchestra.run.smithi150:> import re 2023-06-02T15:30:47.363 DEBUG:teuthology.orchestra.run.smithi150:> import os 2023-06-02T15:30:47.363 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2023-06-02T15:30:47.364 DEBUG:teuthology.orchestra.run.smithi150:> 2023-06-02T15:30:47.364 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2023-06-02T15:30:47.365 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-06-02T15:30:47.366 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2023-06-02T15:30:47.366 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-06-02T15:30:47.367 DEBUG:teuthology.orchestra.run.smithi150:> 2023-06-02T15:30:47.368 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2023-06-02T15:30:47.368 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2023-06-02T15:30:47.369 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2023-06-02T15:30:47.369 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2023-06-02T15:30:47.370 DEBUG:teuthology.orchestra.run.smithi150:> 2023-06-02T15:30:47.371 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2023-06-02T15:30:47.371 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-02T15:30:47.372 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-02T15:30:47.373 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-02T15:30:47.373 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2023-06-02T15:30:47.374 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2023-06-02T15:30:47.374 DEBUG:teuthology.orchestra.run.smithi150:> return f 2023-06-02T15:30:47.375 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-02T15:30:47.376 DEBUG:teuthology.orchestra.run.smithi150:> 2023-06-02T15:30:47.376 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.admin")) 2023-06-02T15:30:47.377 DEBUG:teuthology.orchestra.run.smithi150:> ' 2023-06-02T15:30:47.479 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.admin.32299.asok 2023-06-02T15:30:47.661 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.32299.asok 2023-06-02T15:30:47.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:47.662 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.32299.asok status 2023-06-02T15:30:47.815 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2023-06-02T15:30:47.816 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2023-06-02T15:30:47.816 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "2870bf456d3115490c153abce9d47ac5c043b65e", 2023-06-02T15:30:47.816 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 18.0.0-3488-g2870bf45 (2870bf456d3115490c153abce9d47ac5c043b65e) reef (rc)", 2023-06-02T15:30:47.816 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "admin", 2023-06-02T15:30:47.816 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2023-06-02T15:30:47.816 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-06-02T15:30:47.817 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "32299", 2023-06-02T15:30:47.817 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2023-06-02T15:30:47.817 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-06-02T15:30:47.817 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2023-06-02T15:30:47.817 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2023-06-02T15:30:47.817 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4363, 2023-06-02T15:30:47.817 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2023-06-02T15:30:47.818 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2023-06-02T15:30:47.818 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2023-06-02T15:30:47.818 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4363 2023-06-02T15:30:47.818 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-06-02T15:30:47.818 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2023-06-02T15:30:47.818 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2023-06-02T15:30:47.818 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2023-06-02T15:30:47.818 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 919010980 2023-06-02T15:30:47.819 INFO:teuthology.orchestra.run.smithi150.stdout: } 2023-06-02T15:30:47.819 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-06-02T15:30:47.819 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2023-06-02T15:30:47.819 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2023-06-02T15:30:47.819 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2023-06-02T15:30:47.819 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 919010980 2023-06-02T15:30:47.819 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-06-02T15:30:47.819 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4363 172.21.15.150:0/919010980", 2023-06-02T15:30:47.820 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "172.21.15.150:0/919010980", 2023-06-02T15:30:47.820 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2023-06-02T15:30:47.820 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 7, 2023-06-02T15:30:47.820 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 25, 2023-06-02T15:30:47.820 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2023-06-02T15:30:47.820 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2023-06-02T15:30:47.820 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2023-06-02T15:30:47.820 INFO:teuthology.orchestra.run.smithi150.stdout:} 2023-06-02T15:30:47.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:47.830 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2023-06-02T15:30:47.830 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-06-02T15:30:47.835 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2023-06-02T15:30:47.836 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-06-02T15:30:47.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:47.837 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-06-02T15:30:47.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:47.892 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-06-02T15:30:47.976 INFO:teuthology.orchestra.run.smithi150.stdout:# file: . 2023-06-02T15:30:47.976 INFO:teuthology.orchestra.run.smithi150.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-06-02T15:30:47.976 INFO:teuthology.orchestra.run.smithi150.stdout: 2023-06-02T15:30:47.977 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:30:47.978 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-02T15:30:48.023 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:48.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.143+0000 7f92d2086640 1 Processor -- start 2023-06-02T15:30:48.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.143+0000 7f92d2086640 1 -- start start 2023-06-02T15:30:48.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92d2086640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc0a2e40 0x7f92cc14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92d2086640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f92cc0a28f0 0x7f92cc14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92d2086640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92cc152b50 con 0x7f92cc14be20 2023-06-02T15:30:48.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92d2086640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92cc0a0990 con 0x7f92cc0a28f0 2023-06-02T15:30:48.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92d2086640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc06d200 con 0x7f92cc0a2e40 2023-06-02T15:30:48.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92cbfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f92cc0a28f0 0x7f92cc14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92cb7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f92cc14be20 0x7f92cc06c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44812/0 (socket says 172.21.15.78:44812) 2023-06-02T15:30:48.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92cb7fe640 1 -- 172.21.15.78:0/3871141436 learned_addr learned my addr 172.21.15.78:0/3871141436 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:48.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92caffd640 1 --2- 172.21.15.78:0/3871141436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc0a2e40 0x7f92cc14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92cbfff640 1 -- 172.21.15.78:0/3871141436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc0a2e40 msgr2=0x7f92cc14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:48.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92cbfff640 1 --2- 172.21.15.78:0/3871141436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc0a2e40 0x7f92cc14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92cbfff640 1 -- 172.21.15.78:0/3871141436 >> v1:172.21.15.78:6789/0 conn(0x7f92cc14be20 legacy=0x7f92cc06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92ca7fc640 1 -- 172.21.15.78:0/3871141436 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2459469093 0 0) 0x7f92cc152b50 con 0x7f92cc14be20 2023-06-02T15:30:48.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92cbfff640 1 -- 172.21.15.78:0/3871141436 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92cc152870 con 0x7f92cc0a28f0 2023-06-02T15:30:48.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92cbfff640 1 --2- 172.21.15.78:0/3871141436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a28f0 0x7f92cc14ecf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0097c0 tx=0x7f92bc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65befd2a24ec22e server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:48.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92ca7fc640 1 -- 172.21.15.78:0/3871141436 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0ab600 con 0x7f92cc0a28f0 2023-06-02T15:30:48.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92ca7fc640 1 -- 172.21.15.78:0/3871141436 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92bc0a7050 con 0x7f92cc0a28f0 2023-06-02T15:30:48.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.147+0000 7f92ca7fc640 1 -- 172.21.15.78:0/3871141436 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92bc0ab980 con 0x7f92cc0a28f0 2023-06-02T15:30:48.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- 172.21.15.78:0/3871141436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a28f0 msgr2=0x7f92cc14ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 --2- 172.21.15.78:0/3871141436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a28f0 0x7f92cc14ecf0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f92bc0097c0 tx=0x7f92bc01c3f0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- 172.21.15.78:0/3871141436 shutdown_connections 2023-06-02T15:30:48.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 --2- 172.21.15.78:0/3871141436 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a28f0 0x7f92cc14ecf0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 --2- 172.21.15.78:0/3871141436 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc0a2e40 0x7f92cc14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- 172.21.15.78:0/3871141436 >> 172.21.15.78:0/3871141436 conn(0x7f92cc0bcf50 msgr2=0x7f92cc0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:48.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- 172.21.15.78:0/3871141436 shutdown_connections 2023-06-02T15:30:48.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- 172.21.15.78:0/3871141436 wait complete. 2023-06-02T15:30:48.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 Processor -- start 2023-06-02T15:30:48.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- start start 2023-06-02T15:30:48.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92cc0a28f0 0x7f92cc0be080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a2e40 0x7f92cc143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc14be20 0x7f92cc142770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0bf4d0 con 0x7f92cc0a2e40 2023-06-02T15:30:48.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0be5c0 con 0x7f92cc0a28f0 2023-06-02T15:30:48.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92cc0be760 con 0x7f92cc14be20 2023-06-02T15:30:48.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92caffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a2e40 0x7f92cc143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92caffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a2e40 0x7f92cc143b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53390/0 (socket says 172.21.15.78:53390) 2023-06-02T15:30:48.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92caffd640 1 -- 172.21.15.78:0/1979203493 learned_addr learned my addr 172.21.15.78:0/1979203493 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:48.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92cb7fe640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92cc0a28f0 0x7f92cc0be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92cbfff640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc14be20 0x7f92cc142770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92caffd640 1 -- 172.21.15.78:0/1979203493 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc14be20 msgr2=0x7f92cc142770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92caffd640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc14be20 0x7f92cc142770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92caffd640 1 -- 172.21.15.78:0/1979203493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92cc0a28f0 msgr2=0x7f92cc0be080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92caffd640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92cc0a28f0 0x7f92cc0be080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92caffd640 1 -- 172.21.15.78:0/1979203493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92bc009420 con 0x7f92cc0a2e40 2023-06-02T15:30:48.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92cbfff640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc14be20 0x7f92cc142770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:48.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92caffd640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a2e40 0x7f92cc143b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f92b400d830 tx=0x7f92b400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:48.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92c3fff640 1 -- 172.21.15.78:0/1979203493 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b400b6c0 con 0x7f92cc0a2e40 2023-06-02T15:30:48.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92c3fff640 1 -- 172.21.15.78:0/1979203493 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b400b820 con 0x7f92cc0a2e40 2023-06-02T15:30:48.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92c3fff640 1 -- 172.21.15.78:0/1979203493 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b400bbd0 con 0x7f92cc0a2e40 2023-06-02T15:30:48.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- 172.21.15.78:0/1979203493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92cc15b800 con 0x7f92cc0a2e40 2023-06-02T15:30:48.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.151+0000 7f92d2086640 1 -- 172.21.15.78:0/1979203493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92cc0a01e0 con 0x7f92cc0a2e40 2023-06-02T15:30:48.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.155+0000 7f92d2086640 1 -- 172.21.15.78:0/1979203493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92cc15b990 con 0x7f92cc0a2e40 2023-06-02T15:30:48.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.155+0000 7f92c3fff640 1 -- 172.21.15.78:0/1979203493 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f92b401e460 con 0x7f92cc0a2e40 2023-06-02T15:30:48.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.155+0000 7f92c3fff640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f92ac065c30 0x7f92ac0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.155+0000 7f92cb7fe640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f92ac065c30 0x7f92ac0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.155+0000 7f92c3fff640 1 -- 172.21.15.78:0/1979203493 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f92b4083d80 con 0x7f92cc0a2e40 2023-06-02T15:30:48.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.155+0000 7f92cb7fe640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f92ac065c30 0x7f92ac0680e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92c40012f0 tx=0x7f92c4005ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:48.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.159+0000 7f92c3fff640 1 -- 172.21.15.78:0/1979203493 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f92b4051260 con 0x7f92cc0a2e40 2023-06-02T15:30:48.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.311+0000 7f92d2086640 1 -- 172.21.15.78:0/1979203493 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92cc073bc0 con 0x7f92cc0a2e40 2023-06-02T15:30:48.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92c3fff640 1 -- 172.21.15.78:0/1979203493 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f92b4054880 con 0x7f92cc0a2e40 2023-06-02T15:30:48.322 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:48.322 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:48.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 -- 172.21.15.78:0/1979203493 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f92ac065c30 msgr2=0x7f92ac0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f92ac065c30 0x7f92ac0680e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f92c40012f0 tx=0x7f92c4005ec0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 -- 172.21.15.78:0/1979203493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a2e40 msgr2=0x7f92cc143b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a2e40 0x7f92cc143b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f92b400d830 tx=0x7f92b400dcf0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 -- 172.21.15.78:0/1979203493 shutdown_connections 2023-06-02T15:30:48.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f92cc14be20 0x7f92cc142770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f92ac065c30 0x7f92ac0680e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92cc0a2e40 0x7f92cc143b10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 --2- 172.21.15.78:0/1979203493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f92cc0a28f0 0x7f92cc0be080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 -- 172.21.15.78:0/1979203493 >> 172.21.15.78:0/1979203493 conn(0x7f92cc0bcf50 msgr2=0x7f92cc149ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:48.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 -- 172.21.15.78:0/1979203493 shutdown_connections 2023-06-02T15:30:48.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.315+0000 7f92d2086640 1 -- 172.21.15.78:0/1979203493 wait complete. 2023-06-02T15:30:48.341 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-02T15:30:31.844882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-02T15:30:33.293644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-02T15:30:36.277798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-02T15:30:37.599884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-02T15:30:40.680165+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-02T15:30:48.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-02T15:30:48.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.455+0000 7f07d0c54640 1 Processor -- start 2023-06-02T15:30:48.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.455+0000 7f07d0c54640 1 -- start start 2023-06-02T15:30:48.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07d0c54640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07cc0c19c0 0x7f07cc0bf500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07d0c54640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc0b5e00 0x7f07cc06e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07d0c54640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07cc0c24c0 con 0x7f07cc06eb30 2023-06-02T15:30:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07d0c54640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07cc0bf0b0 con 0x7f07cc0c19c0 2023-06-02T15:30:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07d0c54640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0be410 con 0x7f07cc0b5e00 2023-06-02T15:30:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07ca59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07cc0c19c0 0x7f07cc0bf500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07ca59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f07cc0c19c0 0x7f07cc0bf500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53392/0 (socket says 172.21.15.78:53392) 2023-06-02T15:30:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07ca59c640 1 -- 172.21.15.78:0/604589212 learned_addr learned my addr 172.21.15.78:0/604589212 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07c3fff640 1 --2- 172.21.15.78:0/604589212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc0b5e00 0x7f07cc06e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07ca59c640 1 -- 172.21.15.78:0/604589212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc0b5e00 msgr2=0x7f07cc06e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:48.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07ca59c640 1 --2- 172.21.15.78:0/604589212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc0b5e00 0x7f07cc06e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07ca59c640 1 -- 172.21.15.78:0/604589212 >> v1:172.21.15.132:6789/0 conn(0x7f07cc06eb30 legacy=0x7f07cc1502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07ca59c640 1 -- 172.21.15.78:0/604589212 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07cc0c12f0 con 0x7f07cc0c19c0 2023-06-02T15:30:48.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07ca59c640 1 --2- 172.21.15.78:0/604589212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0c19c0 0x7f07cc0bf500 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009870 tx=0x7f07bc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a340560d1e06b server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:48.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07c9d9b640 1 -- 172.21.15.78:0/604589212 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0ad640 con 0x7f07cc0c19c0 2023-06-02T15:30:48.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07c9d9b640 1 -- 172.21.15.78:0/604589212 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07bc0ad7a0 con 0x7f07cc0c19c0 2023-06-02T15:30:48.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.459+0000 7f07c9d9b640 1 -- 172.21.15.78:0/604589212 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07bc0adb30 con 0x7f07cc0c19c0 2023-06-02T15:30:48.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- 172.21.15.78:0/604589212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0c19c0 msgr2=0x7f07cc0bf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 --2- 172.21.15.78:0/604589212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0c19c0 0x7f07cc0bf500 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f07bc009870 tx=0x7f07bc01c480 comp rx=0 tx=0).stop 2023-06-02T15:30:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- 172.21.15.78:0/604589212 shutdown_connections 2023-06-02T15:30:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 --2- 172.21.15.78:0/604589212 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc0b5e00 0x7f07cc06e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 --2- 172.21.15.78:0/604589212 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0c19c0 0x7f07cc0bf500 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- 172.21.15.78:0/604589212 >> 172.21.15.78:0/604589212 conn(0x7f07cc0a4290 msgr2=0x7f07cc0a4690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- 172.21.15.78:0/604589212 shutdown_connections 2023-06-02T15:30:48.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- 172.21.15.78:0/604589212 wait complete. 2023-06-02T15:30:48.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 Processor -- start 2023-06-02T15:30:48.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- start start 2023-06-02T15:30:48.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc06eb30 0x7f07cc0ba280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0b5e00 0x7f07cc14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07cc0c19c0 0x7f07cc0bad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0b7e70 con 0x7f07cc0b5e00 2023-06-02T15:30:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc0bb940 con 0x7f07cc0c19c0 2023-06-02T15:30:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07cc14a510 con 0x7f07cc06eb30 2023-06-02T15:30:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0b5e00 0x7f07cc14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0b5e00 0x7f07cc14f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53398/0 (socket says 172.21.15.78:53398) 2023-06-02T15:30:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c3fff640 1 -- 172.21.15.78:0/351523517 learned_addr learned my addr 172.21.15.78:0/351523517 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07cad9d640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07cc0c19c0 0x7f07cc0bad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07ca59c640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc06eb30 0x7f07cc0ba280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c3fff640 1 -- 172.21.15.78:0/351523517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc06eb30 msgr2=0x7f07cc0ba280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c3fff640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc06eb30 0x7f07cc0ba280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c3fff640 1 -- 172.21.15.78:0/351523517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07cc0c19c0 msgr2=0x7f07cc0bad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c3fff640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07cc0c19c0 0x7f07cc0bad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c3fff640 1 -- 172.21.15.78:0/351523517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07bc0094d0 con 0x7f07cc0b5e00 2023-06-02T15:30:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07ca59c640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc06eb30 0x7f07cc0ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c3fff640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0b5e00 0x7f07cc14f720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f07b400e930 tx=0x7f07b400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c2ffd640 1 -- 172.21.15.78:0/351523517 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b4009690 con 0x7f07cc0b5e00 2023-06-02T15:30:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c2ffd640 1 -- 172.21.15.78:0/351523517 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b400ca00 con 0x7f07cc0b5e00 2023-06-02T15:30:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07c2ffd640 1 -- 172.21.15.78:0/351523517 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b400cd70 con 0x7f07cc0b5e00 2023-06-02T15:30:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- 172.21.15.78:0/351523517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07cc0c1f20 con 0x7f07cc0b5e00 2023-06-02T15:30:48.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.463+0000 7f07d0c54640 1 -- 172.21.15.78:0/351523517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07cc0c1d90 con 0x7f07cc0b5e00 2023-06-02T15:30:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.467+0000 7f07d0c54640 1 -- 172.21.15.78:0/351523517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07cc0c05a0 con 0x7f07cc0b5e00 2023-06-02T15:30:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.467+0000 7f07c2ffd640 1 -- 172.21.15.78:0/351523517 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f07b4013470 con 0x7f07cc0b5e00 2023-06-02T15:30:48.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.467+0000 7f07c2ffd640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f07ac065c00 0x7f07ac0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.467+0000 7f07c2ffd640 1 -- 172.21.15.78:0/351523517 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f07b4083c50 con 0x7f07cc0b5e00 2023-06-02T15:30:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.467+0000 7f07ca59c640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f07ac065c00 0x7f07ac0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.467+0000 7f07ca59c640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f07ac065c00 0x7f07ac0680b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0af000 tx=0x7f07bc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:48.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.471+0000 7f07c2ffd640 1 -- 172.21.15.78:0/351523517 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f07b4089020 con 0x7f07cc0b5e00 2023-06-02T15:30:48.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.618+0000 7f07d0c54640 1 -- 172.21.15.78:0/351523517 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f07cc14a370 con 0x7f07cc0b5e00 2023-06-02T15:30:48.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07c2ffd640 1 -- 172.21.15.78:0/351523517 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f07cc14a370 con 0x7f07cc0b5e00 2023-06-02T15:30:48.629 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-02T15:30:48.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 -- 172.21.15.78:0/351523517 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f07ac065c00 msgr2=0x7f07ac0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f07ac065c00 0x7f07ac0680b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f07bc0af000 tx=0x7f07bc0a7070 comp rx=0 tx=0).stop 2023-06-02T15:30:48.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 -- 172.21.15.78:0/351523517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0b5e00 msgr2=0x7f07cc14f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0b5e00 0x7f07cc14f720 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f07b400e930 tx=0x7f07b400edf0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 -- 172.21.15.78:0/351523517 shutdown_connections 2023-06-02T15:30:48.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07cc0c19c0 0x7f07cc0bad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f07ac065c00 0x7f07ac0680b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07cc0b5e00 0x7f07cc14f720 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 --2- 172.21.15.78:0/351523517 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f07cc06eb30 0x7f07cc0ba280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 -- 172.21.15.78:0/351523517 >> 172.21.15.78:0/351523517 conn(0x7f07cc0a4290 msgr2=0x7f07cc0a7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 -- 172.21.15.78:0/351523517 shutdown_connections 2023-06-02T15:30:48.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.622+0000 7f07d0c54640 1 -- 172.21.15.78:0/351523517 wait complete. 2023-06-02T15:30:48.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-02T15:30:48.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef83b5640 1 Processor -- start 2023-06-02T15:30:48.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef83b5640 1 -- start start 2023-06-02T15:30:48.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef83b5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbef01504e0 0x7fbef00a4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef83b5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef006ec40 con 0x7fbef00c3000 2023-06-02T15:30:48.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef83b5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef006f170 con 0x7fbef00a3720 2023-06-02T15:30:48.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef83b5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef006ee90 con 0x7fbef01504e0 2023-06-02T15:30:48.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef6151640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbef00c3000 0x7fbef01497f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44820/0 (socket says 172.21.15.78:44820) 2023-06-02T15:30:48.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef6151640 1 -- 172.21.15.78:0/2520153198 learned_addr learned my addr 172.21.15.78:0/2520153198 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:48.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef6952640 1 --2- 172.21.15.78:0/2520153198 >> v2:172.21.15.132:3300/0 conn(0x7fbef01504e0 0x7fbef00a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368251450 0 0) 0x7fbef006ec40 con 0x7fbef00c3000 2023-06-02T15:30:48.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbedc003530 con 0x7fbef00c3000 2023-06-02T15:30:48.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2602842179 0 0) 0x7fbedc003530 con 0x7fbef00c3000 2023-06-02T15:30:48.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 >> v2:172.21.15.132:3300/0 conn(0x7fbef01504e0 msgr2=0x7fbef00a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:48.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 --2- 172.21.15.78:0/2520153198 >> v2:172.21.15.132:3300/0 conn(0x7fbef01504e0 0x7fbef00a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 >> v1:172.21.15.132:6789/0 conn(0x7fbef00a3720 legacy=0x7fbef014cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef014c700 con 0x7fbef00c3000 2023-06-02T15:30:48.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fbeec001680 con 0x7fbef00c3000 2023-06-02T15:30:48.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 >> v1:172.21.15.78:6789/0 conn(0x7fbef00c3000 legacy=0x7fbef01497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 --2- 172.21.15.78:0/2520153198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbedc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 --2- 172.21.15.78:0/2520153198 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbedc0047d0 0x7fbedc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 --2- 172.21.15.78:0/2520153198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbedc005180 0x7fbedc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef006ee90 con 0x7fbedc0039f0 2023-06-02T15:30:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc00c090 con 0x7fbedc005180 2023-06-02T15:30:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc00c250 con 0x7fbedc0047d0 2023-06-02T15:30:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef6151640 1 --2- 172.21.15.78:0/2520153198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbedc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef6151640 1 -- 172.21.15.78:0/2520153198 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbedc0047d0 msgr2=0x7fbedc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef6151640 1 --2- 172.21.15.78:0/2520153198 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbedc0047d0 0x7fbedc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef6151640 1 -- 172.21.15.78:0/2520153198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbedc005180 msgr2=0x7fbedc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef6151640 1 --2- 172.21.15.78:0/2520153198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbedc005180 0x7fbedc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef6952640 1 -- 172.21.15.78:0/2520153198 reap_dead start 2023-06-02T15:30:48.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.766+0000 7fbef6151640 1 -- 172.21.15.78:0/2520153198 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbedc003530 con 0x7fbedc0039f0 2023-06-02T15:30:48.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef6151640 1 --2- 172.21.15.78:0/2520153198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbedc003e00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbeec001060 tx=0x7fbeec01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c8fb9b32dc728 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:48.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0058e0 con 0x7fbedc0039f0 2023-06-02T15:30:48.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec005a40 con 0x7fbedc0039f0 2023-06-02T15:30:48.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef514f640 1 -- 172.21.15.78:0/2520153198 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec005e70 con 0x7fbedc0039f0 2023-06-02T15:30:48.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 -- 172.21.15.78:0/2520153198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 msgr2=0x7fbedc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 --2- 172.21.15.78:0/2520153198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbedc003e00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbeec001060 tx=0x7fbeec01cc00 comp rx=0 tx=0).stop 2023-06-02T15:30:48.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 -- 172.21.15.78:0/2520153198 shutdown_connections 2023-06-02T15:30:48.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 --2- 172.21.15.78:0/2520153198 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbedc003e00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 -- 172.21.15.78:0/2520153198 >> 172.21.15.78:0/2520153198 conn(0x7fbef006a550 msgr2=0x7fbef00c2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:48.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 -- 172.21.15.78:0/2520153198 shutdown_connections 2023-06-02T15:30:48.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 -- 172.21.15.78:0/2520153198 wait complete. 2023-06-02T15:30:48.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 Processor -- start 2023-06-02T15:30:48.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 -- start start 2023-06-02T15:30:48.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbef00b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbef014f8e0 0x7fbef014d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbef00b4020 0x7fbef014bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00b3e90 con 0x7fbedc0039f0 2023-06-02T15:30:48.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00c1ff0 con 0x7fbef014f8e0 2023-06-02T15:30:48.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef83b5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef014c160 con 0x7fbef00b4020 2023-06-02T15:30:48.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef6151640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbef00b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef6151640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbef00b44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53424/0 (socket says 172.21.15.78:53424) 2023-06-02T15:30:48.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef6151640 1 -- 172.21.15.78:0/4008055141 learned_addr learned my addr 172.21.15.78:0/4008055141 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:48.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef5950640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbef014f8e0 0x7fbef014d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef6952640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbef00b4020 0x7fbef014bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef6151640 1 -- 172.21.15.78:0/4008055141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbef00b4020 msgr2=0x7fbef014bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef6151640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbef00b4020 0x7fbef014bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef6151640 1 -- 172.21.15.78:0/4008055141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbef014f8e0 msgr2=0x7fbef014d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef6151640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbef014f8e0 0x7fbef014d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef6151640 1 -- 172.21.15.78:0/4008055141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef014cdb0 con 0x7fbedc0039f0 2023-06-02T15:30:48.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.770+0000 7fbef5950640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbef014f8e0 0x7fbef014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:48.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbef6151640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbef00b44b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbeec0ab040 tx=0x7fbedc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:48.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbee6ffd640 1 -- 172.21.15.78:0/4008055141 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0a57f0 con 0x7fbedc0039f0 2023-06-02T15:30:48.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbee6ffd640 1 -- 172.21.15.78:0/4008055141 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec0a5950 con 0x7fbedc0039f0 2023-06-02T15:30:48.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbef83b5640 1 -- 172.21.15.78:0/4008055141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef014cc20 con 0x7fbedc0039f0 2023-06-02T15:30:48.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbee6ffd640 1 -- 172.21.15.78:0/4008055141 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec0a5ce0 con 0x7fbedc0039f0 2023-06-02T15:30:48.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbef83b5640 1 -- 172.21.15.78:0/4008055141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef014cf40 con 0x7fbedc0039f0 2023-06-02T15:30:48.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbef83b5640 1 -- 172.21.15.78:0/4008055141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbef0073bc0 con 0x7fbedc0039f0 2023-06-02T15:30:48.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbee6ffd640 1 -- 172.21.15.78:0/4008055141 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fbeec0047f0 con 0x7fbedc0039f0 2023-06-02T15:30:48.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbee6ffd640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbed4065c00 0x7fbed40680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:48.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbee6ffd640 1 -- 172.21.15.78:0/4008055141 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbef014a000 con 0x7fbedc0039f0 2023-06-02T15:30:48.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbef5950640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbed4065c00 0x7fbed40680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:48.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.774+0000 7fbef5950640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbed4065c00 0x7fbed40680b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbef00b49f0 tx=0x7fbee0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:48.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.778+0000 7fbee6ffd640 1 -- 172.21.15.78:0/4008055141 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fbeec0e9fe0 con 0x7fbedc0039f0 2023-06-02T15:30:48.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 -- 172.21.15.78:0/4008055141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbef00a5020 con 0x7fbedc0039f0 2023-06-02T15:30:48.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbee6ffd640 1 -- 172.21.15.78:0/4008055141 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbeec0ed600 con 0x7fbedc0039f0 2023-06-02T15:30:48.938 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-02T15:30:48.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 -- 172.21.15.78:0/4008055141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbed4065c00 msgr2=0x7fbed40680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbed4065c00 0x7fbed40680b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbef00b49f0 tx=0x7fbee0009040 comp rx=0 tx=0).stop 2023-06-02T15:30:48.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 -- 172.21.15.78:0/4008055141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 msgr2=0x7fbef00b44b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:48.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbef00b44b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbeec0ab040 tx=0x7fbedc005800 comp rx=0 tx=0).stop 2023-06-02T15:30:48.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 -- 172.21.15.78:0/4008055141 shutdown_connections 2023-06-02T15:30:48.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbef00b4020 0x7fbef014bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbef014f8e0 0x7fbef014d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbed4065c00 0x7fbed40680b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 --2- 172.21.15.78:0/4008055141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbedc0039f0 0x7fbef00b44b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:48.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 -- 172.21.15.78:0/4008055141 >> 172.21.15.78:0/4008055141 conn(0x7fbef006a550 msgr2=0x7fbef01451e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:48.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 -- 172.21.15.78:0/4008055141 shutdown_connections 2023-06-02T15:30:48.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:48.930+0000 7fbef83b5640 1 -- 172.21.15.78:0/4008055141 wait complete. 2023-06-02T15:30:48.957 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-02T15:30:49.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.066+0000 7eff2d720640 1 Processor -- start 2023-06-02T15:30:49.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.066+0000 7eff2d720640 1 -- start start 2023-06-02T15:30:49.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff2d720640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7eff2814bdb0 0x7eff280c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff2d720640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff280a3ed0 0x7eff280c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff2d720640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff280c2ca0 0x7eff2814e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff2d720640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff280a96f0 con 0x7eff280a3ed0 2023-06-02T15:30:49.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff2d720640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff280c3690 con 0x7eff2814bdb0 2023-06-02T15:30:49.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff2d720640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff280c3fa0 con 0x7eff280c2ca0 2023-06-02T15:30:49.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff267fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff280a3ed0 0x7eff280c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff267fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff280a3ed0 0x7eff280c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53438/0 (socket says 172.21.15.78:53438) 2023-06-02T15:30:49.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff267fc640 1 -- 172.21.15.78:0/3046840523 learned_addr learned my addr 172.21.15.78:0/3046840523 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:49.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff26ffd640 1 --2- 172.21.15.78:0/3046840523 >> v2:172.21.15.132:3300/0 conn(0x7eff2814bdb0 0x7eff280c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff277fe640 1 --2- 172.21.15.78:0/3046840523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff280c2ca0 0x7eff2814e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff267fc640 1 -- 172.21.15.78:0/3046840523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff280c2ca0 msgr2=0x7eff2814e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:49.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff267fc640 1 --2- 172.21.15.78:0/3046840523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff280c2ca0 0x7eff2814e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff267fc640 1 -- 172.21.15.78:0/3046840523 >> v2:172.21.15.132:3300/0 conn(0x7eff2814bdb0 msgr2=0x7eff280c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:49.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff267fc640 1 --2- 172.21.15.78:0/3046840523 >> v2:172.21.15.132:3300/0 conn(0x7eff2814bdb0 0x7eff280c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff267fc640 1 -- 172.21.15.78:0/3046840523 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff280a98e0 con 0x7eff280a3ed0 2023-06-02T15:30:49.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff277fe640 1 --2- 172.21.15.78:0/3046840523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff280c2ca0 0x7eff2814e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:49.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff267fc640 1 --2- 172.21.15.78:0/3046840523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 0x7eff280c2760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff280c3c50 tx=0x7eff1801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43f8fa818e29fa41 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff25ffb640 1 -- 172.21.15.78:0/3046840523 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180af400 con 0x7eff280a3ed0 2023-06-02T15:30:49.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff25ffb640 1 -- 172.21.15.78:0/3046840523 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff180ab050 con 0x7eff280a3ed0 2023-06-02T15:30:49.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.070+0000 7eff25ffb640 1 -- 172.21.15.78:0/3046840523 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff180af780 con 0x7eff280a3ed0 2023-06-02T15:30:49.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- 172.21.15.78:0/3046840523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 msgr2=0x7eff280c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 --2- 172.21.15.78:0/3046840523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 0x7eff280c2760 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7eff280c3c50 tx=0x7eff1801f1c0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- 172.21.15.78:0/3046840523 shutdown_connections 2023-06-02T15:30:49.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 --2- 172.21.15.78:0/3046840523 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff280c2ca0 0x7eff2814e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 --2- 172.21.15.78:0/3046840523 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 0x7eff280c2760 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 --2- 172.21.15.78:0/3046840523 >> v2:172.21.15.132:3300/0 conn(0x7eff2814bdb0 0x7eff280c3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- 172.21.15.78:0/3046840523 >> 172.21.15.78:0/3046840523 conn(0x7eff280a6470 msgr2=0x7eff280a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:49.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- 172.21.15.78:0/3046840523 shutdown_connections 2023-06-02T15:30:49.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- 172.21.15.78:0/3046840523 wait complete. 2023-06-02T15:30:49.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 Processor -- start 2023-06-02T15:30:49.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- start start 2023-06-02T15:30:49.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 0x7eff281d8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff280c2ca0 0x7eff28149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff2814bdb0 0x7eff281d8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281d8540 con 0x7eff280a3ed0 2023-06-02T15:30:49.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281db8a0 con 0x7eff280c2ca0 2023-06-02T15:30:49.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff28151430 con 0x7eff2814bdb0 2023-06-02T15:30:49.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 0x7eff281d8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 0x7eff281d8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53442/0 (socket says 172.21.15.78:53442) 2023-06-02T15:30:49.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff26ffd640 1 -- 172.21.15.78:0/888455268 learned_addr learned my addr 172.21.15.78:0/888455268 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:49.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff267fc640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff280c2ca0 0x7eff28149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff277fe640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff2814bdb0 0x7eff281d8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff26ffd640 1 -- 172.21.15.78:0/888455268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff2814bdb0 msgr2=0x7eff281d8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff26ffd640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff2814bdb0 0x7eff281d8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff26ffd640 1 -- 172.21.15.78:0/888455268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff280c2ca0 msgr2=0x7eff28149bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff26ffd640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff280c2ca0 0x7eff28149bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff26ffd640 1 -- 172.21.15.78:0/888455268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff18009b30 con 0x7eff280a3ed0 2023-06-02T15:30:49.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff267fc640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff280c2ca0 0x7eff28149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:49.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff277fe640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff2814bdb0 0x7eff281d8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:49.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff26ffd640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 0x7eff281d8000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff1000d5f0 tx=0x7eff1000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff1f7fe640 1 -- 172.21.15.78:0/888455268 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff100125f0 con 0x7eff280a3ed0 2023-06-02T15:30:49.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff1f7fe640 1 -- 172.21.15.78:0/888455268 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff10012750 con 0x7eff280a3ed0 2023-06-02T15:30:49.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff1f7fe640 1 -- 172.21.15.78:0/888455268 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff10012ae0 con 0x7eff280a3ed0 2023-06-02T15:30:49.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- 172.21.15.78:0/888455268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff280a9bc0 con 0x7eff280a3ed0 2023-06-02T15:30:49.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- 172.21.15.78:0/888455268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff280c4210 con 0x7eff280a3ed0 2023-06-02T15:30:49.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.074+0000 7eff2d720640 1 -- 172.21.15.78:0/888455268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff2814ea80 con 0x7eff280a3ed0 2023-06-02T15:30:49.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.078+0000 7eff1f7fe640 1 -- 172.21.15.78:0/888455268 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7eff10012c40 con 0x7eff280a3ed0 2023-06-02T15:30:49.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.078+0000 7eff1f7fe640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff08065c00 0x7eff080680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.078+0000 7eff1f7fe640 1 -- 172.21.15.78:0/888455268 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7eff10083ad0 con 0x7eff280a3ed0 2023-06-02T15:30:49.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.078+0000 7eff267fc640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff08065c00 0x7eff080680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.078+0000 7eff267fc640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff08065c00 0x7eff080680b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff180b1000 tx=0x7eff180aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.082+0000 7eff1f7fe640 1 -- 172.21.15.78:0/888455268 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7eff10051040 con 0x7eff280a3ed0 2023-06-02T15:30:49.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.226+0000 7eff2d720640 1 -- 172.21.15.78:0/888455268 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff28073bc0 con 0x7eff280a3ed0 2023-06-02T15:30:49.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.226+0000 7eff1f7fe640 1 -- 172.21.15.78:0/888455268 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff10007380 con 0x7eff280a3ed0 2023-06-02T15:30:49.237 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:30:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 -- 172.21.15.78:0/888455268 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff08065c00 msgr2=0x7eff080680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff08065c00 0x7eff080680b0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff180b1000 tx=0x7eff180aa000 comp rx=0 tx=0).stop 2023-06-02T15:30:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 -- 172.21.15.78:0/888455268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 msgr2=0x7eff281d8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 0x7eff281d8000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7eff1000d5f0 tx=0x7eff1000dab0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 -- 172.21.15.78:0/888455268 shutdown_connections 2023-06-02T15:30:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff2814bdb0 0x7eff281d8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff280c2ca0 0x7eff28149bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff08065c00 0x7eff080680b0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 --2- 172.21.15.78:0/888455268 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff280a3ed0 0x7eff281d8000 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 -- 172.21.15.78:0/888455268 >> 172.21.15.78:0/888455268 conn(0x7eff280a6470 msgr2=0x7eff2814eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 -- 172.21.15.78:0/888455268 shutdown_connections 2023-06-02T15:30:49.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.230+0000 7eff2d720640 1 -- 172.21.15.78:0/888455268 wait complete. 2023-06-02T15:30:49.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-02T15:30:49.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.358+0000 7f6c796af640 1 Processor -- start 2023-06-02T15:30:49.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.358+0000 7f6c796af640 1 -- start start 2023-06-02T15:30:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c796af640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c7406c250 0x7f6c740718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c796af640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7414d220 con 0x7f6c7406cfc0 2023-06-02T15:30:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c796af640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c740ba850 con 0x7f6c740a59e0 2023-06-02T15:30:49.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c796af640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c740ba640 con 0x7f6c7406c250 2023-06-02T15:30:49.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c727fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6c7406cfc0 0x7f6c74149660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44826/0 (socket says 172.21.15.78:44826) 2023-06-02T15:30:49.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c727fc640 1 -- 172.21.15.78:0/2002937051 learned_addr learned my addr 172.21.15.78:0/2002937051 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:49.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c737fe640 1 --2- 172.21.15.78:0/2002937051 >> v2:172.21.15.132:3300/0 conn(0x7f6c7406c250 0x7f6c740718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 140165574 0 0) 0x7f6c7414d220 con 0x7f6c7406cfc0 2023-06-02T15:30:49.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c60003530 con 0x7f6c7406cfc0 2023-06-02T15:30:49.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 349684639 0 0) 0x7f6c60003530 con 0x7f6c7406cfc0 2023-06-02T15:30:49.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 >> v2:172.21.15.132:3300/0 conn(0x7f6c7406c250 msgr2=0x7f6c740718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:49.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 --2- 172.21.15.78:0/2002937051 >> v2:172.21.15.132:3300/0 conn(0x7f6c7406c250 0x7f6c740718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 >> v1:172.21.15.132:6789/0 conn(0x7f6c740a59e0 legacy=0x7f6c7414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7414cf40 con 0x7f6c7406cfc0 2023-06-02T15:30:49.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f6c5c001680 con 0x7f6c7406cfc0 2023-06-02T15:30:49.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 >> v1:172.21.15.78:6789/0 conn(0x7f6c7406cfc0 legacy=0x7f6c74149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600039f0 0x7f6c60003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c600047d0 0x7f6c60004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c600051d0 0x7f6c6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c740ba640 con 0x7f6c600051d0 2023-06-02T15:30:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6000c110 con 0x7f6c600039f0 2023-06-02T15:30:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6000c2d0 con 0x7f6c600047d0 2023-06-02T15:30:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c737fe640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c600051d0 0x7f6c6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c72ffd640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600039f0 0x7f6c60003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c737fe640 1 -- 172.21.15.78:0/2002937051 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c600047d0 msgr2=0x7f6c60004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c727fc640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c600047d0 0x7f6c60004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c737fe640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c600047d0 0x7f6c60004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c737fe640 1 -- 172.21.15.78:0/2002937051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600039f0 msgr2=0x7f6c60003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c737fe640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600039f0 0x7f6c60003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c737fe640 1 -- 172.21.15.78:0/2002937051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c60003530 con 0x7f6c600051d0 2023-06-02T15:30:49.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c72ffd640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600039f0 0x7f6c60003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:49.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c737fe640 1 -- 172.21.15.78:0/2002937051 reap_dead start 2023-06-02T15:30:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.362+0000 7f6c737fe640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c600051d0 0x7f6c6000b990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c74071e10 tx=0x7f6c6401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ebaba99cf791c77 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640a5620 con 0x7f6c600051d0 2023-06-02T15:30:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c640a5780 con 0x7f6c600051d0 2023-06-02T15:30:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c71ffb640 1 -- 172.21.15.78:0/2002937051 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640a5b10 con 0x7f6c600051d0 2023-06-02T15:30:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- 172.21.15.78:0/2002937051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c600051d0 msgr2=0x7f6c6000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c600051d0 0x7f6c6000b990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c74071e10 tx=0x7f6c6401ca30 comp rx=0 tx=0).stop 2023-06-02T15:30:49.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- 172.21.15.78:0/2002937051 shutdown_connections 2023-06-02T15:30:49.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 --2- 172.21.15.78:0/2002937051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c600051d0 0x7f6c6000b990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- 172.21.15.78:0/2002937051 >> 172.21.15.78:0/2002937051 conn(0x7f6c740a2170 msgr2=0x7f6c740a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:49.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- 172.21.15.78:0/2002937051 shutdown_connections 2023-06-02T15:30:49.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- 172.21.15.78:0/2002937051 wait complete. 2023-06-02T15:30:49.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 Processor -- start 2023-06-02T15:30:49.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- start start 2023-06-02T15:30:49.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600051d0 0x7f6c741e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74070360 0x7f6c7414bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c74146d90 0x7f6c74139340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7414c650 con 0x7f6c74070360 2023-06-02T15:30:49.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c741e42e0 con 0x7f6c600051d0 2023-06-02T15:30:49.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7414bff0 con 0x7f6c74146d90 2023-06-02T15:30:49.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c727fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74070360 0x7f6c7414bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c727fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74070360 0x7f6c7414bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53462/0 (socket says 172.21.15.78:53462) 2023-06-02T15:30:49.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c727fc640 1 -- 172.21.15.78:0/480161811 learned_addr learned my addr 172.21.15.78:0/480161811 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:49.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c72ffd640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600051d0 0x7f6c741e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c737fe640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c74146d90 0x7f6c74139340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c727fc640 1 -- 172.21.15.78:0/480161811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c74146d90 msgr2=0x7f6c74139340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c727fc640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c74146d90 0x7f6c74139340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c727fc640 1 -- 172.21.15.78:0/480161811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600051d0 msgr2=0x7f6c741e3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c727fc640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600051d0 0x7f6c741e3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c727fc640 1 -- 172.21.15.78:0/480161811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c740a5f40 con 0x7f6c74070360 2023-06-02T15:30:49.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c737fe640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c74146d90 0x7f6c74139340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:49.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c72ffd640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600051d0 0x7f6c741e3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:49.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c727fc640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74070360 0x7f6c7414bab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c010c90 tx=0x7f6c5c00e4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c6b7fe640 1 -- 172.21.15.78:0/480161811 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00ed90 con 0x7f6c74070360 2023-06-02T15:30:49.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c6b7fe640 1 -- 172.21.15.78:0/480161811 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c5c0143a0 con 0x7f6c74070360 2023-06-02T15:30:49.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- 172.21.15.78:0/480161811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c740a5db0 con 0x7f6c74070360 2023-06-02T15:30:49.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c6b7fe640 1 -- 172.21.15.78:0/480161811 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c014710 con 0x7f6c74070360 2023-06-02T15:30:49.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.366+0000 7f6c796af640 1 -- 172.21.15.78:0/480161811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c740718d0 con 0x7f6c74070360 2023-06-02T15:30:49.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.370+0000 7f6c796af640 1 -- 172.21.15.78:0/480161811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7406f590 con 0x7f6c74070360 2023-06-02T15:30:49.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.370+0000 7f6c6b7fe640 1 -- 172.21.15.78:0/480161811 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f6c5c014870 con 0x7f6c74070360 2023-06-02T15:30:49.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.370+0000 7f6c6b7fe640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c54065c30 0x7f6c540680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.370+0000 7f6c6b7fe640 1 -- 172.21.15.78:0/480161811 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6c5c0861f0 con 0x7f6c74070360 2023-06-02T15:30:49.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.370+0000 7f6c72ffd640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c54065c30 0x7f6c540680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.370+0000 7f6c72ffd640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c54065c30 0x7f6c540680e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0012f0 tx=0x7f6c6c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.374+0000 7f6c6b7fe640 1 -- 172.21.15.78:0/480161811 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f6c7406f590 con 0x7f6c74070360 2023-06-02T15:30:49.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.518+0000 7f6c796af640 1 -- 172.21.15.78:0/480161811 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c7406f590 con 0x7f6c74070360 2023-06-02T15:30:49.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.518+0000 7f6c6b7fe640 1 -- 172.21.15.78:0/480161811 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c7406f590 con 0x7f6c74070360 2023-06-02T15:30:49.527 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-02T15:30:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 -- 172.21.15.78:0/480161811 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c54065c30 msgr2=0x7f6c540680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c54065c30 0x7f6c540680e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0012f0 tx=0x7f6c6c009040 comp rx=0 tx=0).stop 2023-06-02T15:30:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 -- 172.21.15.78:0/480161811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74070360 msgr2=0x7f6c7414bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74070360 0x7f6c7414bab0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c010c90 tx=0x7f6c5c00e4d0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 -- 172.21.15.78:0/480161811 shutdown_connections 2023-06-02T15:30:49.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c74146d90 0x7f6c74139340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c54065c30 0x7f6c540680e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c74070360 0x7f6c7414bab0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 --2- 172.21.15.78:0/480161811 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c600051d0 0x7f6c741e3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 -- 172.21.15.78:0/480161811 >> 172.21.15.78:0/480161811 conn(0x7f6c740a2170 msgr2=0x7f6c741488f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:49.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 -- 172.21.15.78:0/480161811 shutdown_connections 2023-06-02T15:30:49.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.522+0000 7f6c796af640 1 -- 172.21.15.78:0/480161811 wait complete. 2023-06-02T15:30:49.544 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-02T15:30:49.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.642+0000 7f94e7411640 1 Processor -- start 2023-06-02T15:30:49.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e7411640 1 -- start start 2023-06-02T15:30:49.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e7411640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94e01481b0 0x7f94e014dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e7411640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00bccd0 con 0x7f94e00ba640 2023-06-02T15:30:49.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e7411640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e006bf70 con 0x7f94e00bc8b0 2023-06-02T15:30:49.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e7411640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00a4b60 con 0x7f94e01481b0 2023-06-02T15:30:49.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e49ac640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f94e00ba640 0x7f94e00bc1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44840/0 (socket says 172.21.15.78:44840) 2023-06-02T15:30:49.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e49ac640 1 -- 172.21.15.78:0/2091679384 learned_addr learned my addr 172.21.15.78:0/2091679384 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:49.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e51ad640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94e01481b0 0x7f94e014dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3146744316 0 0) 0x7f94dc001120 con 0x7f94e00ba640 2023-06-02T15:30:49.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94cc003530 con 0x7f94e00ba640 2023-06-02T15:30:49.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1436753830 0 0) 0x7f94cc003530 con 0x7f94e00ba640 2023-06-02T15:30:49.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94e01481b0 msgr2=0x7f94e014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:49.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94e01481b0 0x7f94e014dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 >> v1:172.21.15.132:6789/0 conn(0x7f94e00bc8b0 legacy=0x7f94e0155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00a41a0 con 0x7f94e00ba640 2023-06-02T15:30:49.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f94dc001810 con 0x7f94e00ba640 2023-06-02T15:30:49.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 >> v1:172.21.15.78:6789/0 conn(0x7f94e00ba640 legacy=0x7f94e00bc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94e01481b0 0x7f94cc003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94cc003fa0 0x7f94cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94cc004d10 0x7f94cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc00baa0 con 0x7f94cc003fa0 2023-06-02T15:30:49.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc00bc10 con 0x7f94cc004d10 2023-06-02T15:30:49.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94cc00bdd0 con 0x7f94e01481b0 2023-06-02T15:30:49.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e49ac640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94cc003fa0 0x7f94cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e51ad640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94e01481b0 0x7f94cc003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e49ac640 1 -- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94e01481b0 msgr2=0x7f94cc003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:49.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e49ac640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94e01481b0 0x7f94cc003a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e49ac640 1 -- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94cc004d10 msgr2=0x7f94cc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:49.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e59ae640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94cc004d10 0x7f94cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e49ac640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94cc004d10 0x7f94cc005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.646+0000 7f94e49ac640 1 -- 172.21.15.78:0/2091679384 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94cc003530 con 0x7f94cc003fa0 2023-06-02T15:30:49.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e49ac640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94cc003fa0 0x7f94cc0047d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00c240 tx=0x7f94dc01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53bbfaab65d53a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc005ae0 con 0x7f94cc003fa0 2023-06-02T15:30:49.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc0ab070 con 0x7f94cc003fa0 2023-06-02T15:30:49.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94d7fff640 1 -- 172.21.15.78:0/2091679384 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc007070 con 0x7f94cc003fa0 2023-06-02T15:30:49.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- 172.21.15.78:0/2091679384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94cc003fa0 msgr2=0x7f94cc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 --2- 172.21.15.78:0/2091679384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94cc003fa0 0x7f94cc0047d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00c240 tx=0x7f94dc01f3b0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e59ae640 1 -- 172.21.15.78:0/2091679384 reap_dead start 2023-06-02T15:30:49.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- 172.21.15.78:0/2091679384 shutdown_connections 2023-06-02T15:30:49.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- 172.21.15.78:0/2091679384 >> 172.21.15.78:0/2091679384 conn(0x7f94e00a2170 msgr2=0x7f94e00a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:49.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- 172.21.15.78:0/2091679384 shutdown_connections 2023-06-02T15:30:49.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- 172.21.15.78:0/2091679384 wait complete. 2023-06-02T15:30:49.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 Processor -- start 2023-06-02T15:30:49.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- start start 2023-06-02T15:30:49.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc003fa0 0x7f94e0143810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e0141570 0x7f94e013b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e013b670 0x7f94e0140000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e006ef60 con 0x7f94e013b670 2023-06-02T15:30:49.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0143d50 con 0x7f94e0141570 2023-06-02T15:30:49.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01473d0 con 0x7f94cc003fa0 2023-06-02T15:30:49.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e59ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e013b670 0x7f94e0140000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e59ae640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e013b670 0x7f94e0140000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53476/0 (socket says 172.21.15.78:53476) 2023-06-02T15:30:49.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e59ae640 1 -- 172.21.15.78:0/1308274234 learned_addr learned my addr 172.21.15.78:0/1308274234 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:49.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e51ad640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc003fa0 0x7f94e0143810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e49ac640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e0141570 0x7f94e013b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e59ae640 1 -- 172.21.15.78:0/1308274234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc003fa0 msgr2=0x7f94e0143810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e59ae640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc003fa0 0x7f94e0143810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e59ae640 1 -- 172.21.15.78:0/1308274234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e0141570 msgr2=0x7f94e013b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e59ae640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e0141570 0x7f94e013b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e59ae640 1 -- 172.21.15.78:0/1308274234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e006c4a0 con 0x7f94e013b670 2023-06-02T15:30:49.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e49ac640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e0141570 0x7f94e013b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:49.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e59ae640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e013b670 0x7f94e0140000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f94e0072120 tx=0x7f94d800d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94d5ffb640 1 -- 172.21.15.78:0/1308274234 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d800b070 con 0x7f94e013b670 2023-06-02T15:30:49.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94d5ffb640 1 -- 172.21.15.78:0/1308274234 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d8003980 con 0x7f94e013b670 2023-06-02T15:30:49.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- 172.21.15.78:0/1308274234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e006c1c0 con 0x7f94e013b670 2023-06-02T15:30:49.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94d5ffb640 1 -- 172.21.15.78:0/1308274234 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d8003d30 con 0x7f94e013b670 2023-06-02T15:30:49.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.650+0000 7f94e7411640 1 -- 172.21.15.78:0/1308274234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e006c780 con 0x7f94e013b670 2023-06-02T15:30:49.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.654+0000 7f94e7411640 1 -- 172.21.15.78:0/1308274234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e0073bc0 con 0x7f94e013b670 2023-06-02T15:30:49.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.654+0000 7f94d5ffb640 1 -- 172.21.15.78:0/1308274234 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f94d80050d0 con 0x7f94e013b670 2023-06-02T15:30:49.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.654+0000 7f94d5ffb640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f94c4065c00 0x7f94c40680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.654+0000 7f94d5ffb640 1 -- 172.21.15.78:0/1308274234 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94d80828a0 con 0x7f94e013b670 2023-06-02T15:30:49.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.654+0000 7f94e51ad640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f94c4065c00 0x7f94c40680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.654+0000 7f94e51ad640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f94c4065c00 0x7f94c40680b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009930 tx=0x7f94d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.658+0000 7f94d5ffb640 1 -- 172.21.15.78:0/1308274234 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f94d804fd60 con 0x7f94e013b670 2023-06-02T15:30:49.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.798+0000 7f94e7411640 1 -- 172.21.15.78:0/1308274234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f94e00a4c40 con 0x7f94e013b670 2023-06-02T15:30:49.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.798+0000 7f94d5ffb640 1 -- 172.21.15.78:0/1308274234 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f94d8053380 con 0x7f94e013b670 2023-06-02T15:30:49.808 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:30:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 -- 172.21.15.78:0/1308274234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f94c4065c00 msgr2=0x7f94c40680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f94c4065c00 0x7f94c40680b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f94d0009930 tx=0x7f94d0008040 comp rx=0 tx=0).stop 2023-06-02T15:30:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 -- 172.21.15.78:0/1308274234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e013b670 msgr2=0x7f94e0140000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e013b670 0x7f94e0140000 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f94e0072120 tx=0x7f94d800d830 comp rx=0 tx=0).stop 2023-06-02T15:30:49.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 -- 172.21.15.78:0/1308274234 shutdown_connections 2023-06-02T15:30:49.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f94c4065c00 0x7f94c40680b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94e013b670 0x7f94e0140000 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94e0141570 0x7f94e013b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 --2- 172.21.15.78:0/1308274234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f94cc003fa0 0x7f94e0143810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 -- 172.21.15.78:0/1308274234 >> 172.21.15.78:0/1308274234 conn(0x7f94e00a2170 msgr2=0x7f94e00bb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:49.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 -- 172.21.15.78:0/1308274234 shutdown_connections 2023-06-02T15:30:49.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.802+0000 7f94e7411640 1 -- 172.21.15.78:0/1308274234 wait complete. 2023-06-02T15:30:49.825 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-02T15:30:49.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde35e66640 1 Processor -- start 2023-06-02T15:30:49.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde35e66640 1 -- start start 2023-06-02T15:30:49.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde35e66640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fde300a59e0 0x7fde300718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde35e66640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde3006cfc0 0x7fde3014f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde35e66640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde3014d220 con 0x7fde3014fd80 2023-06-02T15:30:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde35e66640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde300ba640 con 0x7fde3006cfc0 2023-06-02T15:30:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde35e66640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde3014cd30 con 0x7fde300a59e0 2023-06-02T15:30:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde26ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde3006cfc0 0x7fde3014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde26ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fde3006cfc0 0x7fde3014f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53480/0 (socket says 172.21.15.78:53480) 2023-06-02T15:30:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde26ffd640 1 -- 172.21.15.78:0/2680331270 learned_addr learned my addr 172.21.15.78:0/2680331270 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde2f7fe640 1 --2- 172.21.15.78:0/2680331270 >> v2:172.21.15.132:3300/0 conn(0x7fde300a59e0 0x7fde300718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde26ffd640 1 -- 172.21.15.78:0/2680331270 >> v2:172.21.15.132:3300/0 conn(0x7fde300a59e0 msgr2=0x7fde300718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde26ffd640 1 --2- 172.21.15.78:0/2680331270 >> v2:172.21.15.132:3300/0 conn(0x7fde300a59e0 0x7fde300718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde26ffd640 1 -- 172.21.15.78:0/2680331270 >> v1:172.21.15.132:6789/0 conn(0x7fde3014fd80 legacy=0x7fde30149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde26ffd640 1 -- 172.21.15.78:0/2680331270 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde300ba850 con 0x7fde3006cfc0 2023-06-02T15:30:49.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde26ffd640 1 --2- 172.21.15.78:0/2680331270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3006cfc0 0x7fde3014f840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fde300c1460 tx=0x7fde2001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65590ed5de573a6a server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.926+0000 7fde2effd640 1 -- 172.21.15.78:0/2680331270 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde200ab620 con 0x7fde3006cfc0 2023-06-02T15:30:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2effd640 1 -- 172.21.15.78:0/2680331270 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde200ab780 con 0x7fde3006cfc0 2023-06-02T15:30:49.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2effd640 1 -- 172.21.15.78:0/2680331270 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde200abb10 con 0x7fde3006cfc0 2023-06-02T15:30:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- 172.21.15.78:0/2680331270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3006cfc0 msgr2=0x7fde3014f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 --2- 172.21.15.78:0/2680331270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3006cfc0 0x7fde3014f840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fde300c1460 tx=0x7fde2001c400 comp rx=0 tx=0).stop 2023-06-02T15:30:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- 172.21.15.78:0/2680331270 shutdown_connections 2023-06-02T15:30:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 --2- 172.21.15.78:0/2680331270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3006cfc0 0x7fde3014f840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 --2- 172.21.15.78:0/2680331270 >> v2:172.21.15.132:3300/0 conn(0x7fde300a59e0 0x7fde300718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- 172.21.15.78:0/2680331270 >> 172.21.15.78:0/2680331270 conn(0x7fde300a2170 msgr2=0x7fde300a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:49.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- 172.21.15.78:0/2680331270 shutdown_connections 2023-06-02T15:30:49.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- 172.21.15.78:0/2680331270 wait complete. 2023-06-02T15:30:49.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 Processor -- start 2023-06-02T15:30:49.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- start start 2023-06-02T15:30:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fde3006cfc0 0x7fde301e8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde300a59e0 0x7fde300bba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3014fd80 0x7fde30146260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde301e80c0 con 0x7fde3014fd80 2023-06-02T15:30:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde30141350 con 0x7fde300a59e0 2023-06-02T15:30:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde300bbfa0 con 0x7fde3006cfc0 2023-06-02T15:30:49.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3014fd80 0x7fde30146260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3014fd80 0x7fde30146260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53496/0 (socket says 172.21.15.78:53496) 2023-06-02T15:30:49.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2ffff640 1 -- 172.21.15.78:0/744236142 learned_addr learned my addr 172.21.15.78:0/744236142 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:49.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde26ffd640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde300a59e0 0x7fde300bba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2f7fe640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fde3006cfc0 0x7fde301e8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2ffff640 1 -- 172.21.15.78:0/744236142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fde3006cfc0 msgr2=0x7fde301e8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2ffff640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fde3006cfc0 0x7fde301e8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2ffff640 1 -- 172.21.15.78:0/744236142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde300a59e0 msgr2=0x7fde300bba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:49.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2ffff640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde300a59e0 0x7fde300bba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:49.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2ffff640 1 -- 172.21.15.78:0/744236142 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde200094d0 con 0x7fde3014fd80 2023-06-02T15:30:49.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde26ffd640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde300a59e0 0x7fde300bba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:49.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2ffff640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3014fd80 0x7fde30146260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fde2800c780 tx=0x7fde2800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2cff9640 1 -- 172.21.15.78:0/744236142 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde28004b70 con 0x7fde3014fd80 2023-06-02T15:30:49.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2cff9640 1 -- 172.21.15.78:0/744236142 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde2800ce90 con 0x7fde3014fd80 2023-06-02T15:30:49.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde2cff9640 1 -- 172.21.15.78:0/744236142 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde2800a850 con 0x7fde3014fd80 2023-06-02T15:30:49.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- 172.21.15.78:0/744236142 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde30149f00 con 0x7fde3014fd80 2023-06-02T15:30:49.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.930+0000 7fde35e66640 1 -- 172.21.15.78:0/744236142 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde30149d70 con 0x7fde3014fd80 2023-06-02T15:30:49.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.934+0000 7fde35e66640 1 -- 172.21.15.78:0/744236142 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde301593f0 con 0x7fde3014fd80 2023-06-02T15:30:49.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.934+0000 7fde2cff9640 1 -- 172.21.15.78:0/744236142 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fde2800a9b0 con 0x7fde3014fd80 2023-06-02T15:30:49.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.934+0000 7fde2cff9640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fde10065c00 0x7fde100680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:49.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.934+0000 7fde2f7fe640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fde10065c00 0x7fde100680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:49.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.934+0000 7fde2cff9640 1 -- 172.21.15.78:0/744236142 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fde280838f0 con 0x7fde3014fd80 2023-06-02T15:30:49.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.934+0000 7fde2f7fe640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fde10065c00 0x7fde100680b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde1800b800 tx=0x7fde18008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:49.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:49.938+0000 7fde2cff9640 1 -- 172.21.15.78:0/744236142 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fde280547d0 con 0x7fde3014fd80 2023-06-02T15:30:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 -- 172.21.15.78:0/744236142 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fde30073bc0 con 0x7fde3014fd80 2023-06-02T15:30:50.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde2cff9640 1 -- 172.21.15.78:0/744236142 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fde28054360 con 0x7fde3014fd80 2023-06-02T15:30:50.110 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-02T15:30:50.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 -- 172.21.15.78:0/744236142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fde10065c00 msgr2=0x7fde100680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fde10065c00 0x7fde100680b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fde1800b800 tx=0x7fde18008040 comp rx=0 tx=0).stop 2023-06-02T15:30:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 -- 172.21.15.78:0/744236142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3014fd80 msgr2=0x7fde30146260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3014fd80 0x7fde30146260 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fde2800c780 tx=0x7fde2800cc40 comp rx=0 tx=0).stop 2023-06-02T15:30:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 -- 172.21.15.78:0/744236142 shutdown_connections 2023-06-02T15:30:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fde10065c00 0x7fde100680b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fde3014fd80 0x7fde30146260 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde300a59e0 0x7fde300bba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 --2- 172.21.15.78:0/744236142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fde3006cfc0 0x7fde301e8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 -- 172.21.15.78:0/744236142 >> 172.21.15.78:0/744236142 conn(0x7fde300a2170 msgr2=0x7fde30144f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 -- 172.21.15.78:0/744236142 shutdown_connections 2023-06-02T15:30:50.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.102+0000 7fde35e66640 1 -- 172.21.15.78:0/744236142 wait complete. 2023-06-02T15:30:50.127 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:30:50.127 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-02T15:30:50.133 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.234+0000 7f8332983640 1 Processor -- start 2023-06-02T15:30:50.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.234+0000 7f8332983640 1 -- start start 2023-06-02T15:30:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8332983640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c14f330 0x7f832c14bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8332983640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c14ba90 con 0x7f832c0bc1c0 2023-06-02T15:30:50.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8332983640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0a47b0 con 0x7f832c0a0020 2023-06-02T15:30:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8332983640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c14f7c0 con 0x7f832c14f330 2023-06-02T15:30:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f832c0bc1c0 0x7f832c0a40a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44850/0 (socket says 172.21.15.78:44850) 2023-06-02T15:30:50.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832bfff640 1 -- 172.21.15.78:0/3266518015 learned_addr learned my addr 172.21.15.78:0/3266518015 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:50.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556160373 0 0) 0x7f832c14ba90 con 0x7f832c0bc1c0 2023-06-02T15:30:50.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8318003530 con 0x7f832c0bc1c0 2023-06-02T15:30:50.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f83237fe640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c14f330 0x7f832c14bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 62347126 0 0) 0x7f8318003530 con 0x7f832c0bc1c0 2023-06-02T15:30:50.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c14f330 msgr2=0x7f832c14bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c14f330 0x7f832c14bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 >> v1:172.21.15.132:6789/0 conn(0x7f832c0a0020 legacy=0x7f832c1487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c14b440 con 0x7f832c0bc1c0 2023-06-02T15:30:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f831c001680 con 0x7f832c0bc1c0 2023-06-02T15:30:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f83237fe640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c14f330 0x7f832c14bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 >> v1:172.21.15.78:6789/0 conn(0x7f832c0bc1c0 legacy=0x7f832c0a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c14f330 0x7f83180039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8318003fa0 0x7f83180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8318004d10 0x7f8318005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c14f7c0 con 0x7f8318004d10 2023-06-02T15:30:50.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f831800de80 con 0x7f8318003fa0 2023-06-02T15:30:50.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f831800e040 con 0x7f832c14f330 2023-06-02T15:30:50.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8330f20640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8318004d10 0x7f8318005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832bfff640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c14f330 0x7f83180039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f83237fe640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8318003fa0 0x7f83180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8330f20640 1 -- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c14f330 msgr2=0x7f83180039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8330f20640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c14f330 0x7f83180039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8330f20640 1 -- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8318003fa0 msgr2=0x7f83180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8330f20640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8318003fa0 0x7f83180047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8330f20640 1 -- 172.21.15.78:0/3266518015 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8318003530 con 0x7f8318004d10 2023-06-02T15:30:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f8330f20640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8318004d10 0x7f8318005180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8324001e40 tx=0x7f832401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6550685b6ee438c server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:50.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324003b80 con 0x7f8318004d10 2023-06-02T15:30:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8324003ce0 con 0x7f8318004d10 2023-06-02T15:30:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.238+0000 7f832b7fe640 1 -- 172.21.15.78:0/3266518015 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324005310 con 0x7f8318004d10 2023-06-02T15:30:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- 172.21.15.78:0/3266518015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8318004d10 msgr2=0x7f8318005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 --2- 172.21.15.78:0/3266518015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8318004d10 0x7f8318005180 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8324001e40 tx=0x7f832401c740 comp rx=0 tx=0).stop 2023-06-02T15:30:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8330f20640 1 -- 172.21.15.78:0/3266518015 reap_dead start 2023-06-02T15:30:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- 172.21.15.78:0/3266518015 shutdown_connections 2023-06-02T15:30:50.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- 172.21.15.78:0/3266518015 >> 172.21.15.78:0/3266518015 conn(0x7f832c0bcf50 msgr2=0x7f832c0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- 172.21.15.78:0/3266518015 shutdown_connections 2023-06-02T15:30:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- 172.21.15.78:0/3266518015 wait complete. 2023-06-02T15:30:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 Processor -- start 2023-06-02T15:30:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- start start 2023-06-02T15:30:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c146a40 0x7f832c0c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f832c0be080 0x7f832c14d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f832c1e2220 0x7f832c142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0beba0 con 0x7f832c1e2220 2023-06-02T15:30:50.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0be6e0 con 0x7f832c0be080 2023-06-02T15:30:50.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0bee80 con 0x7f832c146a40 2023-06-02T15:30:50.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8330f20640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f832c1e2220 0x7f832c142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8330f20640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f832c1e2220 0x7f832c142750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53518/0 (socket says 172.21.15.78:53518) 2023-06-02T15:30:50.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8330f20640 1 -- 172.21.15.78:0/3439153980 learned_addr learned my addr 172.21.15.78:0/3439153980 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:50.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f832bfff640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c146a40 0x7f832c0c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f83237fe640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f832c0be080 0x7f832c14d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8330f20640 1 -- 172.21.15.78:0/3439153980 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c146a40 msgr2=0x7f832c0c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8330f20640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c146a40 0x7f832c0c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8330f20640 1 -- 172.21.15.78:0/3439153980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f832c0be080 msgr2=0x7f832c14d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8330f20640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f832c0be080 0x7f832c14d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8330f20640 1 -- 172.21.15.78:0/3439153980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c0bc720 con 0x7f832c1e2220 2023-06-02T15:30:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8330f20640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f832c1e2220 0x7f832c142750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f832401c570 tx=0x7f8318005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f83297fa640 1 -- 172.21.15.78:0/3439153980 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324003e50 con 0x7f832c1e2220 2023-06-02T15:30:50.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f83297fa640 1 -- 172.21.15.78:0/3439153980 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83240012e0 con 0x7f832c1e2220 2023-06-02T15:30:50.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- 172.21.15.78:0/3439153980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c0bc590 con 0x7f832c1e2220 2023-06-02T15:30:50.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f83297fa640 1 -- 172.21.15.78:0/3439153980 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8324003b80 con 0x7f832c1e2220 2023-06-02T15:30:50.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.242+0000 7f8332983640 1 -- 172.21.15.78:0/3439153980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c0bca00 con 0x7f832c1e2220 2023-06-02T15:30:50.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.246+0000 7f8332983640 1 -- 172.21.15.78:0/3439153980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c073bc0 con 0x7f832c1e2220 2023-06-02T15:30:50.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.246+0000 7f83297fa640 1 -- 172.21.15.78:0/3439153980 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f8324005070 con 0x7f832c1e2220 2023-06-02T15:30:50.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.246+0000 7f83297fa640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f830c065c00 0x7f830c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.246+0000 7f83297fa640 1 -- 172.21.15.78:0/3439153980 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f832411c430 con 0x7f832c1e2220 2023-06-02T15:30:50.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.246+0000 7f832bfff640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f830c065c00 0x7f830c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.246+0000 7f832bfff640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f830c065c00 0x7f830c0680b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f831c0010f0 tx=0x7f831c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:50.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.250+0000 7f83297fa640 1 -- 172.21.15.78:0/3439153980 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f83240e99a0 con 0x7f832c1e2220 2023-06-02T15:30:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.402+0000 7f8332983640 1 -- 172.21.15.78:0/3439153980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f832c0bece0 con 0x7f832c1e2220 2023-06-02T15:30:50.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f83297fa640 1 -- 172.21.15.78:0/3439153980 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f832c0bece0 con 0x7f832c1e2220 2023-06-02T15:30:50.414 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:50.415 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:50.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 -- 172.21.15.78:0/3439153980 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f830c065c00 msgr2=0x7f830c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f830c065c00 0x7f830c0680b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f831c0010f0 tx=0x7f831c009040 comp rx=0 tx=0).stop 2023-06-02T15:30:50.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 -- 172.21.15.78:0/3439153980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f832c1e2220 msgr2=0x7f832c142750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f832c1e2220 0x7f832c142750 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f832401c570 tx=0x7f8318005800 comp rx=0 tx=0).stop 2023-06-02T15:30:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 -- 172.21.15.78:0/3439153980 shutdown_connections 2023-06-02T15:30:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f830c065c00 0x7f830c0680b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f832c1e2220 0x7f832c142750 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f832c0be080 0x7f832c14d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 --2- 172.21.15.78:0/3439153980 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f832c146a40 0x7f832c0c0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 -- 172.21.15.78:0/3439153980 >> 172.21.15.78:0/3439153980 conn(0x7f832c0bcf50 msgr2=0x7f832c14a100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:50.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 -- 172.21.15.78:0/3439153980 shutdown_connections 2023-06-02T15:30:50.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.406+0000 7f8332983640 1 -- 172.21.15.78:0/3439153980 wait complete. 2023-06-02T15:30:50.433 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-02T15:30:31.844882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-02T15:30:33.293644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-02T15:30:36.277798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-02T15:30:37.599884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-02T15:30:40.680165+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-02T15:30:50.433 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-02T15:30:50.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.546+0000 7f638ef8c640 1 Processor -- start 2023-06-02T15:30:50.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.546+0000 7f638ef8c640 1 -- start start 2023-06-02T15:30:50.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638ef8c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f638806bf70 0x7f6388152000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638ef8c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f638814e410 0x7f6388152540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638ef8c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63880bb970 con 0x7f638814ef40 2023-06-02T15:30:50.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638ef8c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6388151ae0 con 0x7f638814e410 2023-06-02T15:30:50.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638ef8c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63880c0a20 con 0x7f638806bf70 2023-06-02T15:30:50.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638d529640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f638814e410 0x7f6388152540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638cd28640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f638814ef40 0x7f63880c0310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44856/0 (socket says 172.21.15.78:44856) 2023-06-02T15:30:50.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638cd28640 1 -- 172.21.15.78:0/2020495291 learned_addr learned my addr 172.21.15.78:0/2020495291 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:50.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f6387fff640 1 --2- 172.21.15.78:0/2020495291 >> v2:172.21.15.132:3300/0 conn(0x7f638806bf70 0x7f6388152000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638d529640 1 -- 172.21.15.78:0/2020495291 >> v2:172.21.15.132:3300/0 conn(0x7f638806bf70 msgr2=0x7f6388152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:50.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638d529640 1 --2- 172.21.15.78:0/2020495291 >> v2:172.21.15.132:3300/0 conn(0x7f638806bf70 0x7f6388152000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638d529640 1 -- 172.21.15.78:0/2020495291 >> v1:172.21.15.78:6789/0 conn(0x7f638814ef40 legacy=0x7f63880c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638d529640 1 -- 172.21.15.78:0/2020495291 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880bbc50 con 0x7f638814e410 2023-06-02T15:30:50.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f63877fe640 1 -- 172.21.15.78:0/2020495291 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108027687 0 0) 0x7f63880bb970 con 0x7f638814ef40 2023-06-02T15:30:50.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f638d529640 1 --2- 172.21.15.78:0/2020495291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 0x7f6388152540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f638806e640 tx=0x7f638001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7f2f6148066acb server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:50.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f63877fe640 1 -- 172.21.15.78:0/2020495291 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63800a5910 con 0x7f638814e410 2023-06-02T15:30:50.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f63877fe640 1 -- 172.21.15.78:0/2020495291 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63800a5a70 con 0x7f638814e410 2023-06-02T15:30:50.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.550+0000 7f63877fe640 1 -- 172.21.15.78:0/2020495291 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63800a5e00 con 0x7f638814e410 2023-06-02T15:30:50.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- 172.21.15.78:0/2020495291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 msgr2=0x7f6388152540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 --2- 172.21.15.78:0/2020495291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 0x7f6388152540 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f638806e640 tx=0x7f638001c910 comp rx=0 tx=0).stop 2023-06-02T15:30:50.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- 172.21.15.78:0/2020495291 shutdown_connections 2023-06-02T15:30:50.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 --2- 172.21.15.78:0/2020495291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 0x7f6388152540 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 --2- 172.21.15.78:0/2020495291 >> v2:172.21.15.132:3300/0 conn(0x7f638806bf70 0x7f6388152000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- 172.21.15.78:0/2020495291 >> 172.21.15.78:0/2020495291 conn(0x7f63880a2170 msgr2=0x7f63880a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:50.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- 172.21.15.78:0/2020495291 shutdown_connections 2023-06-02T15:30:50.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- 172.21.15.78:0/2020495291 wait complete. 2023-06-02T15:30:50.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 Processor -- start 2023-06-02T15:30:50.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- start start 2023-06-02T15:30:50.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f638806bf70 0x7f638814d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 0x7f6388144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f638814ef40 0x7f6388144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63880a3a70 con 0x7f638814e410 2023-06-02T15:30:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f638814dec0 con 0x7f638806bf70 2023-06-02T15:30:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6388146d50 con 0x7f638814ef40 2023-06-02T15:30:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f6387fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 0x7f6388144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f6387fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 0x7f6388144920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53536/0 (socket says 172.21.15.78:53536) 2023-06-02T15:30:50.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f6387fff640 1 -- 172.21.15.78:0/3803468234 learned_addr learned my addr 172.21.15.78:0/3803468234 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638cd28640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f638806bf70 0x7f638814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638d529640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f638814ef40 0x7f6388144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f6387fff640 1 -- 172.21.15.78:0/3803468234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f638814ef40 msgr2=0x7f6388144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f6387fff640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f638814ef40 0x7f6388144e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f6387fff640 1 -- 172.21.15.78:0/3803468234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f638806bf70 msgr2=0x7f638814d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f6387fff640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f638806bf70 0x7f638814d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f6387fff640 1 -- 172.21.15.78:0/3803468234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6380009a70 con 0x7f638814e410 2023-06-02T15:30:50.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638cd28640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f638806bf70 0x7f638814d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f6387fff640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 0x7f6388144920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f637c00d800 tx=0x7f637c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f63857fa640 1 -- 172.21.15.78:0/3803468234 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c00b6c0 con 0x7f638814e410 2023-06-02T15:30:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f63857fa640 1 -- 172.21.15.78:0/3803468234 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637c00b820 con 0x7f638814e410 2023-06-02T15:30:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- 172.21.15.78:0/3803468234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638815b780 con 0x7f638814e410 2023-06-02T15:30:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f63857fa640 1 -- 172.21.15.78:0/3803468234 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637c00bb90 con 0x7f638814e410 2023-06-02T15:30:50.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.554+0000 7f638ef8c640 1 -- 172.21.15.78:0/3803468234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638815b5f0 con 0x7f638814e410 2023-06-02T15:30:50.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.558+0000 7f638ef8c640 1 -- 172.21.15.78:0/3803468234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f638815b910 con 0x7f638814e410 2023-06-02T15:30:50.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.558+0000 7f63857fa640 1 -- 172.21.15.78:0/3803468234 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f637c00bcf0 con 0x7f638814e410 2023-06-02T15:30:50.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.558+0000 7f63857fa640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6374065c30 0x7f63740680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.558+0000 7f63857fa640 1 -- 172.21.15.78:0/3803468234 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f637c083b40 con 0x7f638814e410 2023-06-02T15:30:50.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.558+0000 7f638cd28640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6374065c30 0x7f63740680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.558+0000 7f638cd28640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6374065c30 0x7f63740680e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6378007fd0 tx=0x7f6378009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:50.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.562+0000 7f63857fa640 1 -- 172.21.15.78:0/3803468234 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f637c054b40 con 0x7f638814e410 2023-06-02T15:30:50.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.706+0000 7f638ef8c640 1 -- 172.21.15.78:0/3803468234 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6388073bc0 con 0x7f638814e410 2023-06-02T15:30:50.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.706+0000 7f63857fa640 1 -- 172.21.15.78:0/3803468234 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f637c0546d0 con 0x7f638814e410 2023-06-02T15:30:50.714 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-02T15:30:50.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 -- 172.21.15.78:0/3803468234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6374065c30 msgr2=0x7f63740680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6374065c30 0x7f63740680e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6378007fd0 tx=0x7f6378009040 comp rx=0 tx=0).stop 2023-06-02T15:30:50.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 -- 172.21.15.78:0/3803468234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 msgr2=0x7f6388144920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 0x7f6388144920 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f637c00d800 tx=0x7f637c00dcc0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 -- 172.21.15.78:0/3803468234 shutdown_connections 2023-06-02T15:30:50.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f638814ef40 0x7f6388144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6374065c30 0x7f63740680e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f638814e410 0x7f6388144920 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 --2- 172.21.15.78:0/3803468234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f638806bf70 0x7f638814d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 -- 172.21.15.78:0/3803468234 >> 172.21.15.78:0/3803468234 conn(0x7f63880a2170 msgr2=0x7f63880be8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:50.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 -- 172.21.15.78:0/3803468234 shutdown_connections 2023-06-02T15:30:50.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.710+0000 7f638ef8c640 1 -- 172.21.15.78:0/3803468234 wait complete. 2023-06-02T15:30:50.733 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-02T15:30:50.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd38223a640 1 Processor -- start 2023-06-02T15:30:50.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd38223a640 1 -- start start 2023-06-02T15:30:50.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd38223a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd37c14bcc0 0x7fd37c0698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd38223a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c06cf80 con 0x7fd37c0bd3a0 2023-06-02T15:30:50.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd38223a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c06d1d0 con 0x7fd37c069e30 2023-06-02T15:30:50.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd38223a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0c0670 con 0x7fd37c14bcc0 2023-06-02T15:30:50.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37affd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd37c0bd3a0 0x7fd37c14e6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44868/0 (socket says 172.21.15.78:44868) 2023-06-02T15:30:50.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37affd640 1 -- 172.21.15.78:0/4277671808 learned_addr learned my addr 172.21.15.78:0/4277671808 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:50.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666133686 0 0) 0x7fd37c06cf80 con 0x7fd37c0bd3a0 2023-06-02T15:30:50.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd364003530 con 0x7fd37c0bd3a0 2023-06-02T15:30:50.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37b7fe640 1 --2- 172.21.15.78:0/4277671808 >> v2:172.21.15.132:3300/0 conn(0x7fd37c14bcc0 0x7fd37c0698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3844979950 0 0) 0x7fd364003530 con 0x7fd37c0bd3a0 2023-06-02T15:30:50.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 >> v2:172.21.15.132:3300/0 conn(0x7fd37c14bcc0 msgr2=0x7fd37c0698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:50.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 --2- 172.21.15.78:0/4277671808 >> v2:172.21.15.132:3300/0 conn(0x7fd37c14bcc0 0x7fd37c0698f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 >> v1:172.21.15.132:6789/0 conn(0x7fd37c069e30 legacy=0x7fd37c158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0c0100 con 0x7fd37c0bd3a0 2023-06-02T15:30:50.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fd370001680 con 0x7fd37c0bd3a0 2023-06-02T15:30:50.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 >> v1:172.21.15.78:6789/0 conn(0x7fd37c0bd3a0 legacy=0x7fd37c14e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd364003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3640047d0 0x7fd364004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd364005180 0x7fd36400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0c0670 con 0x7fd3640039f0 2023-06-02T15:30:50.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36400c070 con 0x7fd3640047d0 2023-06-02T15:30:50.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36400c230 con 0x7fd364005180 2023-06-02T15:30:50.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37b7fe640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd364003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37bfff640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd364005180 0x7fd36400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37b7fe640 1 -- 172.21.15.78:0/4277671808 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd364005180 msgr2=0x7fd36400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:50.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37b7fe640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd364005180 0x7fd36400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37b7fe640 1 -- 172.21.15.78:0/4277671808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3640047d0 msgr2=0x7fd364004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:50.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37b7fe640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3640047d0 0x7fd364004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37b7fe640 1 -- 172.21.15.78:0/4277671808 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364003530 con 0x7fd3640039f0 2023-06-02T15:30:50.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37bfff640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd364005180 0x7fd36400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:50.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.842+0000 7fd37bfff640 1 -- 172.21.15.78:0/4277671808 reap_dead start 2023-06-02T15:30:50.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd37b7fe640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd364003e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009ae0 tx=0x7fd36c01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d96f3360c4971f server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:50.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0a5640 con 0x7fd3640039f0 2023-06-02T15:30:50.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c0a57a0 con 0x7fd3640039f0 2023-06-02T15:30:50.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd37a7fc640 1 -- 172.21.15.78:0/4277671808 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0a5b50 con 0x7fd3640039f0 2023-06-02T15:30:50.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 -- 172.21.15.78:0/4277671808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 msgr2=0x7fd364003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd364003e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd36c009ae0 tx=0x7fd36c01ca50 comp rx=0 tx=0).stop 2023-06-02T15:30:50.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 -- 172.21.15.78:0/4277671808 shutdown_connections 2023-06-02T15:30:50.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 --2- 172.21.15.78:0/4277671808 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd364003e00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 -- 172.21.15.78:0/4277671808 >> 172.21.15.78:0/4277671808 conn(0x7fd37c0a3180 msgr2=0x7fd37c0a3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:50.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 -- 172.21.15.78:0/4277671808 shutdown_connections 2023-06-02T15:30:50.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 -- 172.21.15.78:0/4277671808 wait complete. 2023-06-02T15:30:50.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 Processor -- start 2023-06-02T15:30:50.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 -- start start 2023-06-02T15:30:50.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd37c14d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd37c0a71a0 0x7fd37c1e3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c0b7c40 0x7fd37c14e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c14db10 con 0x7fd3640039f0 2023-06-02T15:30:50.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0a5cd0 con 0x7fd37c0b7c40 2023-06-02T15:30:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd38223a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1e4870 con 0x7fd37c0a71a0 2023-06-02T15:30:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd37b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd37c14d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd37b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd37c14d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53560/0 (socket says 172.21.15.78:53560) 2023-06-02T15:30:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd37b7fe640 1 -- 172.21.15.78:0/4240654200 learned_addr learned my addr 172.21.15.78:0/4240654200 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd37affd640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd37c0a71a0 0x7fd37c1e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.846+0000 7fd37bfff640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c0b7c40 0x7fd37c14e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd37b7fe640 1 -- 172.21.15.78:0/4240654200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd37c0a71a0 msgr2=0x7fd37c1e3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd37b7fe640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd37c0a71a0 0x7fd37c1e3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd37b7fe640 1 -- 172.21.15.78:0/4240654200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c0b7c40 msgr2=0x7fd37c14e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd37b7fe640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c0b7c40 0x7fd37c14e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd37b7fe640 1 -- 172.21.15.78:0/4240654200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c14c090 con 0x7fd3640039f0 2023-06-02T15:30:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd37affd640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd37c0a71a0 0x7fd37c1e3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd37bfff640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c0b7c40 0x7fd37c14e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd37b7fe640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd37c14d5d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd36c01c880 tx=0x7fd36c0197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:50.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd363fff640 1 -- 172.21.15.78:0/4240654200 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c004220 con 0x7fd3640039f0 2023-06-02T15:30:50.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd363fff640 1 -- 172.21.15.78:0/4240654200 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c0043a0 con 0x7fd3640039f0 2023-06-02T15:30:50.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd363fff640 1 -- 172.21.15.78:0/4240654200 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c004510 con 0x7fd3640039f0 2023-06-02T15:30:50.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd38223a640 1 -- 172.21.15.78:0/4240654200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c0bfdd0 con 0x7fd3640039f0 2023-06-02T15:30:50.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd38223a640 1 -- 172.21.15.78:0/4240654200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c06dbd0 con 0x7fd3640039f0 2023-06-02T15:30:50.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd38223a640 1 -- 172.21.15.78:0/4240654200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c1e3e30 con 0x7fd3640039f0 2023-06-02T15:30:50.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd363fff640 1 -- 172.21.15.78:0/4240654200 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fd36c0b4070 con 0x7fd3640039f0 2023-06-02T15:30:50.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd363fff640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd368065c30 0x7fd3680680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:50.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd37affd640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd368065c30 0x7fd3680680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:50.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd363fff640 1 -- 172.21.15.78:0/4240654200 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd36c11d3e0 con 0x7fd3640039f0 2023-06-02T15:30:50.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.850+0000 7fd37affd640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd368065c30 0x7fd3680680e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd370004880 tx=0x7fd37000c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:50.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.854+0000 7fd363fff640 1 -- 172.21.15.78:0/4240654200 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fd37c1e3e30 con 0x7fd3640039f0 2023-06-02T15:30:51.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.994+0000 7fd38223a640 1 -- 172.21.15.78:0/4240654200 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd37c1e3e30 con 0x7fd3640039f0 2023-06-02T15:30:51.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.994+0000 7fd363fff640 1 -- 172.21.15.78:0/4240654200 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd37c1e3e30 con 0x7fd3640039f0 2023-06-02T15:30:51.004 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-02T15:30:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 -- 172.21.15.78:0/4240654200 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd368065c30 msgr2=0x7fd3680680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd368065c30 0x7fd3680680e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd370004880 tx=0x7fd37000c040 comp rx=0 tx=0).stop 2023-06-02T15:30:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 -- 172.21.15.78:0/4240654200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 msgr2=0x7fd37c14d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd37c14d5d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd36c01c880 tx=0x7fd36c0197f0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 -- 172.21.15.78:0/4240654200 shutdown_connections 2023-06-02T15:30:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c0b7c40 0x7fd37c14e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd37c0a71a0 0x7fd37c1e3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd368065c30 0x7fd3680680e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 --2- 172.21.15.78:0/4240654200 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3640039f0 0x7fd37c14d5d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 -- 172.21.15.78:0/4240654200 >> 172.21.15.78:0/4240654200 conn(0x7fd37c0a3180 msgr2=0x7fd37c149ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 -- 172.21.15.78:0/4240654200 shutdown_connections 2023-06-02T15:30:51.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:50.998+0000 7fd38223a640 1 -- 172.21.15.78:0/4240654200 wait complete. 2023-06-02T15:30:51.021 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-02T15:30:51.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.134+0000 7f427726a640 1 Processor -- start 2023-06-02T15:30:51.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f427726a640 1 -- start start 2023-06-02T15:30:51.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f427726a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42700a59e0 0x7f42700718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f427726a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f427006cfc0 0x7f427014f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f427726a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427014d220 con 0x7f427014fd80 2023-06-02T15:30:51.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f427726a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42700ba640 con 0x7f427006cfc0 2023-06-02T15:30:51.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f427726a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427014cd30 con 0x7f42700a59e0 2023-06-02T15:30:51.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f4274805640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f427006cfc0 0x7f427014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f4274805640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f427006cfc0 0x7f427014f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53570/0 (socket says 172.21.15.78:53570) 2023-06-02T15:30:51.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f4274805640 1 -- 172.21.15.78:0/1235752717 learned_addr learned my addr 172.21.15.78:0/1235752717 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:51.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f4275006640 1 --2- 172.21.15.78:0/1235752717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42700a59e0 0x7f42700718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f4274805640 1 -- 172.21.15.78:0/1235752717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42700a59e0 msgr2=0x7f42700718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:51.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f4274805640 1 --2- 172.21.15.78:0/1235752717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42700a59e0 0x7f42700718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f4274805640 1 -- 172.21.15.78:0/1235752717 >> v1:172.21.15.132:6789/0 conn(0x7f427014fd80 legacy=0x7f4270149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:51.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f4274805640 1 -- 172.21.15.78:0/1235752717 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42700ba850 con 0x7f427006cfc0 2023-06-02T15:30:51.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f4274805640 1 --2- 172.21.15.78:0/1235752717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427006cfc0 0x7f427014f840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4264009870 tx=0x7f426401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f9fcd174a3b321 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:51.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f426ffff640 1 -- 172.21.15.78:0/1235752717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640ab620 con 0x7f427006cfc0 2023-06-02T15:30:51.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f426ffff640 1 -- 172.21.15.78:0/1235752717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42640ab780 con 0x7f427006cfc0 2023-06-02T15:30:51.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.138+0000 7f426ffff640 1 -- 172.21.15.78:0/1235752717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42640abb10 con 0x7f427006cfc0 2023-06-02T15:30:51.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- 172.21.15.78:0/1235752717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427006cfc0 msgr2=0x7f427014f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 --2- 172.21.15.78:0/1235752717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427006cfc0 0x7f427014f840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4264009870 tx=0x7f426401c440 comp rx=0 tx=0).stop 2023-06-02T15:30:51.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- 172.21.15.78:0/1235752717 shutdown_connections 2023-06-02T15:30:51.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 --2- 172.21.15.78:0/1235752717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427006cfc0 0x7f427014f840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 --2- 172.21.15.78:0/1235752717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f42700a59e0 0x7f42700718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- 172.21.15.78:0/1235752717 >> 172.21.15.78:0/1235752717 conn(0x7f42700a2170 msgr2=0x7f42700a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:51.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- 172.21.15.78:0/1235752717 shutdown_connections 2023-06-02T15:30:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- 172.21.15.78:0/1235752717 wait complete. 2023-06-02T15:30:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 Processor -- start 2023-06-02T15:30:51.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- start start 2023-06-02T15:30:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f427006cfc0 0x7f42700b9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42700a59e0 0x7f42700a4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427014fd80 0x7f42700a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270142c60 con 0x7f427014fd80 2023-06-02T15:30:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270142fb0 con 0x7f42700a59e0 2023-06-02T15:30:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42701e6a60 con 0x7f427006cfc0 2023-06-02T15:30:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4275807640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427014fd80 0x7f42700a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4275807640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427014fd80 0x7f42700a4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53580/0 (socket says 172.21.15.78:53580) 2023-06-02T15:30:51.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4275807640 1 -- 172.21.15.78:0/2070321857 learned_addr learned my addr 172.21.15.78:0/2070321857 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4274805640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42700a59e0 0x7f42700a4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4275006640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f427006cfc0 0x7f42700b9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4275807640 1 -- 172.21.15.78:0/2070321857 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f427006cfc0 msgr2=0x7f42700b9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4275807640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f427006cfc0 0x7f42700b9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4275807640 1 -- 172.21.15.78:0/2070321857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42700a59e0 msgr2=0x7f42700a4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4275807640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42700a59e0 0x7f42700a4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4275807640 1 -- 172.21.15.78:0/2070321857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640094d0 con 0x7f427014fd80 2023-06-02T15:30:51.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f4275807640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427014fd80 0x7f42700a4ac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f426000c3f0 tx=0x7f426000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f426dffb640 1 -- 172.21.15.78:0/2070321857 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260011790 con 0x7f427014fd80 2023-06-02T15:30:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f426dffb640 1 -- 172.21.15.78:0/2070321857 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42600118f0 con 0x7f427014fd80 2023-06-02T15:30:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- 172.21.15.78:0/2070321857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4270149f00 con 0x7f427014fd80 2023-06-02T15:30:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f426dffb640 1 -- 172.21.15.78:0/2070321857 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260011ca0 con 0x7f427014fd80 2023-06-02T15:30:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.142+0000 7f427726a640 1 -- 172.21.15.78:0/2070321857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4270149d70 con 0x7f427014fd80 2023-06-02T15:30:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.146+0000 7f427726a640 1 -- 172.21.15.78:0/2070321857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42701593f0 con 0x7f427014fd80 2023-06-02T15:30:51.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.146+0000 7f426dffb640 1 -- 172.21.15.78:0/2070321857 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f426001c460 con 0x7f427014fd80 2023-06-02T15:30:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.146+0000 7f426dffb640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f425c065c30 0x7f425c0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.146+0000 7f426dffb640 1 -- 172.21.15.78:0/2070321857 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f42600833d0 con 0x7f427014fd80 2023-06-02T15:30:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.146+0000 7f4275006640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f425c065c30 0x7f425c0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.146+0000 7f4275006640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f425c065c30 0x7f425c0680e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4268003fd0 tx=0x7f42680039a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:51.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.150+0000 7f426dffb640 1 -- 172.21.15.78:0/2070321857 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f42600543d0 con 0x7f427014fd80 2023-06-02T15:30:51.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.302+0000 7f427726a640 1 -- 172.21.15.78:0/2070321857 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f42701ea060 con 0x7f427014fd80 2023-06-02T15:30:51.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f426dffb640 1 -- 172.21.15.78:0/2070321857 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4260003810 con 0x7f427014fd80 2023-06-02T15:30:51.313 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:30:51.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 -- 172.21.15.78:0/2070321857 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f425c065c30 msgr2=0x7f425c0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f425c065c30 0x7f425c0680e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4268003fd0 tx=0x7f42680039a0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 -- 172.21.15.78:0/2070321857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427014fd80 msgr2=0x7f42700a4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427014fd80 0x7f42700a4ac0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f426000c3f0 tx=0x7f426000c8b0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 -- 172.21.15.78:0/2070321857 shutdown_connections 2023-06-02T15:30:51.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f425c065c30 0x7f425c0680e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f427014fd80 0x7f42700a4ac0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42700a59e0 0x7f42700a4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 --2- 172.21.15.78:0/2070321857 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f427006cfc0 0x7f42700b9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 -- 172.21.15.78:0/2070321857 >> 172.21.15.78:0/2070321857 conn(0x7f42700a2170 msgr2=0x7f4270142130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:51.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 -- 172.21.15.78:0/2070321857 shutdown_connections 2023-06-02T15:30:51.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.306+0000 7f427726a640 1 -- 172.21.15.78:0/2070321857 wait complete. 2023-06-02T15:30:51.332 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-02T15:30:51.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.446+0000 7fecf31b8640 1 Processor -- start 2023-06-02T15:30:51.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.446+0000 7fecf31b8640 1 -- start start 2023-06-02T15:30:51.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf31b8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fecec06cfc0 0x7fecec0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf31b8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec06c250 0x7fecec149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf31b8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec14d220 con 0x7fecec0a59e0 2023-06-02T15:30:51.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf31b8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0ba640 con 0x7fecec06cfc0 2023-06-02T15:30:51.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf31b8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec14cd30 con 0x7fecec06c250 2023-06-02T15:30:51.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf1755640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec06c250 0x7fecec149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecebfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fecec06cfc0 0x7fecec0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf0f54640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fecec0a59e0 0x7fecec14f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:56854/0 (socket says 172.21.15.78:56854) 2023-06-02T15:30:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf1755640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec06c250 0x7fecec149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:43252/0 (socket says 172.21.15.78:43252) 2023-06-02T15:30:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf0f54640 1 -- 172.21.15.78:0/3868733142 learned_addr learned my addr 172.21.15.78:0/3868733142 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf1755640 1 -- 172.21.15.78:0/3868733142 >> v2:172.21.15.132:3300/0 conn(0x7fecec06cfc0 msgr2=0x7fecec0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf1755640 1 --2- 172.21.15.78:0/3868733142 >> v2:172.21.15.132:3300/0 conn(0x7fecec06cfc0 0x7fecec0718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf1755640 1 -- 172.21.15.78:0/3868733142 >> v1:172.21.15.132:6789/0 conn(0x7fecec0a59e0 legacy=0x7fecec14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf1755640 1 -- 172.21.15.78:0/3868733142 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec0ba850 con 0x7fecec06c250 2023-06-02T15:30:51.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.450+0000 7fecf1755640 1 --2- 172.21.15.78:0/3868733142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec06c250 0x7fecec149660 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fece4009d90 tx=0x7fece401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1667765feb7bb062 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7feceb7fe640 1 -- 172.21.15.78:0/3868733142 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40a5860 con 0x7fecec06c250 2023-06-02T15:30:51.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7feceb7fe640 1 -- 172.21.15.78:0/3868733142 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece40a59c0 con 0x7fecec06c250 2023-06-02T15:30:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7feceb7fe640 1 -- 172.21.15.78:0/3868733142 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece40a5d50 con 0x7fecec06c250 2023-06-02T15:30:51.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 -- 172.21.15.78:0/3868733142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec06c250 msgr2=0x7fecec149660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 --2- 172.21.15.78:0/3868733142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec06c250 0x7fecec149660 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fece4009d90 tx=0x7fece401c890 comp rx=0 tx=0).stop 2023-06-02T15:30:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 -- 172.21.15.78:0/3868733142 shutdown_connections 2023-06-02T15:30:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 --2- 172.21.15.78:0/3868733142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec06c250 0x7fecec149660 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 --2- 172.21.15.78:0/3868733142 >> v2:172.21.15.132:3300/0 conn(0x7fecec06cfc0 0x7fecec0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 -- 172.21.15.78:0/3868733142 >> 172.21.15.78:0/3868733142 conn(0x7fecec0a2170 msgr2=0x7fecec0a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 -- 172.21.15.78:0/3868733142 shutdown_connections 2023-06-02T15:30:51.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 -- 172.21.15.78:0/3868733142 wait complete. 2023-06-02T15:30:51.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 Processor -- start 2023-06-02T15:30:51.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 -- start start 2023-06-02T15:30:51.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecec06c250 0x7fecec0c0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecec06cfc0 0x7fecec14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec0a59e0 0x7fecec1e4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec14fac0 con 0x7fecec06c250 2023-06-02T15:30:51.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec1e8460 con 0x7fecec06cfc0 2023-06-02T15:30:51.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf31b8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec143ac0 con 0x7fecec0a59e0 2023-06-02T15:30:51.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf0f54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecec06c250 0x7fecec0c0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf0f54640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecec06c250 0x7fecec0c0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53590/0 (socket says 172.21.15.78:53590) 2023-06-02T15:30:51.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf0f54640 1 -- 172.21.15.78:0/2534566227 learned_addr learned my addr 172.21.15.78:0/2534566227 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:51.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf1755640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec0a59e0 0x7fecec1e4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecebfff640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecec06cfc0 0x7fecec14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf0f54640 1 -- 172.21.15.78:0/2534566227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec0a59e0 msgr2=0x7fecec1e4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf0f54640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec0a59e0 0x7fecec1e4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf0f54640 1 -- 172.21.15.78:0/2534566227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecec06cfc0 msgr2=0x7fecec14f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf0f54640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecec06cfc0 0x7fecec14f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf0f54640 1 -- 172.21.15.78:0/2534566227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece4009a70 con 0x7fecec06c250 2023-06-02T15:30:51.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecebfff640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecec06cfc0 0x7fecec14f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:51.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf1755640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec0a59e0 0x7fecec1e4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:51.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.454+0000 7fecf0f54640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecec06c250 0x7fecec0c0780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00c420 tx=0x7fecdc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:51.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fece97fa640 1 -- 172.21.15.78:0/2534566227 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc005cf0 con 0x7fecec06c250 2023-06-02T15:30:51.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fece97fa640 1 -- 172.21.15.78:0/2534566227 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc005e50 con 0x7fecec06c250 2023-06-02T15:30:51.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fecf31b8640 1 -- 172.21.15.78:0/2534566227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecec0a5f40 con 0x7fecec06c250 2023-06-02T15:30:51.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fece97fa640 1 -- 172.21.15.78:0/2534566227 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0072f0 con 0x7fecec06c250 2023-06-02T15:30:51.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fecf31b8640 1 -- 172.21.15.78:0/2534566227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec0a5db0 con 0x7fecec06c250 2023-06-02T15:30:51.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fecf31b8640 1 -- 172.21.15.78:0/2534566227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec1593f0 con 0x7fecec06c250 2023-06-02T15:30:51.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fece97fa640 1 -- 172.21.15.78:0/2534566227 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fecdc007450 con 0x7fecec06c250 2023-06-02T15:30:51.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fece97fa640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fecd8065c00 0x7fecd80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fece97fa640 1 -- 172.21.15.78:0/2534566227 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fecdc082c20 con 0x7fecec06c250 2023-06-02T15:30:51.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fecebfff640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fecd8065c00 0x7fecd80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.458+0000 7fecebfff640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fecd8065c00 0x7fecd80680b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fecec071b10 tx=0x7fece0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:51.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.462+0000 7fece97fa640 1 -- 172.21.15.78:0/2534566227 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fecdc050100 con 0x7fecec06c250 2023-06-02T15:30:51.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.614+0000 7fecf31b8640 1 -- 172.21.15.78:0/2534566227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fecec073bc0 con 0x7fecec06c250 2023-06-02T15:30:51.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.614+0000 7fece97fa640 1 -- 172.21.15.78:0/2534566227 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fecdc017020 con 0x7fecec06c250 2023-06-02T15:30:51.623 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-02T15:30:51.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.614+0000 7fecf31b8640 1 -- 172.21.15.78:0/2534566227 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fecd8065c00 msgr2=0x7fecd80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.614+0000 7fecf31b8640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fecd8065c00 0x7fecd80680b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fecec071b10 tx=0x7fece0008040 comp rx=0 tx=0).stop 2023-06-02T15:30:51.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.614+0000 7fecf31b8640 1 -- 172.21.15.78:0/2534566227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecec06c250 msgr2=0x7fecec0c0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.614+0000 7fecf31b8640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecec06c250 0x7fecec0c0780 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fecdc00c420 tx=0x7fecdc00c8e0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.618+0000 7fecf31b8640 1 -- 172.21.15.78:0/2534566227 shutdown_connections 2023-06-02T15:30:51.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.618+0000 7fecf31b8640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fecec0a59e0 0x7fecec1e4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.618+0000 7fecf31b8640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecec06cfc0 0x7fecec14f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.618+0000 7fecf31b8640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fecd8065c00 0x7fecd80680b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.618+0000 7fecf31b8640 1 --2- 172.21.15.78:0/2534566227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecec06c250 0x7fecec0c0780 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.618+0000 7fecf31b8640 1 -- 172.21.15.78:0/2534566227 >> 172.21.15.78:0/2534566227 conn(0x7fecec0a2170 msgr2=0x7fecec14bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:51.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.618+0000 7fecf31b8640 1 -- 172.21.15.78:0/2534566227 shutdown_connections 2023-06-02T15:30:51.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.618+0000 7fecf31b8640 1 -- 172.21.15.78:0/2534566227 wait complete. 2023-06-02T15:30:51.642 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-02T15:30:51.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.758+0000 7efed2886640 1 Processor -- start 2023-06-02T15:30:51.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.758+0000 7efed2886640 1 -- start start 2023-06-02T15:30:51.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efecc0a4700 0x7efecc06c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efecc0a4c50 0x7efecc14ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc14c000 con 0x7efecc06bee0 2023-06-02T15:30:51.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0a5020 con 0x7efecc0a4700 2023-06-02T15:30:51.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc06f150 con 0x7efecc0a4c50 2023-06-02T15:30:51.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efecc0a4700 0x7efecc06c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecbfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efecc06bee0 0x7efecc14e550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44878/0 (socket says 172.21.15.78:44878) 2023-06-02T15:30:51.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecbfff640 1 -- 172.21.15.78:0/278243072 learned_addr learned my addr 172.21.15.78:0/278243072 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:51.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed0e23640 1 --2- 172.21.15.78:0/278243072 >> v2:172.21.15.132:3300/0 conn(0x7efecc0a4c50 0x7efecc14ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecb7fe640 1 -- 172.21.15.78:0/278243072 >> v2:172.21.15.132:3300/0 conn(0x7efecc0a4c50 msgr2=0x7efecc14ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:51.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecb7fe640 1 --2- 172.21.15.78:0/278243072 >> v2:172.21.15.132:3300/0 conn(0x7efecc0a4c50 0x7efecc14ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecb7fe640 1 -- 172.21.15.78:0/278243072 >> v1:172.21.15.78:6789/0 conn(0x7efecc06bee0 legacy=0x7efecc14e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecaffd640 1 -- 172.21.15.78:0/278243072 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 199100447 0 0) 0x7efecc14c000 con 0x7efecc06bee0 2023-06-02T15:30:51.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecb7fe640 1 -- 172.21.15.78:0/278243072 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc1527b0 con 0x7efecc0a4700 2023-06-02T15:30:51.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed0e23640 1 --2- 172.21.15.78:0/278243072 >> v2:172.21.15.132:3300/0 conn(0x7efecc0a4c50 0x7efecc14ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:51.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecb7fe640 1 --2- 172.21.15.78:0/278243072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4700 0x7efecc06c2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efecc06a5b0 tx=0x7efeb401ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc42a1a643fe600d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:51.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecaffd640 1 -- 172.21.15.78:0/278243072 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40a8950 con 0x7efecc0a4700 2023-06-02T15:30:51.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecaffd640 1 -- 172.21.15.78:0/278243072 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb40a8ab0 con 0x7efecc0a4700 2023-06-02T15:30:51.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efecaffd640 1 -- 172.21.15.78:0/278243072 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40a8e40 con 0x7efecc0a4700 2023-06-02T15:30:51.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 -- 172.21.15.78:0/278243072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4700 msgr2=0x7efecc06c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 --2- 172.21.15.78:0/278243072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4700 0x7efecc06c2b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efecc06a5b0 tx=0x7efeb401ec50 comp rx=0 tx=0).stop 2023-06-02T15:30:51.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 -- 172.21.15.78:0/278243072 shutdown_connections 2023-06-02T15:30:51.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 --2- 172.21.15.78:0/278243072 >> v2:172.21.15.132:3300/0 conn(0x7efecc0a4c50 0x7efecc14ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 --2- 172.21.15.78:0/278243072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4700 0x7efecc06c2b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 -- 172.21.15.78:0/278243072 >> 172.21.15.78:0/278243072 conn(0x7efecc0698f0 msgr2=0x7efecc069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:51.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 -- 172.21.15.78:0/278243072 shutdown_connections 2023-06-02T15:30:51.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.762+0000 7efed2886640 1 -- 172.21.15.78:0/278243072 wait complete. 2023-06-02T15:30:51.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 Processor -- start 2023-06-02T15:30:51.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 -- start start 2023-06-02T15:30:51.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efecc06bee0 0x7efecc14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0a4700 0x7efecc0a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4c50 0x7efecc0a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0bb2b0 con 0x7efecc0a4c50 2023-06-02T15:30:51.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc14dbb0 con 0x7efecc0a4700 2023-06-02T15:30:51.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc0bb830 con 0x7efecc06bee0 2023-06-02T15:30:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed0e23640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4c50 0x7efecc0a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed0e23640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4c50 0x7efecc0a7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53618/0 (socket says 172.21.15.78:53618) 2023-06-02T15:30:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed0e23640 1 -- 172.21.15.78:0/1873767977 learned_addr learned my addr 172.21.15.78:0/1873767977 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efecb7fe640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0a4700 0x7efecc0a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efecbfff640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efecc06bee0 0x7efecc14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed0e23640 1 -- 172.21.15.78:0/1873767977 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efecc06bee0 msgr2=0x7efecc14d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed0e23640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efecc06bee0 0x7efecc14d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed0e23640 1 -- 172.21.15.78:0/1873767977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0a4700 msgr2=0x7efecc0a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed0e23640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0a4700 0x7efecc0a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed0e23640 1 -- 172.21.15.78:0/1873767977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb4009420 con 0x7efecc0a4c50 2023-06-02T15:30:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efecb7fe640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0a4700 0x7efecc0a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed0e23640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4c50 0x7efecc0a7ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c7f0 tx=0x7efebc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efec8ff9640 1 -- 172.21.15.78:0/1873767977 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc004230 con 0x7efecc0a4c50 2023-06-02T15:30:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efec8ff9640 1 -- 172.21.15.78:0/1873767977 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc0043b0 con 0x7efecc0a4c50 2023-06-02T15:30:51.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 -- 172.21.15.78:0/1873767977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc1524a0 con 0x7efecc0a4c50 2023-06-02T15:30:51.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efec8ff9640 1 -- 172.21.15.78:0/1873767977 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc003860 con 0x7efecc0a4c50 2023-06-02T15:30:51.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 -- 172.21.15.78:0/1873767977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc06ec30 con 0x7efecc0a4c50 2023-06-02T15:30:51.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.766+0000 7efed2886640 1 -- 172.21.15.78:0/1873767977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc06e310 con 0x7efecc0a4c50 2023-06-02T15:30:51.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.770+0000 7efec8ff9640 1 -- 172.21.15.78:0/1873767977 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7efebc003bd0 con 0x7efecc0a4c50 2023-06-02T15:30:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.770+0000 7efec8ff9640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efeac065c30 0x7efeac0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.770+0000 7efecbfff640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efeac065c30 0x7efeac0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.770+0000 7efec8ff9640 1 -- 172.21.15.78:0/1873767977 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efebc083a60 con 0x7efecc0a4c50 2023-06-02T15:30:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.770+0000 7efecbfff640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efeac065c30 0x7efeac0680e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efec40012f0 tx=0x7efec4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:51.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.774+0000 7efec8ff9640 1 -- 172.21.15.78:0/1873767977 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7efebc050fd0 con 0x7efecc0a4c50 2023-06-02T15:30:51.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.926+0000 7efed2886640 1 -- 172.21.15.78:0/1873767977 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efecc0bbc90 con 0x7efecc0a4c50 2023-06-02T15:30:51.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.926+0000 7efec8ff9640 1 -- 172.21.15.78:0/1873767977 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7efecc0bbc90 con 0x7efecc0a4c50 2023-06-02T15:30:51.935 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:30:51.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 -- 172.21.15.78:0/1873767977 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efeac065c30 msgr2=0x7efeac0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efeac065c30 0x7efeac0680e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efec40012f0 tx=0x7efec4009040 comp rx=0 tx=0).stop 2023-06-02T15:30:51.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 -- 172.21.15.78:0/1873767977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4c50 msgr2=0x7efecc0a7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:51.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4c50 0x7efecc0a7ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efebc00c7f0 tx=0x7efebc00ccb0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 -- 172.21.15.78:0/1873767977 shutdown_connections 2023-06-02T15:30:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efeac065c30 0x7efeac0680e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efecc0a4c50 0x7efecc0a7ca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0a4700 0x7efecc0a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 --2- 172.21.15.78:0/1873767977 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efecc06bee0 0x7efecc14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 -- 172.21.15.78:0/1873767977 >> 172.21.15.78:0/1873767977 conn(0x7efecc0698f0 msgr2=0x7efecc14f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:51.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 -- 172.21.15.78:0/1873767977 shutdown_connections 2023-06-02T15:30:51.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:51.930+0000 7efed2886640 1 -- 172.21.15.78:0/1873767977 wait complete. 2023-06-02T15:30:51.954 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-02T15:30:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62d10e3640 1 Processor -- start 2023-06-02T15:30:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62d10e3640 1 -- start start 2023-06-02T15:30:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62d10e3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62cc14d020 0x7f62cc071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62d10e3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62cc071be0 0x7f62cc0c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62d10e3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc0bc870 con 0x7f62cc0a66a0 2023-06-02T15:30:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62d10e3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62cc071990 con 0x7f62cc14d020 2023-06-02T15:30:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62d10e3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62cc1505d0 con 0x7f62cc071be0 2023-06-02T15:30:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62cad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62cc14d020 0x7f62cc071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62ca59c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f62cc0a66a0 0x7f62cc0a6c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44880/0 (socket says 172.21.15.78:44880) 2023-06-02T15:30:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62ca59c640 1 -- 172.21.15.78:0/4251875515 learned_addr learned my addr 172.21.15.78:0/4251875515 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62cb59e640 1 --2- 172.21.15.78:0/4251875515 >> v2:172.21.15.132:3300/0 conn(0x7f62cc071be0 0x7f62cc0c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62cad9d640 1 -- 172.21.15.78:0/4251875515 >> v2:172.21.15.132:3300/0 conn(0x7f62cc071be0 msgr2=0x7f62cc0c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:52.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62cad9d640 1 --2- 172.21.15.78:0/4251875515 >> v2:172.21.15.132:3300/0 conn(0x7f62cc071be0 0x7f62cc0c26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62cad9d640 1 -- 172.21.15.78:0/4251875515 >> v1:172.21.15.78:6789/0 conn(0x7f62cc0a66a0 legacy=0x7f62cc0a6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62cad9d640 1 -- 172.21.15.78:0/4251875515 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc14d3f0 con 0x7f62cc14d020 2023-06-02T15:30:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62c9d9b640 1 -- 172.21.15.78:0/4251875515 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588000558 0 0) 0x7f62cc0bc870 con 0x7f62cc0a66a0 2023-06-02T15:30:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.062+0000 7f62cb59e640 1 --2- 172.21.15.78:0/4251875515 >> v2:172.21.15.132:3300/0 conn(0x7f62cc071be0 0x7f62cc0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62cad9d640 1 --2- 172.21.15.78:0/4251875515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc14d020 0x7f62cc071450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0c3830 tx=0x7f62bc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e66cafd6397cd35 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62c9d9b640 1 -- 172.21.15.78:0/4251875515 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0ac640 con 0x7f62cc14d020 2023-06-02T15:30:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62c9d9b640 1 -- 172.21.15.78:0/4251875515 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc0ac7a0 con 0x7f62cc14d020 2023-06-02T15:30:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62c9d9b640 1 -- 172.21.15.78:0/4251875515 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0acb30 con 0x7f62cc14d020 2023-06-02T15:30:52.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 -- 172.21.15.78:0/4251875515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc14d020 msgr2=0x7f62cc071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 --2- 172.21.15.78:0/4251875515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc14d020 0x7f62cc071450 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0c3830 tx=0x7f62bc01c460 comp rx=0 tx=0).stop 2023-06-02T15:30:52.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 -- 172.21.15.78:0/4251875515 shutdown_connections 2023-06-02T15:30:52.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 --2- 172.21.15.78:0/4251875515 >> v2:172.21.15.132:3300/0 conn(0x7f62cc071be0 0x7f62cc0c26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 --2- 172.21.15.78:0/4251875515 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc14d020 0x7f62cc071450 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 -- 172.21.15.78:0/4251875515 >> 172.21.15.78:0/4251875515 conn(0x7f62cc0a5730 msgr2=0x7f62cc0a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:52.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 -- 172.21.15.78:0/4251875515 shutdown_connections 2023-06-02T15:30:52.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 -- 172.21.15.78:0/4251875515 wait complete. 2023-06-02T15:30:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 Processor -- start 2023-06-02T15:30:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 -- start start 2023-06-02T15:30:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc071be0 0x7f62cc144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62cc0a66a0 0x7f62cc06b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62cc14d020 0x7f62cc0bbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc06c690 con 0x7f62cc071be0 2023-06-02T15:30:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc06c160 con 0x7f62cc0a66a0 2023-06-02T15:30:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62d10e3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc0bc1c0 con 0x7f62cc14d020 2023-06-02T15:30:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62cad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc071be0 0x7f62cc144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62cad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc071be0 0x7f62cc144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53634/0 (socket says 172.21.15.78:53634) 2023-06-02T15:30:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62cad9d640 1 -- 172.21.15.78:0/333956429 learned_addr learned my addr 172.21.15.78:0/333956429 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62cad9d640 1 -- 172.21.15.78:0/333956429 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62cc14d020 msgr2=0x7f62cc0bbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62cad9d640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62cc14d020 0x7f62cc0bbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62ca59c640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62cc0a66a0 0x7f62cc06b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62cad9d640 1 -- 172.21.15.78:0/333956429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62cc0a66a0 msgr2=0x7f62cc06b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62cad9d640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62cc0a66a0 0x7f62cc06b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62cad9d640 1 -- 172.21.15.78:0/333956429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009420 con 0x7f62cc071be0 2023-06-02T15:30:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.066+0000 7f62cad9d640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc071be0 0x7f62cc144a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0af040 tx=0x7f62bc019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:52.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62c37fe640 1 -- 172.21.15.78:0/333956429 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0bb070 con 0x7f62cc071be0 2023-06-02T15:30:52.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62c37fe640 1 -- 172.21.15.78:0/333956429 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc0b56e0 con 0x7f62cc071be0 2023-06-02T15:30:52.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62d10e3640 1 -- 172.21.15.78:0/333956429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62cc159720 con 0x7f62cc071be0 2023-06-02T15:30:52.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62c37fe640 1 -- 172.21.15.78:0/333956429 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc0b5ab0 con 0x7f62cc071be0 2023-06-02T15:30:52.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62d10e3640 1 -- 172.21.15.78:0/333956429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc159590 con 0x7f62cc071be0 2023-06-02T15:30:52.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62d10e3640 1 -- 172.21.15.78:0/333956429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62cc1598b0 con 0x7f62cc071be0 2023-06-02T15:30:52.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62c37fe640 1 -- 172.21.15.78:0/333956429 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f62bc0b3040 con 0x7f62cc071be0 2023-06-02T15:30:52.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62c37fe640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f62ac065c00 0x7f62ac0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62c37fe640 1 -- 172.21.15.78:0/333956429 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f62bc11d050 con 0x7f62cc071be0 2023-06-02T15:30:52.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62ca59c640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f62ac065c00 0x7f62ac0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.070+0000 7f62ca59c640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f62ac065c00 0x7f62ac0680b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0bc3c0 tx=0x7f62b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:52.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.074+0000 7f62c37fe640 1 -- 172.21.15.78:0/333956429 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f62bc0ea530 con 0x7f62cc071be0 2023-06-02T15:30:52.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.238+0000 7f62d10e3640 1 -- 172.21.15.78:0/333956429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f62cc073bc0 con 0x7f62cc071be0 2023-06-02T15:30:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.238+0000 7f62c37fe640 1 -- 172.21.15.78:0/333956429 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f62bc0edb50 con 0x7f62cc071be0 2023-06-02T15:30:52.248 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-02T15:30:52.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 -- 172.21.15.78:0/333956429 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f62ac065c00 msgr2=0x7f62ac0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f62ac065c00 0x7f62ac0680b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0bc3c0 tx=0x7f62b4009040 comp rx=0 tx=0).stop 2023-06-02T15:30:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 -- 172.21.15.78:0/333956429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc071be0 msgr2=0x7f62cc144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc071be0 0x7f62cc144a10 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f62bc0af040 tx=0x7f62bc019200 comp rx=0 tx=0).stop 2023-06-02T15:30:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 -- 172.21.15.78:0/333956429 shutdown_connections 2023-06-02T15:30:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62cc14d020 0x7f62cc0bbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62cc0a66a0 0x7f62cc06b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f62ac065c00 0x7f62ac0680b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 --2- 172.21.15.78:0/333956429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62cc071be0 0x7f62cc144a10 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 -- 172.21.15.78:0/333956429 >> 172.21.15.78:0/333956429 conn(0x7f62cc0a5730 msgr2=0x7f62cc0a6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:52.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 -- 172.21.15.78:0/333956429 shutdown_connections 2023-06-02T15:30:52.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.242+0000 7f62d10e3640 1 -- 172.21.15.78:0/333956429 wait complete. 2023-06-02T15:30:52.266 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2023-06-02T15:30:52.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:52.267 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-06-02T15:30:52.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi150.stderr:ceph-fuse[32299]: fuse finished with error 0 and tester_r 0 2023-06-02T15:30:52.290 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:30:52.318 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-06-02T15:30:52.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:30:52.319 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-06-02T15:30:52.378 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:52.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.494+0000 7fc01dd8a640 1 Processor -- start 2023-06-02T15:30:52.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.494+0000 7fc01dd8a640 1 -- start start 2023-06-02T15:30:52.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc01dd8a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc01809fc70 0x7fc0180bda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc01dd8a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01814ea10 con 0x7fc01806cc00 2023-06-02T15:30:52.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc01dd8a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc01814ecf0 con 0x7fc018144c80 2023-06-02T15:30:52.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc01dd8a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0180a1da0 con 0x7fc01809fc70 2023-06-02T15:30:52.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0177fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc01806cc00 0x7fc018144570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44890/0 (socket says 172.21.15.78:44890) 2023-06-02T15:30:52.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0177fe640 1 -- 172.21.15.78:0/3315201973 learned_addr learned my addr 172.21.15.78:0/3315201973 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:52.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc017fff640 1 --2- 172.21.15.78:0/3315201973 >> v2:172.21.15.132:3300/0 conn(0x7fc01809fc70 0x7fc0180bda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984197735 0 0) 0x7fc01814ea10 con 0x7fc01806cc00 2023-06-02T15:30:52.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc000004640 con 0x7fc01806cc00 2023-06-02T15:30:52.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2342360801 0 0) 0x7fc000004640 con 0x7fc01806cc00 2023-06-02T15:30:52.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 >> v2:172.21.15.132:3300/0 conn(0x7fc01809fc70 msgr2=0x7fc0180bda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:52.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 --2- 172.21.15.78:0/3315201973 >> v2:172.21.15.132:3300/0 conn(0x7fc01809fc70 0x7fc0180bda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 >> v1:172.21.15.132:6789/0 conn(0x7fc018144c80 legacy=0x7fc01814ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0180bc7e0 con 0x7fc01806cc00 2023-06-02T15:30:52.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fc00c001680 con 0x7fc01806cc00 2023-06-02T15:30:52.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 >> v1:172.21.15.78:6789/0 conn(0x7fc01806cc00 legacy=0x7fc018144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc000004a90 0x7fc000004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0000058e0 0x7fc000005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0000063b0 0x7fc00000caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180a1da0 con 0x7fc0000063b0 2023-06-02T15:30:52.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00000d2e0 con 0x7fc0000058e0 2023-06-02T15:30:52.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00000d4a0 con 0x7fc000004a90 2023-06-02T15:30:52.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc017fff640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0000063b0 0x7fc00000caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc016ffd640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0000058e0 0x7fc000005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc0177fe640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc000004a90 0x7fc000004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc017fff640 1 -- 172.21.15.78:0/3315201973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc000004a90 msgr2=0x7fc000004ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:52.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc017fff640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc000004a90 0x7fc000004ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc017fff640 1 -- 172.21.15.78:0/3315201973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0000058e0 msgr2=0x7fc000005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:52.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc017fff640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0000058e0 0x7fc000005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc017fff640 1 -- 172.21.15.78:0/3315201973 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc000004640 con 0x7fc0000063b0 2023-06-02T15:30:52.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.498+0000 7fc016ffd640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0000058e0 0x7fc000005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:52.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc017fff640 1 -- 172.21.15.78:0/3315201973 reap_dead start 2023-06-02T15:30:52.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc017fff640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0000063b0 0x7fc00000caa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc010009f90 tx=0x7fc01001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af5f0f4a56504c1d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:52.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100a5ae0 con 0x7fc0000063b0 2023-06-02T15:30:52.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc01000f040 con 0x7fc0000063b0 2023-06-02T15:30:52.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc0167fc640 1 -- 172.21.15.78:0/3315201973 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0100a5e60 con 0x7fc0000063b0 2023-06-02T15:30:52.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 -- 172.21.15.78:0/3315201973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0000063b0 msgr2=0x7fc00000caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0000063b0 0x7fc00000caa0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc010009f90 tx=0x7fc01001cc60 comp rx=0 tx=0).stop 2023-06-02T15:30:52.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 -- 172.21.15.78:0/3315201973 shutdown_connections 2023-06-02T15:30:52.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 --2- 172.21.15.78:0/3315201973 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0000063b0 0x7fc00000caa0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 -- 172.21.15.78:0/3315201973 >> 172.21.15.78:0/3315201973 conn(0x7fc0180bcf50 msgr2=0x7fc0180bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:52.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 -- 172.21.15.78:0/3315201973 shutdown_connections 2023-06-02T15:30:52.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 -- 172.21.15.78:0/3315201973 wait complete. 2023-06-02T15:30:52.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 Processor -- start 2023-06-02T15:30:52.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 -- start start 2023-06-02T15:30:52.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0000063b0 0x7fc0180b9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0180a6040 0x7fc01813e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc018070d40 0x7fc01813ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc01806f020 con 0x7fc0180a6040 2023-06-02T15:30:52.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0180a4830 con 0x7fc0000063b0 2023-06-02T15:30:52.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0181e7340 con 0x7fc018070d40 2023-06-02T15:30:52.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc016ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0180a6040 0x7fc01813e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc016ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0180a6040 0x7fc01813e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53666/0 (socket says 172.21.15.78:53666) 2023-06-02T15:30:52.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc016ffd640 1 -- 172.21.15.78:0/2994068141 learned_addr learned my addr 172.21.15.78:0/2994068141 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:52.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc0177fe640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0000063b0 0x7fc0180b9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc016ffd640 1 -- 172.21.15.78:0/2994068141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc018070d40 msgr2=0x7fc01813ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc017fff640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc018070d40 0x7fc01813ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc016ffd640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc018070d40 0x7fc01813ec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc016ffd640 1 -- 172.21.15.78:0/2994068141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0000063b0 msgr2=0x7fc0180b9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc016ffd640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0000063b0 0x7fc0180b9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc016ffd640 1 -- 172.21.15.78:0/2994068141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc01814b7c0 con 0x7fc0180a6040 2023-06-02T15:30:52.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc016ffd640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0180a6040 0x7fc01813e730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc008001ec0 tx=0x7fc00800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:52.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fbffffff640 1 -- 172.21.15.78:0/2994068141 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc008005480 con 0x7fc0180a6040 2023-06-02T15:30:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fbffffff640 1 -- 172.21.15.78:0/2994068141 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc008003620 con 0x7fc0180a6040 2023-06-02T15:30:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fbffffff640 1 -- 172.21.15.78:0/2994068141 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0080039d0 con 0x7fc0180a6040 2023-06-02T15:30:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.502+0000 7fc01dd8a640 1 -- 172.21.15.78:0/2994068141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc01814b630 con 0x7fc0180a6040 2023-06-02T15:30:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.506+0000 7fc01dd8a640 1 -- 172.21.15.78:0/2994068141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0180bda60 con 0x7fc0180a6040 2023-06-02T15:30:52.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.506+0000 7fc01dd8a640 1 -- 172.21.15.78:0/2994068141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0181e7170 con 0x7fc0180a6040 2023-06-02T15:30:52.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.506+0000 7fbffffff640 1 -- 172.21.15.78:0/2994068141 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fc008003b30 con 0x7fc0180a6040 2023-06-02T15:30:52.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.506+0000 7fbffffff640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc004065c30 0x7fc0040680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.506+0000 7fc0177fe640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc004065c30 0x7fc0040680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.506+0000 7fbffffff640 1 -- 172.21.15.78:0/2994068141 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc008083480 con 0x7fc0180a6040 2023-06-02T15:30:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.506+0000 7fc0177fe640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc004065c30 0x7fc0040680e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0010f0 tx=0x7fc00c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:52.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.510+0000 7fbffffff640 1 -- 172.21.15.78:0/2994068141 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fc0080509f0 con 0x7fc0180a6040 2023-06-02T15:30:52.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.658+0000 7fc01dd8a640 1 -- 172.21.15.78:0/2994068141 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc018073bc0 con 0x7fc0180a6040 2023-06-02T15:30:52.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.658+0000 7fbffffff640 1 -- 172.21.15.78:0/2994068141 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fc008054010 con 0x7fc0180a6040 2023-06-02T15:30:52.668 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:52.668 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:52.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 -- 172.21.15.78:0/2994068141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc004065c30 msgr2=0x7fc0040680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc004065c30 0x7fc0040680e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc00c0010f0 tx=0x7fc00c009040 comp rx=0 tx=0).stop 2023-06-02T15:30:52.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 -- 172.21.15.78:0/2994068141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0180a6040 msgr2=0x7fc01813e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0180a6040 0x7fc01813e730 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc008001ec0 tx=0x7fc00800d9d0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 -- 172.21.15.78:0/2994068141 shutdown_connections 2023-06-02T15:30:52.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc018070d40 0x7fc01813ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc004065c30 0x7fc0040680e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0180a6040 0x7fc01813e730 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 --2- 172.21.15.78:0/2994068141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0000063b0 0x7fc0180b9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 -- 172.21.15.78:0/2994068141 >> 172.21.15.78:0/2994068141 conn(0x7fc0180bcf50 msgr2=0x7fc01814a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:52.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 -- 172.21.15.78:0/2994068141 shutdown_connections 2023-06-02T15:30:52.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.662+0000 7fc01dd8a640 1 -- 172.21.15.78:0/2994068141 wait complete. 2023-06-02T15:30:52.685 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:52.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe822419640 1 Processor -- start 2023-06-02T15:30:52.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe822419640 1 -- start start 2023-06-02T15:30:52.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe822419640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c0b7fc0 0x7fe81c0bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe822419640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0c0730 con 0x7fe81c0bf2b0 2023-06-02T15:30:52.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe822419640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c0c0b20 con 0x7fe81c06bd00 2023-06-02T15:30:52.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe822419640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c06b5f0 con 0x7fe81c0b7fc0 2023-06-02T15:30:52.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe8137fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe81c0bf2b0 0x7fe81c1521c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44906/0 (socket says 172.21.15.78:44906) 2023-06-02T15:30:52.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe8137fe640 1 -- 172.21.15.78:0/530509100 learned_addr learned my addr 172.21.15.78:0/530509100 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:52.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1903986311 0 0) 0x7fe81c0c0730 con 0x7fe81c0bf2b0 2023-06-02T15:30:52.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe8209b6640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c0b7fc0 0x7fe81c0bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe808003530 con 0x7fe81c0bf2b0 2023-06-02T15:30:52.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 566627833 0 0) 0x7fe808003530 con 0x7fe81c0bf2b0 2023-06-02T15:30:52.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c0b7fc0 msgr2=0x7fe81c0bff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:52.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c0b7fc0 0x7fe81c0bff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 >> v1:172.21.15.132:6789/0 conn(0x7fe81c06bd00 legacy=0x7fe81c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0aa880 con 0x7fe81c0bf2b0 2023-06-02T15:30:52.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fe804001680 con 0x7fe81c0bf2b0 2023-06-02T15:30:52.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe8209b6640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c0b7fc0 0x7fe81c0bff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:52.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 >> v1:172.21.15.78:6789/0 conn(0x7fe81c0bf2b0 legacy=0x7fe81c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8080039b0 0x7fe808003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8080047d0 0x7fe808004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c0b7fc0 0x7fe808005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80800bad0 con 0x7fe8080039b0 2023-06-02T15:30:52.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80800bc40 con 0x7fe8080047d0 2023-06-02T15:30:52.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80800be00 con 0x7fe81c0b7fc0 2023-06-02T15:30:52.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81bfff640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8080039b0 0x7fe808003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe8137fe640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8080047d0 0x7fe808004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe8209b6640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c0b7fc0 0x7fe808005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81bfff640 1 -- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c0b7fc0 msgr2=0x7fe808005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:52.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81bfff640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c0b7fc0 0x7fe808005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81bfff640 1 -- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8080047d0 msgr2=0x7fe808004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:52.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81bfff640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8080047d0 0x7fe808004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.790+0000 7fe81bfff640 1 -- 172.21.15.78:0/530509100 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808003530 con 0x7fe8080039b0 2023-06-02T15:30:52.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe81bfff640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8080039b0 0x7fe808003dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe80c001780 tx=0x7fe80c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e99a0cdb5b3afa7 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:52.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c0052d0 con 0x7fe8080039b0 2023-06-02T15:30:52.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c0a7050 con 0x7fe8080039b0 2023-06-02T15:30:52.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe81b7fe640 1 -- 172.21.15.78:0/530509100 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c003600 con 0x7fe8080039b0 2023-06-02T15:30:52.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 -- 172.21.15.78:0/530509100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8080039b0 msgr2=0x7fe808003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 --2- 172.21.15.78:0/530509100 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe8080039b0 0x7fe808003dc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe80c001780 tx=0x7fe80c01c400 comp rx=0 tx=0).stop 2023-06-02T15:30:52.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe8209b6640 1 -- 172.21.15.78:0/530509100 reap_dead start 2023-06-02T15:30:52.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 -- 172.21.15.78:0/530509100 shutdown_connections 2023-06-02T15:30:52.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 -- 172.21.15.78:0/530509100 >> 172.21.15.78:0/530509100 conn(0x7fe81c0a6480 msgr2=0x7fe81c0a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:52.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 -- 172.21.15.78:0/530509100 shutdown_connections 2023-06-02T15:30:52.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 -- 172.21.15.78:0/530509100 wait complete. 2023-06-02T15:30:52.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 Processor -- start 2023-06-02T15:30:52.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 -- start start 2023-06-02T15:30:52.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8080039b0 0x7fe81c1e6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c1d2fb0 0x7fe81c1d6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe81c0bb390 0x7fe81c1d8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0b91a0 con 0x7fe81c0bb390 2023-06-02T15:30:52.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1d7ed0 con 0x7fe8080039b0 2023-06-02T15:30:52.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe822419640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c1d66b0 con 0x7fe81c1d2fb0 2023-06-02T15:30:52.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe8209b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe81c0bb390 0x7fe81c1d8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe8209b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe81c0bb390 0x7fe81c1d8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53676/0 (socket says 172.21.15.78:53676) 2023-06-02T15:30:52.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe8209b6640 1 -- 172.21.15.78:0/3553807332 learned_addr learned my addr 172.21.15.78:0/3553807332 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:52.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe8209b6640 1 -- 172.21.15.78:0/3553807332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c1d2fb0 msgr2=0x7fe81c1d6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe8209b6640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c1d2fb0 0x7fe81c1d6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe8209b6640 1 -- 172.21.15.78:0/3553807332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8080039b0 msgr2=0x7fe81c1e6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe8209b6640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8080039b0 0x7fe81c1e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe8209b6640 1 -- 172.21.15.78:0/3553807332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0c1310 con 0x7fe81c0bb390 2023-06-02T15:30:52.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.794+0000 7fe8209b6640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe81c0bb390 0x7fe81c1d8360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0c1e90 tx=0x7fe8140043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:52.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe8197fa640 1 -- 172.21.15.78:0/3553807332 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814014610 con 0x7fe81c0bb390 2023-06-02T15:30:52.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe8197fa640 1 -- 172.21.15.78:0/3553807332 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe81400f050 con 0x7fe81c0bb390 2023-06-02T15:30:52.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe822419640 1 -- 172.21.15.78:0/3553807332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe81c0c0d70 con 0x7fe81c0bb390 2023-06-02T15:30:52.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe8197fa640 1 -- 172.21.15.78:0/3553807332 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8140149d0 con 0x7fe81c0bb390 2023-06-02T15:30:52.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe822419640 1 -- 172.21.15.78:0/3553807332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c06c0d0 con 0x7fe81c0bb390 2023-06-02T15:30:52.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe822419640 1 -- 172.21.15.78:0/3553807332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c073bc0 con 0x7fe81c0bb390 2023-06-02T15:30:52.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe8197fa640 1 -- 172.21.15.78:0/3553807332 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fe814014b30 con 0x7fe81c0bb390 2023-06-02T15:30:52.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe8197fa640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe7fc065c00 0x7fe7fc0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe8197fa640 1 -- 172.21.15.78:0/3553807332 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe814083220 con 0x7fe81c0bb390 2023-06-02T15:30:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe81bfff640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe7fc065c00 0x7fe7fc0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.798+0000 7fe81bfff640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe7fc065c00 0x7fe7fc0680b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe80c001750 tx=0x7fe80c001130 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:52.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.802+0000 7fe8197fa640 1 -- 172.21.15.78:0/3553807332 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fe814054220 con 0x7fe81c0bb390 2023-06-02T15:30:52.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.954+0000 7fe822419640 1 -- 172.21.15.78:0/3553807332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe81c1d7ca0 con 0x7fe81c0bb390 2023-06-02T15:30:52.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe8197fa640 1 -- 172.21.15.78:0/3553807332 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7fe814053db0 con 0x7fe81c0bb390 2023-06-02T15:30:52.967 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:52.967 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:52.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 -- 172.21.15.78:0/3553807332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe7fc065c00 msgr2=0x7fe7fc0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe7fc065c00 0x7fe7fc0680b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe80c001750 tx=0x7fe80c001130 comp rx=0 tx=0).stop 2023-06-02T15:30:52.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 -- 172.21.15.78:0/3553807332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe81c0bb390 msgr2=0x7fe81c1d8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:52.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe81c0bb390 0x7fe81c1d8360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe81c0c1e90 tx=0x7fe8140043b0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 -- 172.21.15.78:0/3553807332 shutdown_connections 2023-06-02T15:30:52.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe7fc065c00 0x7fe7fc0680b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe81c0bb390 0x7fe81c1d8360 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe81c1d2fb0 0x7fe81c1d6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 --2- 172.21.15.78:0/3553807332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8080039b0 0x7fe81c1e6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:52.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 -- 172.21.15.78:0/3553807332 >> 172.21.15.78:0/3553807332 conn(0x7fe81c0a6480 msgr2=0x7fe81c0a4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:52.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.958+0000 7fe822419640 1 -- 172.21.15.78:0/3553807332 shutdown_connections 2023-06-02T15:30:52.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:52.962+0000 7fe822419640 1 -- 172.21.15.78:0/3553807332 wait complete. 2023-06-02T15:30:52.985 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-06-02T15:30:53.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc974942640 1 Processor -- start 2023-06-02T15:30:53.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc974942640 1 -- start start 2023-06-02T15:30:53.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc974942640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc970151f90 0x7fc9700c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc974942640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc97006bd60 0x7fc97006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc974942640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9700c0a50 con 0x7fc9700aa5b0 2023-06-02T15:30:53.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc974942640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc970152360 con 0x7fc97006bd60 2023-06-02T15:30:53.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc974942640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc970152620 con 0x7fc970151f90 2023-06-02T15:30:53.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96ed9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc9700aa5b0 0x7fc97014e500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44908/0 (socket says 172.21.15.78:44908) 2023-06-02T15:30:53.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96ed9d640 1 -- 172.21.15.78:0/1173453789 learned_addr learned my addr 172.21.15.78:0/1173453789 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:53.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96dd9b640 1 --2- 172.21.15.78:0/1173453789 >> v2:172.21.15.132:3300/0 conn(0x7fc97006bd60 0x7fc97006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96e59c640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc970151f90 0x7fc9700c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3980001993 0 0) 0x7fc9700c0a50 con 0x7fc9700aa5b0 2023-06-02T15:30:53.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc958003530 con 0x7fc9700aa5b0 2023-06-02T15:30:53.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4220283255 0 0) 0x7fc958003530 con 0x7fc9700aa5b0 2023-06-02T15:30:53.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc970151f90 msgr2=0x7fc9700c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:53.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc970151f90 0x7fc9700c1260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 >> v2:172.21.15.132:3300/0 conn(0x7fc97006bd60 msgr2=0x7fc97006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:53.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 --2- 172.21.15.78:0/1173453789 >> v2:172.21.15.132:3300/0 conn(0x7fc97006bd60 0x7fc97006a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc970152900 con 0x7fc9700aa5b0 2023-06-02T15:30:53.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fc968001a00 con 0x7fc9700aa5b0 2023-06-02T15:30:53.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 >> v1:172.21.15.78:6789/0 conn(0x7fc9700aa5b0 legacy=0x7fc97014e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:53.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc970151f90 0x7fc9580039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc958003f70 0x7fc9580047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958004d10 0x7fc958005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc970152360 con 0x7fc958004d10 2023-06-02T15:30:53.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc970152620 con 0x7fc958003f70 2023-06-02T15:30:53.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95800ba10 con 0x7fc970151f90 2023-06-02T15:30:53.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96dd9b640 1 --2- 172.21.15.78:0/1173453789 >> v2:172.21.15.132:3300/0 conn(0x7fc97006bd60 0x7fc97006a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:53.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.098+0000 7fc96ed9d640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958004d10 0x7fc958005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96e59c640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc970151f90 0x7fc9580039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96ed9d640 1 -- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc970151f90 msgr2=0x7fc9580039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:53.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96ed9d640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc970151f90 0x7fc9580039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96ed9d640 1 -- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc958003f70 msgr2=0x7fc9580047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:53.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96ed9d640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc958003f70 0x7fc9580047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96ed9d640 1 -- 172.21.15.78:0/1173453789 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958003530 con 0x7fc958004d10 2023-06-02T15:30:53.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96e59c640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc970151f90 0x7fc9580039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:53.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96ed9d640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958004d10 0x7fc958005180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc96800a830 tx=0x7fc96801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e79a6238f51b39 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:53.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680ad630 con 0x7fc958004d10 2023-06-02T15:30:53.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9680a8070 con 0x7fc958004d10 2023-06-02T15:30:53.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96d59a640 1 -- 172.21.15.78:0/1173453789 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680ada30 con 0x7fc958004d10 2023-06-02T15:30:53.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc974942640 1 -- 172.21.15.78:0/1173453789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958004d10 msgr2=0x7fc958005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:53.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc974942640 1 --2- 172.21.15.78:0/1173453789 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc958004d10 0x7fc958005180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc96800a830 tx=0x7fc96801d340 comp rx=0 tx=0).stop 2023-06-02T15:30:53.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc96ed9d640 1 -- 172.21.15.78:0/1173453789 reap_dead start 2023-06-02T15:30:53.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc974942640 1 -- 172.21.15.78:0/1173453789 shutdown_connections 2023-06-02T15:30:53.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc974942640 1 -- 172.21.15.78:0/1173453789 >> 172.21.15.78:0/1173453789 conn(0x7fc9700a63c0 msgr2=0x7fc9700a67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:53.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc974942640 1 -- 172.21.15.78:0/1173453789 shutdown_connections 2023-06-02T15:30:53.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc974942640 1 -- 172.21.15.78:0/1173453789 wait complete. 2023-06-02T15:30:53.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.102+0000 7fc974942640 1 Processor -- start 2023-06-02T15:30:53.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc974942640 1 -- start start 2023-06-02T15:30:53.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc974942640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9700ba030 0x7fc9700ba400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc974942640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9700a91c0 0x7fc970148420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc974942640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc970148960 0x7fc9701e0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc974942640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9700bd3e0 con 0x7fc970148960 2023-06-02T15:30:53.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc974942640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9701e4d20 con 0x7fc9700a91c0 2023-06-02T15:30:53.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc974942640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9701e4890 con 0x7fc9700ba030 2023-06-02T15:30:53.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc970148960 0x7fc9701e0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc970148960 0x7fc9701e0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:53708/0 (socket says 172.21.15.78:53708) 2023-06-02T15:30:53.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96ed9d640 1 -- 172.21.15.78:0/1160287411 learned_addr learned my addr 172.21.15.78:0/1160287411 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:53.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96dd9b640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9700a91c0 0x7fc970148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96ed9d640 1 -- 172.21.15.78:0/1160287411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9700ba030 msgr2=0x7fc9700ba400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:53.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96ed9d640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9700ba030 0x7fc9700ba400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96ed9d640 1 -- 172.21.15.78:0/1160287411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9700a91c0 msgr2=0x7fc970148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:53.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96ed9d640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9700a91c0 0x7fc970148420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96ed9d640 1 -- 172.21.15.78:0/1160287411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9700c0ee0 con 0x7fc970148960 2023-06-02T15:30:53.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96ed9d640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc970148960 0x7fc9701e0b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc96800a830 tx=0x7fc958005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:53.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc95effd640 1 -- 172.21.15.78:0/1160287411 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680019d0 con 0x7fc970148960 2023-06-02T15:30:53.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc95effd640 1 -- 172.21.15.78:0/1160287411 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc968001fe0 con 0x7fc970148960 2023-06-02T15:30:53.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc95effd640 1 -- 172.21.15.78:0/1160287411 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9680ad630 con 0x7fc970148960 2023-06-02T15:30:53.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc974942640 1 -- 172.21.15.78:0/1160287411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9700bf320 con 0x7fc970148960 2023-06-02T15:30:53.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc974942640 1 -- 172.21.15.78:0/1160287411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9700aa040 con 0x7fc970148960 2023-06-02T15:30:53.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc974942640 1 -- 172.21.15.78:0/1160287411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc970073bc0 con 0x7fc970148960 2023-06-02T15:30:53.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc95effd640 1 -- 172.21.15.78:0/1160287411 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fc9680aa030 con 0x7fc970148960 2023-06-02T15:30:53.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc95effd640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc950065c00 0x7fc9500680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc95effd640 1 -- 172.21.15.78:0/1160287411 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc96811cbd0 con 0x7fc970148960 2023-06-02T15:30:53.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96e59c640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc950065c00 0x7fc9500680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.106+0000 7fc96e59c640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc950065c00 0x7fc9500680b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc960009a00 tx=0x7fc960008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:53.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.110+0000 7fc95effd640 1 -- 172.21.15.78:0/1160287411 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fc9680edb40 con 0x7fc970148960 2023-06-02T15:30:53.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.294+0000 7fc974942640 1 -- 172.21.15.78:0/1160287411 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc970073bc0 con 0x7fc970148960 2023-06-02T15:30:53.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.738+0000 7fc95effd640 1 -- 172.21.15.78:0/1160287411 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc9680ed6d0 con 0x7fc970148960 2023-06-02T15:30:53.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 -- 172.21.15.78:0/1160287411 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc950065c00 msgr2=0x7fc9500680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:53.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc950065c00 0x7fc9500680b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc960009a00 tx=0x7fc960008040 comp rx=0 tx=0).stop 2023-06-02T15:30:53.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 -- 172.21.15.78:0/1160287411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc970148960 msgr2=0x7fc9701e0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:53.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc970148960 0x7fc9701e0b70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc96800a830 tx=0x7fc958005800 comp rx=0 tx=0).stop 2023-06-02T15:30:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 -- 172.21.15.78:0/1160287411 shutdown_connections 2023-06-02T15:30:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc950065c00 0x7fc9500680b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc970148960 0x7fc9701e0b70 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9700a91c0 0x7fc970148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 --2- 172.21.15.78:0/1160287411 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc9700ba030 0x7fc9700ba400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 -- 172.21.15.78:0/1160287411 >> 172.21.15.78:0/1160287411 conn(0x7fc9700a63c0 msgr2=0x7fc97014fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 -- 172.21.15.78:0/1160287411 shutdown_connections 2023-06-02T15:30:53.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.742+0000 7fc974942640 1 -- 172.21.15.78:0/1160287411 wait complete. 2023-06-02T15:30:53.769 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-06-02T15:30:53.769 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-06-02T15:30:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.874+0000 7fcc2ca37640 1 Processor -- start 2023-06-02T15:30:53.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.874+0000 7fcc2ca37640 1 -- start start 2023-06-02T15:30:53.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2ca37640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc280a59e0 0x7fcc280718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2ca37640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcc2806cfc0 0x7fcc2814f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2ca37640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc2814d220 con 0x7fcc2814fd80 2023-06-02T15:30:53.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2ca37640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc280ba640 con 0x7fcc280a59e0 2023-06-02T15:30:53.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2ca37640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc2814cd30 con 0x7fcc2806cfc0 2023-06-02T15:30:53.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc26d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcc2814fd80 0x7fcc28149660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55858/0 (socket says 172.21.15.78:55858) 2023-06-02T15:30:53.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc26d9d640 1 -- 172.21.15.78:0/2089079439 learned_addr learned my addr 172.21.15.78:0/2089079439 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:53.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2659c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcc280a59e0 0x7fcc280718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2559a640 1 -- 172.21.15.78:0/2089079439 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2520845098 0 0) 0x7fcc2814d220 con 0x7fcc2814fd80 2023-06-02T15:30:53.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc25d9b640 1 --2- 172.21.15.78:0/2089079439 >> v2:172.21.15.132:3300/0 conn(0x7fcc2806cfc0 0x7fcc2814f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2559a640 1 -- 172.21.15.78:0/2089079439 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc14003530 con 0x7fcc2814fd80 2023-06-02T15:30:53.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2659c640 1 -- 172.21.15.78:0/2089079439 >> v2:172.21.15.132:3300/0 conn(0x7fcc2806cfc0 msgr2=0x7fcc2814f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:53.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2659c640 1 --2- 172.21.15.78:0/2089079439 >> v2:172.21.15.132:3300/0 conn(0x7fcc2806cfc0 0x7fcc2814f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2659c640 1 -- 172.21.15.78:0/2089079439 >> v1:172.21.15.78:6789/0 conn(0x7fcc2814fd80 legacy=0x7fcc28149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:53.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2659c640 1 -- 172.21.15.78:0/2089079439 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc280ba850 con 0x7fcc280a59e0 2023-06-02T15:30:53.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc25d9b640 1 --2- 172.21.15.78:0/2089079439 >> v2:172.21.15.132:3300/0 conn(0x7fcc2806cfc0 0x7fcc2814f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:53.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2659c640 1 --2- 172.21.15.78:0/2089079439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc280a59e0 0x7fcc280718d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcc280bac90 tx=0x7fcc1801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca42b5649a22989 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:53.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2559a640 1 -- 172.21.15.78:0/2089079439 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180ac620 con 0x7fcc280a59e0 2023-06-02T15:30:53.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2559a640 1 -- 172.21.15.78:0/2089079439 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc180ac780 con 0x7fcc280a59e0 2023-06-02T15:30:53.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.878+0000 7fcc2559a640 1 -- 172.21.15.78:0/2089079439 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc180acaf0 con 0x7fcc280a59e0 2023-06-02T15:30:53.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2089079439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc280a59e0 msgr2=0x7fcc280718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:53.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 --2- 172.21.15.78:0/2089079439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc280a59e0 0x7fcc280718d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcc280bac90 tx=0x7fcc1801c3a0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2089079439 shutdown_connections 2023-06-02T15:30:53.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 --2- 172.21.15.78:0/2089079439 >> v2:172.21.15.132:3300/0 conn(0x7fcc2806cfc0 0x7fcc2814f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 --2- 172.21.15.78:0/2089079439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc280a59e0 0x7fcc280718d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2089079439 >> 172.21.15.78:0/2089079439 conn(0x7fcc280a2170 msgr2=0x7fcc280a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:53.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2089079439 shutdown_connections 2023-06-02T15:30:53.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2089079439 wait complete. 2023-06-02T15:30:53.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 Processor -- start 2023-06-02T15:30:53.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- start start 2023-06-02T15:30:53.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc2806cfc0 0x7fcc2813ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc280a59e0 0x7fcc280b9a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc2814fd80 0x7fcc281e6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280a3650 con 0x7fcc2814fd80 2023-06-02T15:30:53.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc280b9f90 con 0x7fcc280a59e0 2023-06-02T15:30:53.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc281ea530 con 0x7fcc2806cfc0 2023-06-02T15:30:53.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc26d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc2814fd80 0x7fcc281e6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc26d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc2814fd80 0x7fcc281e6a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57314/0 (socket says 172.21.15.78:57314) 2023-06-02T15:30:53.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc26d9d640 1 -- 172.21.15.78:0/2186438470 learned_addr learned my addr 172.21.15.78:0/2186438470 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:53.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2659c640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc2806cfc0 0x7fcc2813ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc26d9d640 1 -- 172.21.15.78:0/2186438470 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc2806cfc0 msgr2=0x7fcc2813ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:53.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc25d9b640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc280a59e0 0x7fcc280b9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc26d9d640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc2806cfc0 0x7fcc2813ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc26d9d640 1 -- 172.21.15.78:0/2186438470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc280a59e0 msgr2=0x7fcc280b9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:53.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc26d9d640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc280a59e0 0x7fcc280b9a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:53.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc26d9d640 1 -- 172.21.15.78:0/2186438470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc18009420 con 0x7fcc2814fd80 2023-06-02T15:30:53.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc26d9d640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc2814fd80 0x7fcc281e6a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000caa0 tx=0x7fcc2000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:53.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc1effd640 1 -- 172.21.15.78:0/2186438470 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2000ac00 con 0x7fcc2814fd80 2023-06-02T15:30:53.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc1effd640 1 -- 172.21.15.78:0/2186438470 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2000ad60 con 0x7fcc2814fd80 2023-06-02T15:30:53.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2186438470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc28149f00 con 0x7fcc2814fd80 2023-06-02T15:30:53.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc1effd640 1 -- 172.21.15.78:0/2186438470 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc20012620 con 0x7fcc2814fd80 2023-06-02T15:30:53.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2186438470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc28149d70 con 0x7fcc2814fd80 2023-06-02T15:30:53.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.882+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2186438470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc281593f0 con 0x7fcc2814fd80 2023-06-02T15:30:53.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.886+0000 7fcc1effd640 1 -- 172.21.15.78:0/2186438470 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fcc20007070 con 0x7fcc2814fd80 2023-06-02T15:30:53.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.886+0000 7fcc1effd640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcc08065c00 0x7fcc080680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:53.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.886+0000 7fcc1effd640 1 -- 172.21.15.78:0/2186438470 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcc20083650 con 0x7fcc2814fd80 2023-06-02T15:30:53.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.886+0000 7fcc2659c640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcc08065c00 0x7fcc080680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:53.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.886+0000 7fcc2659c640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcc08065c00 0x7fcc080680b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc180ae000 tx=0x7fcc180a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:53.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:53.890+0000 7fcc1effd640 1 -- 172.21.15.78:0/2186438470 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fcc20050b20 con 0x7fcc2814fd80 2023-06-02T15:30:54.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.066+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2186438470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcc281ea360 con 0x7fcc2814fd80 2023-06-02T15:30:54.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.738+0000 7fcc1effd640 1 -- 172.21.15.78:0/2186438470 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcc20054140 con 0x7fcc2814fd80 2023-06-02T15:30:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2186438470 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcc08065c00 msgr2=0x7fcc080680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcc08065c00 0x7fcc080680b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcc180ae000 tx=0x7fcc180a7000 comp rx=0 tx=0).stop 2023-06-02T15:30:54.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2186438470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc2814fd80 msgr2=0x7fcc281e6a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc2814fd80 0x7fcc281e6a00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcc2000caa0 tx=0x7fcc2000cf60 comp rx=0 tx=0).stop 2023-06-02T15:30:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2186438470 shutdown_connections 2023-06-02T15:30:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcc08065c00 0x7fcc080680b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcc2814fd80 0x7fcc281e6a00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc280a59e0 0x7fcc280b9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 --2- 172.21.15.78:0/2186438470 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcc2806cfc0 0x7fcc2813ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:54.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2186438470 >> 172.21.15.78:0/2186438470 conn(0x7fcc280a2170 msgr2=0x7fcc2814f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:54.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2186438470 shutdown_connections 2023-06-02T15:30:54.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.742+0000 7fcc2ca37640 1 -- 172.21.15.78:0/2186438470 wait complete. 2023-06-02T15:30:54.774 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-06-02T15:30:54.775 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-02T15:30:54.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.886+0000 7f812a11c640 1 Processor -- start 2023-06-02T15:30:54.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.886+0000 7f812a11c640 1 -- start start 2023-06-02T15:30:54.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f812a11c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f812414f330 0x7f812414bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:54.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f812a11c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240a0020 0x7f81241487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:54.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f812a11c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f812414ba90 con 0x7f81240bc1c0 2023-06-02T15:30:54.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f812a11c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81240a47b0 con 0x7f812414f330 2023-06-02T15:30:54.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f812a11c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f812414f7c0 con 0x7f81240a0020 2023-06-02T15:30:54.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f81237fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f81240bc1c0 0x7f81240a40a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55872/0 (socket says 172.21.15.78:55872) 2023-06-02T15:30:54.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f81237fe640 1 -- 172.21.15.78:0/855997771 learned_addr learned my addr 172.21.15.78:0/855997771 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:54.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f8122ffd640 1 --2- 172.21.15.78:0/855997771 >> v2:172.21.15.78:3300/0 conn(0x7f812414f330 0x7f812414bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:54.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f8123fff640 1 --2- 172.21.15.78:0/855997771 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240a0020 0x7f81241487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:54.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f8122ffd640 1 -- 172.21.15.78:0/855997771 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240a0020 msgr2=0x7f81241487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:54.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f8122ffd640 1 --2- 172.21.15.78:0/855997771 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240a0020 0x7f81241487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:54.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f8122ffd640 1 -- 172.21.15.78:0/855997771 >> v1:172.21.15.78:6789/0 conn(0x7f81240bc1c0 legacy=0x7f81240a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:54.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f8122ffd640 1 -- 172.21.15.78:0/855997771 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812414b440 con 0x7f812414f330 2023-06-02T15:30:54.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f81227fc640 1 -- 172.21.15.78:0/855997771 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926090663 0 0) 0x7f812414ba90 con 0x7f81240bc1c0 2023-06-02T15:30:54.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f8123fff640 1 --2- 172.21.15.78:0/855997771 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240a0020 0x7f81241487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:54.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f8122ffd640 1 --2- 172.21.15.78:0/855997771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f812414f330 0x7f812414bf20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f810c0097c0 tx=0x7f810c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5991b381f2facc0d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:54.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f81227fc640 1 -- 172.21.15.78:0/855997771 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c0ab600 con 0x7f812414f330 2023-06-02T15:30:54.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f81227fc640 1 -- 172.21.15.78:0/855997771 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810c0a7050 con 0x7f812414f330 2023-06-02T15:30:54.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.890+0000 7f81227fc640 1 -- 172.21.15.78:0/855997771 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c0ab980 con 0x7f812414f330 2023-06-02T15:30:54.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- 172.21.15.78:0/855997771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f812414f330 msgr2=0x7f812414bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:54.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 --2- 172.21.15.78:0/855997771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f812414f330 0x7f812414bf20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f810c0097c0 tx=0x7f810c01c3f0 comp rx=0 tx=0).stop 2023-06-02T15:30:54.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- 172.21.15.78:0/855997771 shutdown_connections 2023-06-02T15:30:54.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 --2- 172.21.15.78:0/855997771 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240a0020 0x7f81241487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:54.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 --2- 172.21.15.78:0/855997771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f812414f330 0x7f812414bf20 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:54.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- 172.21.15.78:0/855997771 >> 172.21.15.78:0/855997771 conn(0x7f81240bcf50 msgr2=0x7f81240bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:54.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- 172.21.15.78:0/855997771 shutdown_connections 2023-06-02T15:30:54.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- 172.21.15.78:0/855997771 wait complete. 2023-06-02T15:30:54.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 Processor -- start 2023-06-02T15:30:54.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- start start 2023-06-02T15:30:54.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81240a0020 0x7f812406eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:54.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240bc1c0 0x7f81240bf330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:54.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f812414f330 0x7f812414d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:54.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f812406f400 con 0x7f81240a0020 2023-06-02T15:30:54.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81241e5890 con 0x7f812414f330 2023-06-02T15:30:54.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81240bffd0 con 0x7f81240bc1c0 2023-06-02T15:30:54.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f81237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81240a0020 0x7f812406eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:54.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f81237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81240a0020 0x7f812406eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57334/0 (socket says 172.21.15.78:57334) 2023-06-02T15:30:54.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f81237fe640 1 -- 172.21.15.78:0/1571563073 learned_addr learned my addr 172.21.15.78:0/1571563073 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:54.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f8122ffd640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240bc1c0 0x7f81240bf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:54.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f81237fe640 1 -- 172.21.15.78:0/1571563073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240bc1c0 msgr2=0x7f81240bf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:54.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f81237fe640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240bc1c0 0x7f81240bf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:54.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f8123fff640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f812414f330 0x7f812414d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:54.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f81237fe640 1 -- 172.21.15.78:0/1571563073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f812414f330 msgr2=0x7f812414d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:54.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f81237fe640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f812414f330 0x7f812414d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f81237fe640 1 -- 172.21.15.78:0/1571563073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c009420 con 0x7f81240a0020 2023-06-02T15:30:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f81237fe640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81240a0020 0x7f812406eec0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f811c001570 tx=0x7f811c00cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f811bfff640 1 -- 172.21.15.78:0/1571563073 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00a640 con 0x7f81240a0020 2023-06-02T15:30:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f811bfff640 1 -- 172.21.15.78:0/1571563073 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811c00a7c0 con 0x7f81240a0020 2023-06-02T15:30:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- 172.21.15.78:0/1571563073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81240bcb90 con 0x7f81240a0020 2023-06-02T15:30:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f811bfff640 1 -- 172.21.15.78:0/1571563073 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f811c00ab70 con 0x7f81240a0020 2023-06-02T15:30:54.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.894+0000 7f812a11c640 1 -- 172.21.15.78:0/1571563073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81240bca00 con 0x7f81240a0020 2023-06-02T15:30:54.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.898+0000 7f812a11c640 1 -- 172.21.15.78:0/1571563073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81241584d0 con 0x7f81240a0020 2023-06-02T15:30:54.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.898+0000 7f811bfff640 1 -- 172.21.15.78:0/1571563073 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f811c00acd0 con 0x7f81240a0020 2023-06-02T15:30:54.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.898+0000 7f811bfff640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8104065c00 0x7f81040680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:54.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.898+0000 7f8122ffd640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8104065c00 0x7f81040680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:54.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.898+0000 7f811bfff640 1 -- 172.21.15.78:0/1571563073 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f811c082fe0 con 0x7f81240a0020 2023-06-02T15:30:54.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.898+0000 7f8122ffd640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8104065c00 0x7f81040680b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f810c0ad000 tx=0x7f810c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:54.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:54.902+0000 7f811bfff640 1 -- 172.21.15.78:0/1571563073 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f811c050420 con 0x7f81240a0020 2023-06-02T15:30:55.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.090+0000 7f812a11c640 1 -- 172.21.15.78:0/1571563073 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f81241e5ab0 con 0x7f81240a0020 2023-06-02T15:30:55.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.090+0000 7f811bfff640 1 -- 172.21.15.78:0/1571563073 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3888 (secure 0 0 0) 0x7f811c018020 con 0x7f81240a0020 2023-06-02T15:30:55.099 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:55.099 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/4074209272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4074209272},{"type":"v1","addr":"172.21.15.78:6836","nonce":4074209272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/987093145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":987093145},{"type":"v1","addr":"172.21.15.78:6837","nonce":987093145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-02T15:30:38.611635+0000","modified":"2023-06-02T15:30:54.737249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/3115859297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3115859297},{"type":"v1","addr":"172.21.15.132:6833","nonce":3115859297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-02T15:30:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-06-02T15:30:55.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 -- 172.21.15.78:0/1571563073 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8104065c00 msgr2=0x7f81040680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8104065c00 0x7f81040680b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f810c0ad000 tx=0x7f810c008040 comp rx=0 tx=0).stop 2023-06-02T15:30:55.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 -- 172.21.15.78:0/1571563073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81240a0020 msgr2=0x7f812406eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81240a0020 0x7f812406eec0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f811c001570 tx=0x7f811c00cd20 comp rx=0 tx=0).stop 2023-06-02T15:30:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 -- 172.21.15.78:0/1571563073 shutdown_connections 2023-06-02T15:30:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f812414f330 0x7f812414d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81240bc1c0 0x7f81240bf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8104065c00 0x7f81040680b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 --2- 172.21.15.78:0/1571563073 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81240a0020 0x7f812406eec0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 -- 172.21.15.78:0/1571563073 >> 172.21.15.78:0/1571563073 conn(0x7f81240bcf50 msgr2=0x7f8124147750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 -- 172.21.15.78:0/1571563073 shutdown_connections 2023-06-02T15:30:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.094+0000 7f812a11c640 1 -- 172.21.15.78:0/1571563073 wait complete. 2023-06-02T15:30:55.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:55.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.226+0000 7f2d8d1b8640 1 Processor -- start 2023-06-02T15:30:55.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.226+0000 7f2d8d1b8640 1 -- start start 2023-06-02T15:30:55.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d8d1b8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2d88149e00 0x7f2d880a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d8d1b8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d880bb0e0 con 0x7f2d880ba880 2023-06-02T15:30:55.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d8d1b8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d880a3810 con 0x7f2d8814fe20 2023-06-02T15:30:55.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d8d1b8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d8814a1d0 con 0x7f2d88149e00 2023-06-02T15:30:55.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d8659c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2d880ba880 0x7f2d880a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55876/0 (socket says 172.21.15.78:55876) 2023-06-02T15:30:55.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d8659c640 1 -- 172.21.15.78:0/89537472 learned_addr learned my addr 172.21.15.78:0/89537472 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:55.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d86d9d640 1 --2- 172.21.15.78:0/89537472 >> v2:172.21.15.78:3300/0 conn(0x7f2d88149e00 0x7f2d880a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d86d9d640 1 -- 172.21.15.78:0/89537472 >> v1:172.21.15.132:6789/0 conn(0x7f2d8814fe20 legacy=0x7f2d881502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:55.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d86d9d640 1 -- 172.21.15.78:0/89537472 >> v1:172.21.15.78:6789/0 conn(0x7f2d880ba880 legacy=0x7f2d880a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d85d9b640 1 -- 172.21.15.78:0/89537472 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304698492 0 0) 0x7f2d880bb0e0 con 0x7f2d880ba880 2023-06-02T15:30:55.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d86d9d640 1 -- 172.21.15.78:0/89537472 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d880a3af0 con 0x7f2d88149e00 2023-06-02T15:30:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d86d9d640 1 --2- 172.21.15.78:0/89537472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 0x7f2d880a5bd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0097c0 tx=0x7f2d7c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f0cd8810c96010 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d85d9b640 1 -- 172.21.15.78:0/89537472 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0ab600 con 0x7f2d88149e00 2023-06-02T15:30:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d85d9b640 1 -- 172.21.15.78:0/89537472 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7c0a7050 con 0x7f2d88149e00 2023-06-02T15:30:55.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d85d9b640 1 -- 172.21.15.78:0/89537472 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c0ab980 con 0x7f2d88149e00 2023-06-02T15:30:55.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/89537472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 msgr2=0x7f2d880a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.230+0000 7f2d8d1b8640 1 --2- 172.21.15.78:0/89537472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 0x7f2d880a5bd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0097c0 tx=0x7f2d7c01c440 comp rx=0 tx=0).stop 2023-06-02T15:30:55.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/89537472 shutdown_connections 2023-06-02T15:30:55.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 --2- 172.21.15.78:0/89537472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 0x7f2d880a5bd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/89537472 >> 172.21.15.78:0/89537472 conn(0x7f2d880bcf50 msgr2=0x7f2d880bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:55.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/89537472 shutdown_connections 2023-06-02T15:30:55.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/89537472 wait complete. 2023-06-02T15:30:55.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 Processor -- start 2023-06-02T15:30:55.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- start start 2023-06-02T15:30:55.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d880ba880 0x7f2d8814a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 0x7f2d88142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d8814fe20 0x7f2d88142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d880a61d0 con 0x7f2d88149e00 2023-06-02T15:30:55.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d88070510 con 0x7f2d8814fe20 2023-06-02T15:30:55.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d88071790 con 0x7f2d880ba880 2023-06-02T15:30:55.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 0x7f2d88142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 0x7f2d88142650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57346/0 (socket says 172.21.15.78:57346) 2023-06-02T15:30:55.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8659c640 1 -- 172.21.15.78:0/3914939034 learned_addr learned my addr 172.21.15.78:0/3914939034 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:55.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8659c640 1 -- 172.21.15.78:0/3914939034 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d880ba880 msgr2=0x7f2d8814a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8659c640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d880ba880 0x7f2d8814a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8659c640 1 -- 172.21.15.78:0/3914939034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d8814fe20 msgr2=0x7f2d88142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8659c640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d8814fe20 0x7f2d88142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8659c640 1 -- 172.21.15.78:0/3914939034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d7c009420 con 0x7f2d88149e00 2023-06-02T15:30:55.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8659c640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 0x7f2d88142650 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800c520 tx=0x7f2d7800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:55.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d6f7fe640 1 -- 172.21.15.78:0/3914939034 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d780074e0 con 0x7f2d88149e00 2023-06-02T15:30:55.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d6f7fe640 1 -- 172.21.15.78:0/3914939034 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d78007640 con 0x7f2d88149e00 2023-06-02T15:30:55.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/3914939034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d8815a710 con 0x7f2d88149e00 2023-06-02T15:30:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d6f7fe640 1 -- 172.21.15.78:0/3914939034 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d780049f0 con 0x7f2d88149e00 2023-06-02T15:30:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/3914939034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d881509b0 con 0x7f2d88149e00 2023-06-02T15:30:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.234+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/3914939034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d8815a8a0 con 0x7f2d88149e00 2023-06-02T15:30:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.238+0000 7f2d6f7fe640 1 -- 172.21.15.78:0/3914939034 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f2d7801b360 con 0x7f2d88149e00 2023-06-02T15:30:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.238+0000 7f2d6f7fe640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2d74065c30 0x7f2d740680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.238+0000 7f2d6f7fe640 1 -- 172.21.15.78:0/3914939034 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2d78082a60 con 0x7f2d88149e00 2023-06-02T15:30:55.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.238+0000 7f2d86d9d640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2d74065c30 0x7f2d740680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.238+0000 7f2d86d9d640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2d74065c30 0x7f2d740680e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0ad000 tx=0x7f2d7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:55.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.242+0000 7f2d6f7fe640 1 -- 172.21.15.78:0/3914939034 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f2d78050060 con 0x7f2d88149e00 2023-06-02T15:30:55.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.386+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/3914939034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d8809ff50 con 0x7f2d88149e00 2023-06-02T15:30:55.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d6f7fe640 1 -- 172.21.15.78:0/3914939034 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f2d78021030 con 0x7f2d88149e00 2023-06-02T15:30:55.397 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:55.397 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:55.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/3914939034 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2d74065c30 msgr2=0x7f2d740680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2d74065c30 0x7f2d740680e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c0ad000 tx=0x7f2d7c008040 comp rx=0 tx=0).stop 2023-06-02T15:30:55.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/3914939034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 msgr2=0x7f2d88142650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 0x7f2d88142650 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2d7800c520 tx=0x7f2d7800c9e0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/3914939034 shutdown_connections 2023-06-02T15:30:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d8814fe20 0x7f2d88142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2d74065c30 0x7f2d740680e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2d88149e00 0x7f2d88142650 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 --2- 172.21.15.78:0/3914939034 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2d880ba880 0x7f2d8814a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/3914939034 >> 172.21.15.78:0/3914939034 conn(0x7f2d880bcf50 msgr2=0x7f2d880bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:55.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/3914939034 shutdown_connections 2023-06-02T15:30:55.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.390+0000 7f2d8d1b8640 1 -- 172.21.15.78:0/3914939034 wait complete. 2023-06-02T15:30:55.414 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-06-02T15:30:55.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:30:55.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fddac8a2640 1 Processor -- start 2023-06-02T15:30:55.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fddac8a2640 1 -- start start 2023-06-02T15:30:55.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fddac8a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdda8149e00 0x7fdda80a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fddac8a2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdda814fe20 0x7fdda81502a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fddac8a2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda80bb0e0 con 0x7fdda80ba880 2023-06-02T15:30:55.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fddac8a2640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda814a1d0 con 0x7fdda814fe20 2023-06-02T15:30:55.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fddac8a2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda80a61d0 con 0x7fdda8149e00 2023-06-02T15:30:55.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fdda6d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdda814fe20 0x7fdda81502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fdda6d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdda814fe20 0x7fdda81502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57356/0 (socket says 172.21.15.78:57356) 2023-06-02T15:30:55.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fdda6d9d640 1 -- 172.21.15.78:0/262955528 learned_addr learned my addr 172.21.15.78:0/262955528 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:55.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fdda659c640 1 --2- 172.21.15.78:0/262955528 >> v2:172.21.15.132:3300/0 conn(0x7fdda8149e00 0x7fdda80a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fdda6d9d640 1 -- 172.21.15.78:0/262955528 >> v2:172.21.15.132:3300/0 conn(0x7fdda8149e00 msgr2=0x7fdda80a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:55.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fdda6d9d640 1 --2- 172.21.15.78:0/262955528 >> v2:172.21.15.132:3300/0 conn(0x7fdda8149e00 0x7fdda80a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fdda6d9d640 1 -- 172.21.15.78:0/262955528 >> v1:172.21.15.132:6789/0 conn(0x7fdda80ba880 legacy=0x7fdda80a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:55.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fdda6d9d640 1 -- 172.21.15.78:0/262955528 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda80a3810 con 0x7fdda814fe20 2023-06-02T15:30:55.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.510+0000 7fdda659c640 1 --2- 172.21.15.78:0/262955528 >> v2:172.21.15.132:3300/0 conn(0x7fdda8149e00 0x7fdda80a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:55.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fdda6d9d640 1 --2- 172.21.15.78:0/262955528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda814fe20 0x7fdda81502a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdda806ebb0 tx=0x7fdda001c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c3f01d188256bbe server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:55.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fdda559a640 1 -- 172.21.15.78:0/262955528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda00a5650 con 0x7fdda814fe20 2023-06-02T15:30:55.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fdda559a640 1 -- 172.21.15.78:0/262955528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda00a57b0 con 0x7fdda814fe20 2023-06-02T15:30:55.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fdda559a640 1 -- 172.21.15.78:0/262955528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda00a5b40 con 0x7fdda814fe20 2023-06-02T15:30:55.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fddac8a2640 1 -- 172.21.15.78:0/262955528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda814fe20 msgr2=0x7fdda81502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fddac8a2640 1 --2- 172.21.15.78:0/262955528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda814fe20 0x7fdda81502a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdda806ebb0 tx=0x7fdda001c990 comp rx=0 tx=0).stop 2023-06-02T15:30:55.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fddac8a2640 1 -- 172.21.15.78:0/262955528 shutdown_connections 2023-06-02T15:30:55.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fddac8a2640 1 --2- 172.21.15.78:0/262955528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda814fe20 0x7fdda81502a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fddac8a2640 1 --2- 172.21.15.78:0/262955528 >> v2:172.21.15.132:3300/0 conn(0x7fdda8149e00 0x7fdda80a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fddac8a2640 1 -- 172.21.15.78:0/262955528 >> 172.21.15.78:0/262955528 conn(0x7fdda80bcf50 msgr2=0x7fdda80bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:55.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fddac8a2640 1 -- 172.21.15.78:0/262955528 shutdown_connections 2023-06-02T15:30:55.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fddac8a2640 1 -- 172.21.15.78:0/262955528 wait complete. 2023-06-02T15:30:55.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fddac8a2640 1 Processor -- start 2023-06-02T15:30:55.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.514+0000 7fddac8a2640 1 -- start start 2023-06-02T15:30:55.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fddac8a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdda80ba880 0x7fdda8070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fddac8a2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda8149e00 0x7fdda814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fddac8a2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdda814fe20 0x7fdda814a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fddac8a2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda8070750 con 0x7fdda8149e00 2023-06-02T15:30:55.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fddac8a2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda8071fa0 con 0x7fdda80ba880 2023-06-02T15:30:55.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fddac8a2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda806fb60 con 0x7fdda814fe20 2023-06-02T15:30:55.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda8149e00 0x7fdda814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda5d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda8149e00 0x7fdda814cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57362/0 (socket says 172.21.15.78:57362) 2023-06-02T15:30:55.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda5d9b640 1 -- 172.21.15.78:0/4083122041 learned_addr learned my addr 172.21.15.78:0/4083122041 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:55.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda659c640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdda80ba880 0x7fdda8070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda6d9d640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdda814fe20 0x7fdda814a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda5d9b640 1 -- 172.21.15.78:0/4083122041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdda814fe20 msgr2=0x7fdda814a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda5d9b640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdda814fe20 0x7fdda814a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda5d9b640 1 -- 172.21.15.78:0/4083122041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdda80ba880 msgr2=0x7fdda8070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda5d9b640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdda80ba880 0x7fdda8070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda5d9b640 1 -- 172.21.15.78:0/4083122041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda0009b30 con 0x7fdda8149e00 2023-06-02T15:30:55.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda6d9d640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdda814fe20 0x7fdda814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:55.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda5d9b640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda8149e00 0x7fdda814cec0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c450 tx=0x7fdd9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:55.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdd96ffd640 1 -- 172.21.15.78:0/4083122041 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98012830 con 0x7fdda8149e00 2023-06-02T15:30:55.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdd96ffd640 1 -- 172.21.15.78:0/4083122041 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd980129b0 con 0x7fdda8149e00 2023-06-02T15:30:55.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fddac8a2640 1 -- 172.21.15.78:0/4083122041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda8159700 con 0x7fdda8149e00 2023-06-02T15:30:55.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdd96ffd640 1 -- 172.21.15.78:0/4083122041 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98012d60 con 0x7fdda8149e00 2023-06-02T15:30:55.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fddac8a2640 1 -- 172.21.15.78:0/4083122041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda80a2b00 con 0x7fdda8149e00 2023-06-02T15:30:55.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fddac8a2640 1 -- 172.21.15.78:0/4083122041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda8159890 con 0x7fdda8149e00 2023-06-02T15:30:55.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdd96ffd640 1 -- 172.21.15.78:0/4083122041 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fdd9801c460 con 0x7fdda8149e00 2023-06-02T15:30:55.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdd96ffd640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdd88065c30 0x7fdd880680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda659c640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdd88065c30 0x7fdd880680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdd96ffd640 1 -- 172.21.15.78:0/4083122041 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fdd980833b0 con 0x7fdda8149e00 2023-06-02T15:30:55.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.518+0000 7fdda659c640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdd88065c30 0x7fdd880680e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00a9a0 tx=0x7fdd9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:55.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.522+0000 7fdd96ffd640 1 -- 172.21.15.78:0/4083122041 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fdd98050920 con 0x7fdda8149e00 2023-06-02T15:30:55.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.658+0000 7fddac8a2640 1 -- 172.21.15.78:0/4083122041 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdda814d700 con 0x7fdd88065c30 2023-06-02T15:30:55.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.682+0000 7fdd96ffd640 1 -- 172.21.15.78:0/4083122041 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367574 (secure 0 0 0) 0x7fdda814d700 con 0x7fdd88065c30 2023-06-02T15:30:55.696 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:55.698 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:30:55.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 -- 172.21.15.78:0/4083122041 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdd88065c30 msgr2=0x7fdd880680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdd88065c30 0x7fdd880680e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00a9a0 tx=0x7fdd9c008040 comp rx=0 tx=0).stop 2023-06-02T15:30:55.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 -- 172.21.15.78:0/4083122041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda8149e00 msgr2=0x7fdda814cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda8149e00 0x7fdda814cec0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdd9800c450 tx=0x7fdd9800c910 comp rx=0 tx=0).stop 2023-06-02T15:30:55.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 -- 172.21.15.78:0/4083122041 shutdown_connections 2023-06-02T15:30:55.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdda814fe20 0x7fdda814a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdd88065c30 0x7fdd880680e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdda8149e00 0x7fdda814cec0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 --2- 172.21.15.78:0/4083122041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdda80ba880 0x7fdda8070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 -- 172.21.15.78:0/4083122041 >> 172.21.15.78:0/4083122041 conn(0x7fdda80bcf50 msgr2=0x7fdda80bbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:55.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 -- 172.21.15.78:0/4083122041 shutdown_connections 2023-06-02T15:30:55.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.686+0000 7fddac8a2640 1 -- 172.21.15.78:0/4083122041 wait complete. 2023-06-02T15:30:55.712 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-06-02T15:30:55.223967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594753,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69464,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":754905256,"statfs":{"total":773094113280,"available":773022982144,"internally_reserved":0,"allocated":2318336,"data_stored":2065630,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004480"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.713456+0000","last_change":"2023-06-02T15:30:42.711237+0000","last_active":"2023-06-02T15:30:42.713456+0000","last_peered":"2023-06-02T15:30:42.713456+0000","last_clean":"2023-06-02T15:30:42.713456+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:30:42.713456+0000","last_undegraded":"2023-06-02T15:30:42.713456+0000","last_fullsized":"2023-06-02T15:30:42.713456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669011+0000","last_change":"2023-06-02T15:30:38.275721+0000","last_active":"2023-06-02T15:30:42.669011+0000","last_peered":"2023-06-02T15:30:42.669011+0000","last_clean":"2023-06-02T15:30:42.669011+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:30:42.669011+0000","last_undegraded":"2023-06-02T15:30:42.669011+0000","last_fullsized":"2023-06-02T15:30:42.669011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659411+0000","last_change":"2023-06-02T15:30:38.638911+0000","last_active":"2023-06-02T15:30:42.659411+0000","last_peered":"2023-06-02T15:30:42.659411+0000","last_clean":"2023-06-02T15:30:42.659411+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:30:42.659411+0000","last_undegraded":"2023-06-02T15:30:42.659411+0000","last_fullsized":"2023-06-02T15:30:42.659411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.709825+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:30:42.709825+0000","last_peered":"2023-06-02T15:30:42.709825+0000","last_clean":"2023-06-02T15:30:42.709825+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:30:42.709825+0000","last_undegraded":"2023-06-02T15:30:42.709825+0000","last_fullsized":"2023-06-02T15:30:42.709825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:23:12.455644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674342+0000","last_change":"2023-06-02T15:30:38.282116+0000","last_active":"2023-06-02T15:30:42.674342+0000","last_peered":"2023-06-02T15:30:42.674342+0000","last_clean":"2023-06-02T15:30:42.674342+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:30:42.674342+0000","last_undegraded":"2023-06-02T15:30:42.674342+0000","last_fullsized":"2023-06-02T15:30:42.674342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666523+0000","last_change":"2023-06-02T15:30:38.638342+0000","last_active":"2023-06-02T15:30:42.666523+0000","last_peered":"2023-06-02T15:30:42.666523+0000","last_clean":"2023-06-02T15:30:42.666523+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:30:42.666523+0000","last_undegraded":"2023-06-02T15:30:42.666523+0000","last_fullsized":"2023-06-02T15:30:42.666523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.724432+0000","last_change":"2023-06-02T15:30:42.715416+0000","last_active":"2023-06-02T15:30:42.724432+0000","last_peered":"2023-06-02T15:30:42.724432+0000","last_clean":"2023-06-02T15:30:42.724432+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:30:42.724432+0000","last_undegraded":"2023-06-02T15:30:42.724432+0000","last_fullsized":"2023-06-02T15:30:42.724432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680371+0000","last_change":"2023-06-02T15:30:38.278973+0000","last_active":"2023-06-02T15:30:42.680371+0000","last_peered":"2023-06-02T15:30:42.680371+0000","last_clean":"2023-06-02T15:30:42.680371+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:30:42.680371+0000","last_undegraded":"2023-06-02T15:30:42.680371+0000","last_fullsized":"2023-06-02T15:30:42.680371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661168+0000","last_change":"2023-06-02T15:30:38.644549+0000","last_active":"2023-06-02T15:30:42.661168+0000","last_peered":"2023-06-02T15:30:42.661168+0000","last_clean":"2023-06-02T15:30:42.661168+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:30:42.661168+0000","last_undegraded":"2023-06-02T15:30:42.661168+0000","last_fullsized":"2023-06-02T15:30:42.661168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:26.088195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725079+0000","last_change":"2023-06-02T15:30:42.707090+0000","last_active":"2023-06-02T15:30:42.725079+0000","last_peered":"2023-06-02T15:30:42.725079+0000","last_clean":"2023-06-02T15:30:42.725079+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:30:42.725079+0000","last_undegraded":"2023-06-02T15:30:42.725079+0000","last_fullsized":"2023-06-02T15:30:42.725079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.667871+0000","last_change":"2023-06-02T15:30:38.269876+0000","last_active":"2023-06-02T15:30:42.667871+0000","last_peered":"2023-06-02T15:30:42.667871+0000","last_clean":"2023-06-02T15:30:42.667871+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:30:42.667871+0000","last_undegraded":"2023-06-02T15:30:42.667871+0000","last_fullsized":"2023-06-02T15:30:42.667871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661361+0000","last_change":"2023-06-02T15:30:38.639635+0000","last_active":"2023-06-02T15:30:42.661361+0000","last_peered":"2023-06-02T15:30:42.661361+0000","last_clean":"2023-06-02T15:30:42.661361+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:30:42.661361+0000","last_undegraded":"2023-06-02T15:30:42.661361+0000","last_fullsized":"2023-06-02T15:30:42.661361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:56:57.260064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.702939+0000","last_change":"2023-06-02T15:30:42.699623+0000","last_active":"2023-06-02T15:30:42.702939+0000","last_peered":"2023-06-02T15:30:42.702939+0000","last_clean":"2023-06-02T15:30:42.702939+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:30:42.702939+0000","last_undegraded":"2023-06-02T15:30:42.702939+0000","last_fullsized":"2023-06-02T15:30:42.702939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:18.327051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668971+0000","last_change":"2023-06-02T15:30:38.263534+0000","last_active":"2023-06-02T15:30:42.668971+0000","last_peered":"2023-06-02T15:30:42.668971+0000","last_clean":"2023-06-02T15:30:42.668971+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:30:42.668971+0000","last_undegraded":"2023-06-02T15:30:42.668971+0000","last_fullsized":"2023-06-02T15:30:42.668971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.653780+0000","last_change":"2023-06-02T15:30:38.644102+0000","last_active":"2023-06-02T15:30:42.653780+0000","last_peered":"2023-06-02T15:30:42.653780+0000","last_clean":"2023-06-02T15:30:42.653780+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:30:42.653780+0000","last_undegraded":"2023-06-02T15:30:42.653780+0000","last_fullsized":"2023-06-02T15:30:42.653780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:11.864794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.709755+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:30:42.709755+0000","last_peered":"2023-06-02T15:30:42.709755+0000","last_clean":"2023-06-02T15:30:42.709755+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:30:42.709755+0000","last_undegraded":"2023-06-02T15:30:42.709755+0000","last_fullsized":"2023-06-02T15:30:42.709755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:16:13.363523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661437+0000","last_change":"2023-06-02T15:30:38.272143+0000","last_active":"2023-06-02T15:30:42.661437+0000","last_peered":"2023-06-02T15:30:42.661437+0000","last_clean":"2023-06-02T15:30:42.661437+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:30:42.661437+0000","last_undegraded":"2023-06-02T15:30:42.661437+0000","last_fullsized":"2023-06-02T15:30:42.661437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673969+0000","last_change":"2023-06-02T15:30:38.650795+0000","last_active":"2023-06-02T15:30:42.673969+0000","last_peered":"2023-06-02T15:30:42.673969+0000","last_clean":"2023-06-02T15:30:42.673969+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:30:42.673969+0000","last_undegraded":"2023-06-02T15:30:42.673969+0000","last_fullsized":"2023-06-02T15:30:42.673969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725571+0000","last_change":"2023-06-02T15:30:42.706975+0000","last_active":"2023-06-02T15:30:42.725571+0000","last_peered":"2023-06-02T15:30:42.725571+0000","last_clean":"2023-06-02T15:30:42.725571+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:30:42.725571+0000","last_undegraded":"2023-06-02T15:30:42.725571+0000","last_fullsized":"2023-06-02T15:30:42.725571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:32.007544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675638+0000","last_change":"2023-06-02T15:30:38.290129+0000","last_active":"2023-06-02T15:30:42.675638+0000","last_peered":"2023-06-02T15:30:42.675638+0000","last_clean":"2023-06-02T15:30:42.675638+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:30:42.675638+0000","last_undegraded":"2023-06-02T15:30:42.675638+0000","last_fullsized":"2023-06-02T15:30:42.675638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.670451+0000","last_change":"2023-06-02T15:30:38.656679+0000","last_active":"2023-06-02T15:30:42.670451+0000","last_peered":"2023-06-02T15:30:42.670451+0000","last_clean":"2023-06-02T15:30:42.670451+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:30:42.670451+0000","last_undegraded":"2023-06-02T15:30:42.670451+0000","last_fullsized":"2023-06-02T15:30:42.670451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.707868+0000","last_change":"2023-06-02T15:30:42.705633+0000","last_active":"2023-06-02T15:30:42.707868+0000","last_peered":"2023-06-02T15:30:42.707868+0000","last_clean":"2023-06-02T15:30:42.707868+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:30:42.707868+0000","last_undegraded":"2023-06-02T15:30:42.707868+0000","last_fullsized":"2023-06-02T15:30:42.707868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674076+0000","last_change":"2023-06-02T15:30:38.273154+0000","last_active":"2023-06-02T15:30:42.674076+0000","last_peered":"2023-06-02T15:30:42.674076+0000","last_clean":"2023-06-02T15:30:42.674076+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:30:42.674076+0000","last_undegraded":"2023-06-02T15:30:42.674076+0000","last_fullsized":"2023-06-02T15:30:42.674076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665225+0000","last_change":"2023-06-02T15:30:38.647445+0000","last_active":"2023-06-02T15:30:42.665225+0000","last_peered":"2023-06-02T15:30:42.665225+0000","last_clean":"2023-06-02T15:30:42.665225+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:30:42.665225+0000","last_undegraded":"2023-06-02T15:30:42.665225+0000","last_fullsized":"2023-06-02T15:30:42.665225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:34.366098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675284+0000","last_change":"2023-06-02T15:30:38.650927+0000","last_active":"2023-06-02T15:30:42.675284+0000","last_peered":"2023-06-02T15:30:42.675284+0000","last_clean":"2023-06-02T15:30:42.675284+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:30:42.675284+0000","last_undegraded":"2023-06-02T15:30:42.675284+0000","last_fullsized":"2023-06-02T15:30:42.675284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669099+0000","last_change":"2023-06-02T15:30:38.274472+0000","last_active":"2023-06-02T15:30:42.669099+0000","last_peered":"2023-06-02T15:30:42.669099+0000","last_clean":"2023-06-02T15:30:42.669099+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:30:42.669099+0000","last_undegraded":"2023-06-02T15:30:42.669099+0000","last_fullsized":"2023-06-02T15:30:42.669099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725651+0000","last_change":"2023-06-02T15:30:42.710065+0000","last_active":"2023-06-02T15:30:42.725651+0000","last_peered":"2023-06-02T15:30:42.725651+0000","last_clean":"2023-06-02T15:30:42.725651+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:30:42.725651+0000","last_undegraded":"2023-06-02T15:30:42.725651+0000","last_fullsized":"2023-06-02T15:30:42.725651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666632+0000","last_change":"2023-06-02T15:30:38.656769+0000","last_active":"2023-06-02T15:30:42.666632+0000","last_peered":"2023-06-02T15:30:42.666632+0000","last_clean":"2023-06-02T15:30:42.666632+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:30:42.666632+0000","last_undegraded":"2023-06-02T15:30:42.666632+0000","last_fullsized":"2023-06-02T15:30:42.666632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.677097+0000","last_change":"2023-06-02T15:30:38.275134+0000","last_active":"2023-06-02T15:30:42.677097+0000","last_peered":"2023-06-02T15:30:42.677097+0000","last_clean":"2023-06-02T15:30:42.677097+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:30:42.677097+0000","last_undegraded":"2023-06-02T15:30:42.677097+0000","last_fullsized":"2023-06-02T15:30:42.677097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725199+0000","last_change":"2023-06-02T15:30:42.706722+0000","last_active":"2023-06-02T15:30:42.725199+0000","last_peered":"2023-06-02T15:30:42.725199+0000","last_clean":"2023-06-02T15:30:42.725199+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:30:42.725199+0000","last_undegraded":"2023-06-02T15:30:42.725199+0000","last_fullsized":"2023-06-02T15:30:42.725199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.693560+0000","last_change":"2023-06-02T15:30:38.289736+0000","last_active":"2023-06-02T15:30:42.693560+0000","last_peered":"2023-06-02T15:30:42.693560+0000","last_clean":"2023-06-02T15:30:42.693560+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:30:42.693560+0000","last_undegraded":"2023-06-02T15:30:42.693560+0000","last_fullsized":"2023-06-02T15:30:42.693560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:43:04.205096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675744+0000","last_change":"2023-06-02T15:30:38.642841+0000","last_active":"2023-06-02T15:30:42.675744+0000","last_peered":"2023-06-02T15:30:42.675744+0000","last_clean":"2023-06-02T15:30:42.675744+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:30:42.675744+0000","last_undegraded":"2023-06-02T15:30:42.675744+0000","last_fullsized":"2023-06-02T15:30:42.675744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.722145+0000","last_change":"2023-06-02T15:30:42.720577+0000","last_active":"2023-06-02T15:30:42.722145+0000","last_peered":"2023-06-02T15:30:42.722145+0000","last_clean":"2023-06-02T15:30:42.722145+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:30:42.722145+0000","last_undegraded":"2023-06-02T15:30:42.722145+0000","last_fullsized":"2023-06-02T15:30:42.722145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:48:54.291389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-02T15:30:46.140877+0000","last_change":"2023-06-02T15:30:38.276703+0000","last_active":"2023-06-02T15:30:46.140877+0000","last_peered":"2023-06-02T15:30:46.140877+0000","last_clean":"2023-06-02T15:30:46.140877+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:30:46.140877+0000","last_undegraded":"2023-06-02T15:30:46.140877+0000","last_fullsized":"2023-06-02T15:30:46.140877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661581+0000","last_change":"2023-06-02T15:30:38.634436+0000","last_active":"2023-06-02T15:30:42.661581+0000","last_peered":"2023-06-02T15:30:42.661581+0000","last_clean":"2023-06-02T15:30:42.661581+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:30:42.661581+0000","last_undegraded":"2023-06-02T15:30:42.661581+0000","last_fullsized":"2023-06-02T15:30:42.661581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.710264+0000","last_change":"2023-06-02T15:30:42.707445+0000","last_active":"2023-06-02T15:30:42.710264+0000","last_peered":"2023-06-02T15:30:42.710264+0000","last_clean":"2023-06-02T15:30:42.710264+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:30:42.710264+0000","last_undegraded":"2023-06-02T15:30:42.710264+0000","last_fullsized":"2023-06-02T15:30:42.710264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675836+0000","last_change":"2023-06-02T15:30:38.649326+0000","last_active":"2023-06-02T15:30:42.675836+0000","last_peered":"2023-06-02T15:30:42.675836+0000","last_clean":"2023-06-02T15:30:42.675836+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:30:42.675836+0000","last_undegraded":"2023-06-02T15:30:42.675836+0000","last_fullsized":"2023-06-02T15:30:42.675836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665271+0000","last_change":"2023-06-02T15:30:33.407154+0000","last_active":"2023-06-02T15:30:42.665271+0000","last_peered":"2023-06-02T15:30:42.665271+0000","last_clean":"2023-06-02T15:30:42.665271+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:30:42.665271+0000","last_undegraded":"2023-06-02T15:30:42.665271+0000","last_fullsized":"2023-06-02T15:30:42.665271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680583+0000","last_change":"2023-06-02T15:30:38.279321+0000","last_active":"2023-06-02T15:30:42.680583+0000","last_peered":"2023-06-02T15:30:42.680583+0000","last_clean":"2023-06-02T15:30:42.680583+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:30:42.680583+0000","last_undegraded":"2023-06-02T15:30:42.680583+0000","last_fullsized":"2023-06-02T15:30:42.680583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.717152+0000","last_change":"2023-06-02T15:30:42.715780+0000","last_active":"2023-06-02T15:30:42.717152+0000","last_peered":"2023-06-02T15:30:42.717152+0000","last_clean":"2023-06-02T15:30:42.717152+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:30:42.717152+0000","last_undegraded":"2023-06-02T15:30:42.717152+0000","last_fullsized":"2023-06-02T15:30:42.717152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668772+0000","last_change":"2023-06-02T15:30:38.632171+0000","last_active":"2023-06-02T15:30:42.668772+0000","last_peered":"2023-06-02T15:30:42.668772+0000","last_clean":"2023-06-02T15:30:42.668772+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:30:42.668772+0000","last_undegraded":"2023-06-02T15:30:42.668772+0000","last_fullsized":"2023-06-02T15:30:42.668772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666211+0000","last_change":"2023-06-02T15:30:33.655215+0000","last_active":"2023-06-02T15:30:42.666211+0000","last_peered":"2023-06-02T15:30:42.666211+0000","last_clean":"2023-06-02T15:30:42.666211+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:30:42.666211+0000","last_undegraded":"2023-06-02T15:30:42.666211+0000","last_fullsized":"2023-06-02T15:30:42.666211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678450+0000","last_change":"2023-06-02T15:30:38.277096+0000","last_active":"2023-06-02T15:30:42.678450+0000","last_peered":"2023-06-02T15:30:42.678450+0000","last_clean":"2023-06-02T15:30:42.678450+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:30:42.678450+0000","last_undegraded":"2023-06-02T15:30:42.678450+0000","last_fullsized":"2023-06-02T15:30:42.678450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.720822+0000","last_change":"2023-06-02T15:30:42.698823+0000","last_active":"2023-06-02T15:30:42.720822+0000","last_peered":"2023-06-02T15:30:42.720822+0000","last_clean":"2023-06-02T15:30:42.720822+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:30:42.720822+0000","last_undegraded":"2023-06-02T15:30:42.720822+0000","last_fullsized":"2023-06-02T15:30:42.720822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673925+0000","last_change":"2023-06-02T15:30:38.656372+0000","last_active":"2023-06-02T15:30:42.673925+0000","last_peered":"2023-06-02T15:30:42.673925+0000","last_clean":"2023-06-02T15:30:42.673925+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:30:42.673925+0000","last_undegraded":"2023-06-02T15:30:42.673925+0000","last_fullsized":"2023-06-02T15:30:42.673925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663851+0000","last_change":"2023-06-02T15:30:33.959737+0000","last_active":"2023-06-02T15:30:42.663851+0000","last_peered":"2023-06-02T15:30:42.663851+0000","last_clean":"2023-06-02T15:30:42.663851+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:30:42.663851+0000","last_undegraded":"2023-06-02T15:30:42.663851+0000","last_fullsized":"2023-06-02T15:30:42.663851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674797+0000","last_change":"2023-06-02T15:30:38.281667+0000","last_active":"2023-06-02T15:30:42.674797+0000","last_peered":"2023-06-02T15:30:42.674797+0000","last_clean":"2023-06-02T15:30:42.674797+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:30:42.674797+0000","last_undegraded":"2023-06-02T15:30:42.674797+0000","last_fullsized":"2023-06-02T15:30:42.674797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.718942+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:30:42.718942+0000","last_peered":"2023-06-02T15:30:42.718942+0000","last_clean":"2023-06-02T15:30:42.718942+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:30:42.718942+0000","last_undegraded":"2023-06-02T15:30:42.718942+0000","last_fullsized":"2023-06-02T15:30:42.718942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:02:01.714482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.660273+0000","last_change":"2023-06-02T15:30:38.646642+0000","last_active":"2023-06-02T15:30:42.660273+0000","last_peered":"2023-06-02T15:30:42.660273+0000","last_clean":"2023-06-02T15:30:42.660273+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:30:42.660273+0000","last_undegraded":"2023-06-02T15:30:42.660273+0000","last_fullsized":"2023-06-02T15:30:42.660273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669807+0000","last_change":"2023-06-02T15:30:33.413542+0000","last_active":"2023-06-02T15:30:42.669807+0000","last_peered":"2023-06-02T15:30:42.669807+0000","last_clean":"2023-06-02T15:30:42.669807+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:30:42.669807+0000","last_undegraded":"2023-06-02T15:30:42.669807+0000","last_fullsized":"2023-06-02T15:30:42.669807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-02T15:30:43.440541+0000","last_change":"2023-06-02T15:30:38.270941+0000","last_active":"2023-06-02T15:30:43.440541+0000","last_peered":"2023-06-02T15:30:43.440541+0000","last_clean":"2023-06-02T15:30:43.440541+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:30:43.440541+0000","last_undegraded":"2023-06-02T15:30:43.440541+0000","last_fullsized":"2023-06-02T15:30:43.440541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.711091+0000","last_change":"2023-06-02T15:30:42.702383+0000","last_active":"2023-06-02T15:30:42.711091+0000","last_peered":"2023-06-02T15:30:42.711091+0000","last_clean":"2023-06-02T15:30:42.711091+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:30:42.711091+0000","last_undegraded":"2023-06-02T15:30:42.711091+0000","last_fullsized":"2023-06-02T15:30:42.711091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:49:31.222291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.670681+0000","last_change":"2023-06-02T15:30:38.642398+0000","last_active":"2023-06-02T15:30:42.670681+0000","last_peered":"2023-06-02T15:30:42.670681+0000","last_clean":"2023-06-02T15:30:42.670681+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:30:42.670681+0000","last_undegraded":"2023-06-02T15:30:42.670681+0000","last_fullsized":"2023-06-02T15:30:42.670681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665469+0000","last_change":"2023-06-02T15:30:38.263733+0000","last_active":"2023-06-02T15:30:42.665469+0000","last_peered":"2023-06-02T15:30:42.665469+0000","last_clean":"2023-06-02T15:30:42.665469+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:30:42.665469+0000","last_undegraded":"2023-06-02T15:30:42.665469+0000","last_fullsized":"2023-06-02T15:30:42.665469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687342+0000","last_change":"2023-06-02T15:30:34.413807+0000","last_active":"2023-06-02T15:30:42.687342+0000","last_peered":"2023-06-02T15:30:42.687342+0000","last_clean":"2023-06-02T15:30:42.687342+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:30:42.687342+0000","last_undegraded":"2023-06-02T15:30:42.687342+0000","last_fullsized":"2023-06-02T15:30:42.687342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_clean_scrub_stamp":"2023-06-02T15:30:33.390390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:47:50.762629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678965+0000","last_change":"2023-06-02T15:30:33.411973+0000","last_active":"2023-06-02T15:30:42.678965+0000","last_peered":"2023-06-02T15:30:42.678965+0000","last_clean":"2023-06-02T15:30:42.678965+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:30:42.678965+0000","last_undegraded":"2023-06-02T15:30:42.678965+0000","last_fullsized":"2023-06-02T15:30:42.678965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721145+0000","last_change":"2023-06-02T15:30:42.712421+0000","last_active":"2023-06-02T15:30:42.721145+0000","last_peered":"2023-06-02T15:30:42.721145+0000","last_clean":"2023-06-02T15:30:42.721145+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:30:42.721145+0000","last_undegraded":"2023-06-02T15:30:42.721145+0000","last_fullsized":"2023-06-02T15:30:42.721145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:38:29.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679112+0000","last_change":"2023-06-02T15:30:38.653404+0000","last_active":"2023-06-02T15:30:42.679112+0000","last_peered":"2023-06-02T15:30:42.679112+0000","last_clean":"2023-06-02T15:30:42.679112+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:30:42.679112+0000","last_undegraded":"2023-06-02T15:30:42.679112+0000","last_fullsized":"2023-06-02T15:30:42.679112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675372+0000","last_change":"2023-06-02T15:30:38.269833+0000","last_active":"2023-06-02T15:30:42.675372+0000","last_peered":"2023-06-02T15:30:42.675372+0000","last_clean":"2023-06-02T15:30:42.675372+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:30:42.675372+0000","last_undegraded":"2023-06-02T15:30:42.675372+0000","last_fullsized":"2023-06-02T15:30:42.675372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:06:46.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687434+0000","last_change":"2023-06-02T15:30:33.654728+0000","last_active":"2023-06-02T15:30:42.687434+0000","last_peered":"2023-06-02T15:30:42.687434+0000","last_clean":"2023-06-02T15:30:42.687434+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:30:42.687434+0000","last_undegraded":"2023-06-02T15:30:42.687434+0000","last_fullsized":"2023-06-02T15:30:42.687434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:05:26.791938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.710087+0000","last_change":"2023-06-02T15:30:42.705191+0000","last_active":"2023-06-02T15:30:42.710087+0000","last_peered":"2023-06-02T15:30:42.710087+0000","last_clean":"2023-06-02T15:30:42.710087+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:30:42.710087+0000","last_undegraded":"2023-06-02T15:30:42.710087+0000","last_fullsized":"2023-06-02T15:30:42.710087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:22.765485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678163+0000","last_change":"2023-06-02T15:30:38.642359+0000","last_active":"2023-06-02T15:30:42.678163+0000","last_peered":"2023-06-02T15:30:42.678163+0000","last_clean":"2023-06-02T15:30:42.678163+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:30:42.678163+0000","last_undegraded":"2023-06-02T15:30:42.678163+0000","last_fullsized":"2023-06-02T15:30:42.678163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661971+0000","last_change":"2023-06-02T15:30:38.257531+0000","last_active":"2023-06-02T15:30:42.661971+0000","last_peered":"2023-06-02T15:30:42.661971+0000","last_clean":"2023-06-02T15:30:42.661971+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:30:42.661971+0000","last_undegraded":"2023-06-02T15:30:42.661971+0000","last_fullsized":"2023-06-02T15:30:42.661971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668731+0000","last_change":"2023-06-02T15:30:33.655250+0000","last_active":"2023-06-02T15:30:42.668731+0000","last_peered":"2023-06-02T15:30:42.668731+0000","last_clean":"2023-06-02T15:30:42.668731+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:30:42.668731+0000","last_undegraded":"2023-06-02T15:30:42.668731+0000","last_fullsized":"2023-06-02T15:30:42.668731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.695770+0000","last_change":"2023-06-02T15:30:42.693557+0000","last_active":"2023-06-02T15:30:42.695770+0000","last_peered":"2023-06-02T15:30:42.695770+0000","last_clean":"2023-06-02T15:30:42.695770+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:30:42.695770+0000","last_undegraded":"2023-06-02T15:30:42.695770+0000","last_fullsized":"2023-06-02T15:30:42.695770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665084+0000","last_change":"2023-06-02T15:30:38.645488+0000","last_active":"2023-06-02T15:30:42.665084+0000","last_peered":"2023-06-02T15:30:42.665084+0000","last_clean":"2023-06-02T15:30:42.665084+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:30:42.665084+0000","last_undegraded":"2023-06-02T15:30:42.665084+0000","last_fullsized":"2023-06-02T15:30:42.665084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669942+0000","last_change":"2023-06-02T15:30:38.283390+0000","last_active":"2023-06-02T15:30:42.669942+0000","last_peered":"2023-06-02T15:30:42.669942+0000","last_clean":"2023-06-02T15:30:42.669942+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:30:42.669942+0000","last_undegraded":"2023-06-02T15:30:42.669942+0000","last_fullsized":"2023-06-02T15:30:42.669942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687529+0000","last_change":"2023-06-02T15:30:33.653937+0000","last_active":"2023-06-02T15:30:42.687529+0000","last_peered":"2023-06-02T15:30:42.687529+0000","last_clean":"2023-06-02T15:30:42.687529+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:30:42.687529+0000","last_undegraded":"2023-06-02T15:30:42.687529+0000","last_fullsized":"2023-06-02T15:30:42.687529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.727044+0000","last_change":"2023-06-02T15:30:42.723169+0000","last_active":"2023-06-02T15:30:42.727044+0000","last_peered":"2023-06-02T15:30:42.727044+0000","last_clean":"2023-06-02T15:30:42.727044+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:30:42.727044+0000","last_undegraded":"2023-06-02T15:30:42.727044+0000","last_fullsized":"2023-06-02T15:30:42.727044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679007+0000","last_change":"2023-06-02T15:30:38.640964+0000","last_active":"2023-06-02T15:30:42.679007+0000","last_peered":"2023-06-02T15:30:42.679007+0000","last_clean":"2023-06-02T15:30:42.679007+0000","last_became_active":"2023-06-02T15:30:38.640643+0000","last_became_peered":"2023-06-02T15:30:38.640643+0000","last_unstale":"2023-06-02T15:30:42.679007+0000","last_undegraded":"2023-06-02T15:30:42.679007+0000","last_fullsized":"2023-06-02T15:30:42.679007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675412+0000","last_change":"2023-06-02T15:30:38.281851+0000","last_active":"2023-06-02T15:30:42.675412+0000","last_peered":"2023-06-02T15:30:42.675412+0000","last_clean":"2023-06-02T15:30:42.675412+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:30:42.675412+0000","last_undegraded":"2023-06-02T15:30:42.675412+0000","last_fullsized":"2023-06-02T15:30:42.675412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.715894+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:30:42.715894+0000","last_peered":"2023-06-02T15:30:42.715894+0000","last_clean":"2023-06-02T15:30:42.715894+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:30:42.715894+0000","last_undegraded":"2023-06-02T15:30:42.715894+0000","last_fullsized":"2023-06-02T15:30:42.715894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:44.594461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666012+0000","last_change":"2023-06-02T15:30:38.638725+0000","last_active":"2023-06-02T15:30:42.666012+0000","last_peered":"2023-06-02T15:30:42.666012+0000","last_clean":"2023-06-02T15:30:42.666012+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:30:42.666012+0000","last_undegraded":"2023-06-02T15:30:42.666012+0000","last_fullsized":"2023-06-02T15:30:42.666012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.660551+0000","last_change":"2023-06-02T15:30:38.269278+0000","last_active":"2023-06-02T15:30:42.660551+0000","last_peered":"2023-06-02T15:30:42.660551+0000","last_clean":"2023-06-02T15:30:42.660551+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:30:42.660551+0000","last_undegraded":"2023-06-02T15:30:42.660551+0000","last_fullsized":"2023-06-02T15:30:42.660551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721194+0000","last_change":"2023-06-02T15:30:42.713071+0000","last_active":"2023-06-02T15:30:42.721194+0000","last_peered":"2023-06-02T15:30:42.721194+0000","last_clean":"2023-06-02T15:30:42.721194+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:30:42.721194+0000","last_undegraded":"2023-06-02T15:30:42.721194+0000","last_fullsized":"2023-06-02T15:30:42.721194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663661+0000","last_change":"2023-06-02T15:30:38.636565+0000","last_active":"2023-06-02T15:30:42.663661+0000","last_peered":"2023-06-02T15:30:42.663661+0000","last_clean":"2023-06-02T15:30:42.663661+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:30:42.663661+0000","last_undegraded":"2023-06-02T15:30:42.663661+0000","last_fullsized":"2023-06-02T15:30:42.663661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:56:18.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.664010+0000","last_change":"2023-06-02T15:30:38.277404+0000","last_active":"2023-06-02T15:30:42.664010+0000","last_peered":"2023-06-02T15:30:42.664010+0000","last_clean":"2023-06-02T15:30:42.664010+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:30:42.664010+0000","last_undegraded":"2023-06-02T15:30:42.664010+0000","last_fullsized":"2023-06-02T15:30:42.664010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.702894+0000","last_change":"2023-06-02T15:30:42.697724+0000","last_active":"2023-06-02T15:30:42.702894+0000","last_peered":"2023-06-02T15:30:42.702894+0000","last_clean":"2023-06-02T15:30:42.702894+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:30:42.702894+0000","last_undegraded":"2023-06-02T15:30:42.702894+0000","last_fullsized":"2023-06-02T15:30:42.702894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663344+0000","last_change":"2023-06-02T15:30:38.640532+0000","last_active":"2023-06-02T15:30:42.663344+0000","last_peered":"2023-06-02T15:30:42.663344+0000","last_clean":"2023-06-02T15:30:42.663344+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:30:42.663344+0000","last_undegraded":"2023-06-02T15:30:42.663344+0000","last_fullsized":"2023-06-02T15:30:42.663344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674886+0000","last_change":"2023-06-02T15:30:38.281909+0000","last_active":"2023-06-02T15:30:42.674886+0000","last_peered":"2023-06-02T15:30:42.674886+0000","last_clean":"2023-06-02T15:30:42.674886+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:30:42.674886+0000","last_undegraded":"2023-06-02T15:30:42.674886+0000","last_fullsized":"2023-06-02T15:30:42.674886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.717898+0000","last_change":"2023-06-02T15:30:42.716337+0000","last_active":"2023-06-02T15:30:42.717898+0000","last_peered":"2023-06-02T15:30:42.717898+0000","last_clean":"2023-06-02T15:30:42.717898+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:30:42.717898+0000","last_undegraded":"2023-06-02T15:30:42.717898+0000","last_fullsized":"2023-06-02T15:30:42.717898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665919+0000","last_change":"2023-06-02T15:30:38.651270+0000","last_active":"2023-06-02T15:30:42.665919+0000","last_peered":"2023-06-02T15:30:42.665919+0000","last_clean":"2023-06-02T15:30:42.665919+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:30:42.665919+0000","last_undegraded":"2023-06-02T15:30:42.665919+0000","last_fullsized":"2023-06-02T15:30:42.665919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.667614+0000","last_change":"2023-06-02T15:30:38.277304+0000","last_active":"2023-06-02T15:30:42.667614+0000","last_peered":"2023-06-02T15:30:42.667614+0000","last_clean":"2023-06-02T15:30:42.667614+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:30:42.667614+0000","last_undegraded":"2023-06-02T15:30:42.667614+0000","last_fullsized":"2023-06-02T15:30:42.667614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.694829+0000","last_change":"2023-06-02T15:30:42.692861+0000","last_active":"2023-06-02T15:30:42.694829+0000","last_peered":"2023-06-02T15:30:42.694829+0000","last_clean":"2023-06-02T15:30:42.694829+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:30:42.694829+0000","last_undegraded":"2023-06-02T15:30:42.694829+0000","last_fullsized":"2023-06-02T15:30:42.694829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:29.857375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663612+0000","last_change":"2023-06-02T15:30:38.645534+0000","last_active":"2023-06-02T15:30:42.663612+0000","last_peered":"2023-06-02T15:30:42.663612+0000","last_clean":"2023-06-02T15:30:42.663612+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:30:42.663612+0000","last_undegraded":"2023-06-02T15:30:42.663612+0000","last_fullsized":"2023-06-02T15:30:42.663612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.692193+0000","last_change":"2023-06-02T15:30:38.282239+0000","last_active":"2023-06-02T15:30:42.692193+0000","last_peered":"2023-06-02T15:30:42.692193+0000","last_clean":"2023-06-02T15:30:42.692193+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:30:42.692193+0000","last_undegraded":"2023-06-02T15:30:42.692193+0000","last_fullsized":"2023-06-02T15:30:42.692193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:40.807809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.722484+0000","last_change":"2023-06-02T15:30:42.720849+0000","last_active":"2023-06-02T15:30:42.722484+0000","last_peered":"2023-06-02T15:30:42.722484+0000","last_clean":"2023-06-02T15:30:42.722484+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:30:42.722484+0000","last_undegraded":"2023-06-02T15:30:42.722484+0000","last_fullsized":"2023-06-02T15:30:42.722484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659621+0000","last_change":"2023-06-02T15:30:38.641746+0000","last_active":"2023-06-02T15:30:42.659621+0000","last_peered":"2023-06-02T15:30:42.659621+0000","last_clean":"2023-06-02T15:30:42.659621+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:30:42.659621+0000","last_undegraded":"2023-06-02T15:30:42.659621+0000","last_fullsized":"2023-06-02T15:30:42.659621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681113+0000","last_change":"2023-06-02T15:30:38.282724+0000","last_active":"2023-06-02T15:30:42.681113+0000","last_peered":"2023-06-02T15:30:42.681113+0000","last_clean":"2023-06-02T15:30:42.681113+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:30:42.681113+0000","last_undegraded":"2023-06-02T15:30:42.681113+0000","last_fullsized":"2023-06-02T15:30:42.681113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:21.387209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.701266+0000","last_change":"2023-06-02T15:30:42.697662+0000","last_active":"2023-06-02T15:30:42.701266+0000","last_peered":"2023-06-02T15:30:42.701266+0000","last_clean":"2023-06-02T15:30:42.701266+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:30:42.701266+0000","last_undegraded":"2023-06-02T15:30:42.701266+0000","last_fullsized":"2023-06-02T15:30:42.701266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:19.014996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673369+0000","last_change":"2023-06-02T15:30:38.656950+0000","last_active":"2023-06-02T15:30:42.673369+0000","last_peered":"2023-06-02T15:30:42.673369+0000","last_clean":"2023-06-02T15:30:42.673369+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:30:42.673369+0000","last_undegraded":"2023-06-02T15:30:42.673369+0000","last_fullsized":"2023-06-02T15:30:42.673369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.685248+0000","last_change":"2023-06-02T15:30:38.283602+0000","last_active":"2023-06-02T15:30:42.685248+0000","last_peered":"2023-06-02T15:30:42.685248+0000","last_clean":"2023-06-02T15:30:42.685248+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:30:42.685248+0000","last_undegraded":"2023-06-02T15:30:42.685248+0000","last_fullsized":"2023-06-02T15:30:42.685248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:33.362323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.727005+0000","last_change":"2023-06-02T15:30:42.722884+0000","last_active":"2023-06-02T15:30:42.727005+0000","last_peered":"2023-06-02T15:30:42.727005+0000","last_clean":"2023-06-02T15:30:42.727005+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:30:42.727005+0000","last_undegraded":"2023-06-02T15:30:42.727005+0000","last_fullsized":"2023-06-02T15:30:42.727005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.724350+0000","last_change":"2023-06-02T15:30:42.714188+0000","last_active":"2023-06-02T15:30:42.724350+0000","last_peered":"2023-06-02T15:30:42.724350+0000","last_clean":"2023-06-02T15:30:42.724350+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:30:42.724350+0000","last_undegraded":"2023-06-02T15:30:42.724350+0000","last_fullsized":"2023-06-02T15:30:42.724350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663139+0000","last_change":"2023-06-02T15:30:38.261610+0000","last_active":"2023-06-02T15:30:42.663139+0000","last_peered":"2023-06-02T15:30:42.663139+0000","last_clean":"2023-06-02T15:30:42.663139+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:30:42.663139+0000","last_undegraded":"2023-06-02T15:30:42.663139+0000","last_fullsized":"2023-06-02T15:30:42.663139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674925+0000","last_change":"2023-06-02T15:30:38.658984+0000","last_active":"2023-06-02T15:30:42.674925+0000","last_peered":"2023-06-02T15:30:42.674925+0000","last_clean":"2023-06-02T15:30:42.674925+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:30:42.674925+0000","last_undegraded":"2023-06-02T15:30:42.674925+0000","last_fullsized":"2023-06-02T15:30:42.674925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.712889+0000","last_change":"2023-06-02T15:30:42.705561+0000","last_active":"2023-06-02T15:30:42.712889+0000","last_peered":"2023-06-02T15:30:42.712889+0000","last_clean":"2023-06-02T15:30:42.712889+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:30:42.712889+0000","last_undegraded":"2023-06-02T15:30:42.712889+0000","last_fullsized":"2023-06-02T15:30:42.712889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:39:14.247511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.682004+0000","last_change":"2023-06-02T15:30:38.283796+0000","last_active":"2023-06-02T15:30:42.682004+0000","last_peered":"2023-06-02T15:30:42.682004+0000","last_clean":"2023-06-02T15:30:42.682004+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:30:42.682004+0000","last_undegraded":"2023-06-02T15:30:42.682004+0000","last_fullsized":"2023-06-02T15:30:42.682004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.672736+0000","last_change":"2023-06-02T15:30:38.644966+0000","last_active":"2023-06-02T15:30:42.672736+0000","last_peered":"2023-06-02T15:30:42.672736+0000","last_clean":"2023-06-02T15:30:42.672736+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:30:42.672736+0000","last_undegraded":"2023-06-02T15:30:42.672736+0000","last_fullsized":"2023-06-02T15:30:42.672736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666181+0000","last_change":"2023-06-02T15:30:38.265398+0000","last_active":"2023-06-02T15:30:42.666181+0000","last_peered":"2023-06-02T15:30:42.666181+0000","last_clean":"2023-06-02T15:30:42.666181+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:30:42.666181+0000","last_undegraded":"2023-06-02T15:30:42.666181+0000","last_fullsized":"2023-06-02T15:30:42.666181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:10:29.479149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680142+0000","last_change":"2023-06-02T15:30:38.657999+0000","last_active":"2023-06-02T15:30:42.680142+0000","last_peered":"2023-06-02T15:30:42.680142+0000","last_clean":"2023-06-02T15:30:42.680142+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:30:42.680142+0000","last_undegraded":"2023-06-02T15:30:42.680142+0000","last_fullsized":"2023-06-02T15:30:42.680142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.712989+0000","last_change":"2023-06-02T15:30:42.705725+0000","last_active":"2023-06-02T15:30:42.712989+0000","last_peered":"2023-06-02T15:30:42.712989+0000","last_clean":"2023-06-02T15:30:42.712989+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:30:42.712989+0000","last_undegraded":"2023-06-02T15:30:42.712989+0000","last_fullsized":"2023-06-02T15:30:42.712989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.684274+0000","last_change":"2023-06-02T15:30:38.282095+0000","last_active":"2023-06-02T15:30:42.684274+0000","last_peered":"2023-06-02T15:30:42.684274+0000","last_clean":"2023-06-02T15:30:42.684274+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:30:42.684274+0000","last_undegraded":"2023-06-02T15:30:42.684274+0000","last_fullsized":"2023-06-02T15:30:42.684274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668685+0000","last_change":"2023-06-02T15:30:38.651033+0000","last_active":"2023-06-02T15:30:42.668685+0000","last_peered":"2023-06-02T15:30:42.668685+0000","last_clean":"2023-06-02T15:30:42.668685+0000","last_became_active":"2023-06-02T15:30:38.650698+0000","last_became_peered":"2023-06-02T15:30:38.650698+0000","last_unstale":"2023-06-02T15:30:42.668685+0000","last_undegraded":"2023-06-02T15:30:42.668685+0000","last_fullsized":"2023-06-02T15:30:42.668685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721086+0000","last_change":"2023-06-02T15:30:42.702456+0000","last_active":"2023-06-02T15:30:42.721086+0000","last_peered":"2023-06-02T15:30:42.721086+0000","last_clean":"2023-06-02T15:30:42.721086+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:30:42.721086+0000","last_undegraded":"2023-06-02T15:30:42.721086+0000","last_fullsized":"2023-06-02T15:30:42.721086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663108+0000","last_change":"2023-06-02T15:30:38.637380+0000","last_active":"2023-06-02T15:30:42.663108+0000","last_peered":"2023-06-02T15:30:42.663108+0000","last_clean":"2023-06-02T15:30:42.663108+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:30:42.663108+0000","last_undegraded":"2023-06-02T15:30:42.663108+0000","last_fullsized":"2023-06-02T15:30:42.663108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666409+0000","last_change":"2023-06-02T15:30:38.655074+0000","last_active":"2023-06-02T15:30:42.666409+0000","last_peered":"2023-06-02T15:30:42.666409+0000","last_clean":"2023-06-02T15:30:42.666409+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:30:42.666409+0000","last_undegraded":"2023-06-02T15:30:42.666409+0000","last_fullsized":"2023-06-02T15:30:42.666409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661310+0000","last_change":"2023-06-02T15:30:38.637979+0000","last_active":"2023-06-02T15:30:42.661310+0000","last_peered":"2023-06-02T15:30:42.661310+0000","last_clean":"2023-06-02T15:30:42.661310+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:30:42.661310+0000","last_undegraded":"2023-06-02T15:30:42.661310+0000","last_fullsized":"2023-06-02T15:30:42.661310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674658+0000","last_change":"2023-06-02T15:30:38.659430+0000","last_active":"2023-06-02T15:30:42.674658+0000","last_peered":"2023-06-02T15:30:42.674658+0000","last_clean":"2023-06-02T15:30:42.674658+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:30:42.674658+0000","last_undegraded":"2023-06-02T15:30:42.674658+0000","last_fullsized":"2023-06-02T15:30:42.674658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679154+0000","last_change":"2023-06-02T15:30:38.656408+0000","last_active":"2023-06-02T15:30:42.679154+0000","last_peered":"2023-06-02T15:30:42.679154+0000","last_clean":"2023-06-02T15:30:42.679154+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:30:42.679154+0000","last_undegraded":"2023-06-02T15:30:42.679154+0000","last_fullsized":"2023-06-02T15:30:42.679154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679939+0000","last_change":"2023-06-02T15:30:38.658103+0000","last_active":"2023-06-02T15:30:42.679939+0000","last_peered":"2023-06-02T15:30:42.679939+0000","last_clean":"2023-06-02T15:30:42.679939+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:30:42.679939+0000","last_undegraded":"2023-06-02T15:30:42.679939+0000","last_fullsized":"2023-06-02T15:30:42.679939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678672+0000","last_change":"2023-06-02T15:30:38.641657+0000","last_active":"2023-06-02T15:30:42.678672+0000","last_peered":"2023-06-02T15:30:42.678672+0000","last_clean":"2023-06-02T15:30:42.678672+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:30:42.678672+0000","last_undegraded":"2023-06-02T15:30:42.678672+0000","last_fullsized":"2023-06-02T15:30:42.678672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:22.309633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678899+0000","last_change":"2023-06-02T15:30:38.640289+0000","last_active":"2023-06-02T15:30:42.678899+0000","last_peered":"2023-06-02T15:30:42.678899+0000","last_clean":"2023-06-02T15:30:42.678899+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:30:42.678899+0000","last_undegraded":"2023-06-02T15:30:42.678899+0000","last_fullsized":"2023-06-02T15:30:42.678899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687086+0000","last_change":"2023-06-02T15:30:38.656963+0000","last_active":"2023-06-02T15:30:42.687086+0000","last_peered":"2023-06-02T15:30:42.687086+0000","last_clean":"2023-06-02T15:30:42.687086+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:30:42.687086+0000","last_undegraded":"2023-06-02T15:30:42.687086+0000","last_fullsized":"2023-06-02T15:30:42.687086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666294+0000","last_change":"2023-06-02T15:30:38.648546+0000","last_active":"2023-06-02T15:30:42.666294+0000","last_peered":"2023-06-02T15:30:42.666294+0000","last_clean":"2023-06-02T15:30:42.666294+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:30:42.666294+0000","last_undegraded":"2023-06-02T15:30:42.666294+0000","last_fullsized":"2023-06-02T15:30:42.666294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666007+0000","last_change":"2023-06-02T15:30:38.643407+0000","last_active":"2023-06-02T15:30:42.666007+0000","last_peered":"2023-06-02T15:30:42.666007+0000","last_clean":"2023-06-02T15:30:42.666007+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:30:42.666007+0000","last_undegraded":"2023-06-02T15:30:42.666007+0000","last_fullsized":"2023-06-02T15:30:42.666007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.684038+0000","last_change":"2023-06-02T15:30:38.657038+0000","last_active":"2023-06-02T15:30:42.684038+0000","last_peered":"2023-06-02T15:30:42.684038+0000","last_clean":"2023-06-02T15:30:42.684038+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:30:42.684038+0000","last_undegraded":"2023-06-02T15:30:42.684038+0000","last_fullsized":"2023-06-02T15:30:42.684038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663138+0000","last_change":"2023-06-02T15:30:38.638594+0000","last_active":"2023-06-02T15:30:42.663138+0000","last_peered":"2023-06-02T15:30:42.663138+0000","last_clean":"2023-06-02T15:30:42.663138+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:30:42.663138+0000","last_undegraded":"2023-06-02T15:30:42.663138+0000","last_fullsized":"2023-06-02T15:30:42.663138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:28.604626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.654344+0000","last_change":"2023-06-02T15:30:38.638252+0000","last_active":"2023-06-02T15:30:42.654344+0000","last_peered":"2023-06-02T15:30:42.654344+0000","last_clean":"2023-06-02T15:30:42.654344+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:30:42.654344+0000","last_undegraded":"2023-06-02T15:30:42.654344+0000","last_fullsized":"2023-06-02T15:30:42.654344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:24.550049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665765+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:30:42.665765+0000","last_peered":"2023-06-02T15:30:42.665765+0000","last_clean":"2023-06-02T15:30:42.665765+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:30:42.665765+0000","last_undegraded":"2023-06-02T15:30:42.665765+0000","last_fullsized":"2023-06-02T15:30:42.665765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:14.924133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669090+0000","last_change":"2023-06-02T15:30:38.639262+0000","last_active":"2023-06-02T15:30:42.669090+0000","last_peered":"2023-06-02T15:30:42.669090+0000","last_clean":"2023-06-02T15:30:42.669090+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:30:42.669090+0000","last_undegraded":"2023-06-02T15:30:42.669090+0000","last_fullsized":"2023-06-02T15:30:42.669090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659193+0000","last_change":"2023-06-02T15:30:38.636435+0000","last_active":"2023-06-02T15:30:42.659193+0000","last_peered":"2023-06-02T15:30:42.659193+0000","last_clean":"2023-06-02T15:30:42.659193+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:30:42.659193+0000","last_undegraded":"2023-06-02T15:30:42.659193+0000","last_fullsized":"2023-06-02T15:30:42.659193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:41:54.216725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681786+0000","last_change":"2023-06-02T15:30:38.659341+0000","last_active":"2023-06-02T15:30:42.681786+0000","last_peered":"2023-06-02T15:30:42.681786+0000","last_clean":"2023-06-02T15:30:42.681786+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:30:42.681786+0000","last_undegraded":"2023-06-02T15:30:42.681786+0000","last_fullsized":"2023-06-02T15:30:42.681786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.671862+0000","last_change":"2023-06-02T15:30:38.636138+0000","last_active":"2023-06-02T15:30:42.671862+0000","last_peered":"2023-06-02T15:30:42.671862+0000","last_clean":"2023-06-02T15:30:42.671862+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:30:42.671862+0000","last_undegraded":"2023-06-02T15:30:42.671862+0000","last_fullsized":"2023-06-02T15:30:42.671862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.654567+0000","last_change":"2023-06-02T15:30:38.645755+0000","last_active":"2023-06-02T15:30:42.654567+0000","last_peered":"2023-06-02T15:30:42.654567+0000","last_clean":"2023-06-02T15:30:42.654567+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:30:42.654567+0000","last_undegraded":"2023-06-02T15:30:42.654567+0000","last_fullsized":"2023-06-02T15:30:42.654567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:40.298901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.653573+0000","last_change":"2023-06-02T15:30:38.644641+0000","last_active":"2023-06-02T15:30:42.653573+0000","last_peered":"2023-06-02T15:30:42.653573+0000","last_clean":"2023-06-02T15:30:42.653573+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:30:42.653573+0000","last_undegraded":"2023-06-02T15:30:42.653573+0000","last_fullsized":"2023-06-02T15:30:42.653573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:14.588404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663449+0000","last_change":"2023-06-02T15:30:38.650928+0000","last_active":"2023-06-02T15:30:42.663449+0000","last_peered":"2023-06-02T15:30:42.663449+0000","last_clean":"2023-06-02T15:30:42.663449+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:30:42.663449+0000","last_undegraded":"2023-06-02T15:30:42.663449+0000","last_fullsized":"2023-06-02T15:30:42.663449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.676823+0000","last_change":"2023-06-02T15:30:38.640368+0000","last_active":"2023-06-02T15:30:42.676823+0000","last_peered":"2023-06-02T15:30:42.676823+0000","last_clean":"2023-06-02T15:30:42.676823+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:30:42.676823+0000","last_undegraded":"2023-06-02T15:30:42.676823+0000","last_fullsized":"2023-06-02T15:30:42.676823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668907+0000","last_change":"2023-06-02T15:30:38.639440+0000","last_active":"2023-06-02T15:30:42.668907+0000","last_peered":"2023-06-02T15:30:42.668907+0000","last_clean":"2023-06-02T15:30:42.668907+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:30:42.668907+0000","last_undegraded":"2023-06-02T15:30:42.668907+0000","last_fullsized":"2023-06-02T15:30:42.668907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673165+0000","last_change":"2023-06-02T15:30:38.647961+0000","last_active":"2023-06-02T15:30:42.673165+0000","last_peered":"2023-06-02T15:30:42.673165+0000","last_clean":"2023-06-02T15:30:42.673165+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:30:42.673165+0000","last_undegraded":"2023-06-02T15:30:42.673165+0000","last_fullsized":"2023-06-02T15:30:42.673165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681575+0000","last_change":"2023-06-02T15:30:38.659299+0000","last_active":"2023-06-02T15:30:42.681575+0000","last_peered":"2023-06-02T15:30:42.681575+0000","last_clean":"2023-06-02T15:30:42.681575+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:30:42.681575+0000","last_undegraded":"2023-06-02T15:30:42.681575+0000","last_fullsized":"2023-06-02T15:30:42.681575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661036+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:30:42.661036+0000","last_peered":"2023-06-02T15:30:42.661036+0000","last_clean":"2023-06-02T15:30:42.661036+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:30:42.661036+0000","last_undegraded":"2023-06-02T15:30:42.661036+0000","last_fullsized":"2023-06-02T15:30:42.661036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:15:27.850958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666520+0000","last_change":"2023-06-02T15:30:38.639043+0000","last_active":"2023-06-02T15:30:42.666520+0000","last_peered":"2023-06-02T15:30:42.666520+0000","last_clean":"2023-06-02T15:30:42.666520+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:30:42.666520+0000","last_undegraded":"2023-06-02T15:30:42.666520+0000","last_fullsized":"2023-06-02T15:30:42.666520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663732+0000","last_change":"2023-06-02T15:30:38.637413+0000","last_active":"2023-06-02T15:30:42.663732+0000","last_peered":"2023-06-02T15:30:42.663732+0000","last_clean":"2023-06-02T15:30:42.663732+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:30:42.663732+0000","last_undegraded":"2023-06-02T15:30:42.663732+0000","last_fullsized":"2023-06-02T15:30:42.663732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:22.390984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659962+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:30:42.659962+0000","last_peered":"2023-06-02T15:30:42.659962+0000","last_clean":"2023-06-02T15:30:42.659962+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:30:42.659962+0000","last_undegraded":"2023-06-02T15:30:42.659962+0000","last_fullsized":"2023-06-02T15:30:42.659962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:17:55.191725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.676939+0000","last_change":"2023-06-02T15:30:38.650591+0000","last_active":"2023-06-02T15:30:42.676939+0000","last_peered":"2023-06-02T15:30:42.676939+0000","last_clean":"2023-06-02T15:30:42.676939+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:30:42.676939+0000","last_undegraded":"2023-06-02T15:30:42.676939+0000","last_fullsized":"2023-06-02T15:30:42.676939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.655693+0000","last_change":"2023-06-02T15:30:38.639026+0000","last_active":"2023-06-02T15:30:42.655693+0000","last_peered":"2023-06-02T15:30:42.655693+0000","last_clean":"2023-06-02T15:30:42.655693+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:30:42.655693+0000","last_undegraded":"2023-06-02T15:30:42.655693+0000","last_fullsized":"2023-06-02T15:30:42.655693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:49.394624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4385,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9128,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362712,"statfs":{"total":96636764160,"available":96627417088,"internally_reserved":0,"allocated":360448,"data_stored":703949,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8524,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363316,"statfs":{"total":96636764160,"available":96628035584,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8528,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363312,"statfs":{"total":96636764160,"available":96628031488,"internally_reserved":0,"allocated":270336,"data_stored":109412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8608,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363232,"statfs":{"total":96636764160,"available":96627949568,"internally_reserved":0,"allocated":286720,"data_stored":113421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8528,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363312,"statfs":{"total":96636764160,"available":96628031488,"internally_reserved":0,"allocated":270336,"data_stored":109852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8460,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363380,"statfs":{"total":96636764160,"available":96628101120,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9100,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362740,"statfs":{"total":96636764160,"available":96627445760,"internally_reserved":0,"allocated":331776,"data_stored":700130,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8588,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363252,"statfs":{"total":96636764160,"available":96627970048,"internally_reserved":0,"allocated":266240,"data_stored":109342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:30:55.721 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:30:55.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8cad1e2640 1 Processor -- start 2023-06-02T15:30:55.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8cad1e2640 1 -- start start 2023-06-02T15:30:55.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8cad1e2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ca80bc1c0 0x7f8ca814bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8cad1e2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ca80a0020 0x7f8ca81487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8cad1e2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca814ba90 con 0x7f8ca814f330 2023-06-02T15:30:55.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8cad1e2640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca80a47b0 con 0x7f8ca80bc1c0 2023-06-02T15:30:55.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8cad1e2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca814f7c0 con 0x7f8ca80a0020 2023-06-02T15:30:55.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8ca6d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ca80bc1c0 0x7f8ca814bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8ca6d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ca80bc1c0 0x7f8ca814bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57368/0 (socket says 172.21.15.78:57368) 2023-06-02T15:30:55.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8ca6d9d640 1 -- 172.21.15.78:0/2709924161 learned_addr learned my addr 172.21.15.78:0/2709924161 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:55.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8ca6d9d640 1 -- 172.21.15.78:0/2709924161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ca80a0020 msgr2=0x7f8ca81487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:55.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8ca759e640 1 --2- 172.21.15.78:0/2709924161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ca80a0020 0x7f8ca81487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8ca6d9d640 1 --2- 172.21.15.78:0/2709924161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ca80a0020 0x7f8ca81487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8ca6d9d640 1 -- 172.21.15.78:0/2709924161 >> v1:172.21.15.132:6789/0 conn(0x7f8ca814f330 legacy=0x7f8ca80a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:55.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.866+0000 7f8ca6d9d640 1 -- 172.21.15.78:0/2709924161 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca814b440 con 0x7f8ca80bc1c0 2023-06-02T15:30:55.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8ca6d9d640 1 --2- 172.21.15.78:0/2709924161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca80bc1c0 0x7f8ca814bf20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009870 tx=0x7f8ca001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=828df1675f91ce3b server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8ca5d9b640 1 -- 172.21.15.78:0/2709924161 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00ab600 con 0x7f8ca80bc1c0 2023-06-02T15:30:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8ca5d9b640 1 -- 172.21.15.78:0/2709924161 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca00a7050 con 0x7f8ca80bc1c0 2023-06-02T15:30:55.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8ca5d9b640 1 -- 172.21.15.78:0/2709924161 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00ab980 con 0x7f8ca80bc1c0 2023-06-02T15:30:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8cad1e2640 1 -- 172.21.15.78:0/2709924161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca80bc1c0 msgr2=0x7f8ca814bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8cad1e2640 1 --2- 172.21.15.78:0/2709924161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca80bc1c0 0x7f8ca814bf20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8ca0009870 tx=0x7f8ca001c470 comp rx=0 tx=0).stop 2023-06-02T15:30:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8cad1e2640 1 -- 172.21.15.78:0/2709924161 shutdown_connections 2023-06-02T15:30:55.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8cad1e2640 1 --2- 172.21.15.78:0/2709924161 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ca80a0020 0x7f8ca81487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8cad1e2640 1 --2- 172.21.15.78:0/2709924161 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca80bc1c0 0x7f8ca814bf20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8cad1e2640 1 -- 172.21.15.78:0/2709924161 >> 172.21.15.78:0/2709924161 conn(0x7f8ca80bcf50 msgr2=0x7f8ca80bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:55.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8cad1e2640 1 -- 172.21.15.78:0/2709924161 shutdown_connections 2023-06-02T15:30:55.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8cad1e2640 1 -- 172.21.15.78:0/2709924161 wait complete. 2023-06-02T15:30:55.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8cad1e2640 1 Processor -- start 2023-06-02T15:30:55.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.870+0000 7f8cad1e2640 1 -- start start 2023-06-02T15:30:55.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8cad1e2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ca80a0020 0x7f8ca80b9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8cad1e2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ca80bc1c0 0x7f8ca80c0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8cad1e2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca814f330 0x7f8ca80c0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8cad1e2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca8142730 con 0x7f8ca814f330 2023-06-02T15:30:55.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8cad1e2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca81576d0 con 0x7f8ca80a0020 2023-06-02T15:30:55.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8cad1e2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca80c10c0 con 0x7f8ca80bc1c0 2023-06-02T15:30:55.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca814f330 0x7f8ca80c0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca759e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca814f330 0x7f8ca80c0b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57376/0 (socket says 172.21.15.78:57376) 2023-06-02T15:30:55.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca759e640 1 -- 172.21.15.78:0/1041210782 learned_addr learned my addr 172.21.15.78:0/1041210782 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:55.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca659c640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ca80bc1c0 0x7f8ca80c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca759e640 1 -- 172.21.15.78:0/1041210782 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ca80bc1c0 msgr2=0x7f8ca80c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca6d9d640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ca80a0020 0x7f8ca80b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca759e640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ca80bc1c0 0x7f8ca80c0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca759e640 1 -- 172.21.15.78:0/1041210782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ca80a0020 msgr2=0x7f8ca80b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:55.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca759e640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ca80a0020 0x7f8ca80b9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:55.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca759e640 1 -- 172.21.15.78:0/1041210782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca00094d0 con 0x7f8ca814f330 2023-06-02T15:30:55.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca759e640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca814f330 0x7f8ca80c0b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800cd70 tx=0x7f8c9800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:55.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8c8f7fe640 1 -- 172.21.15.78:0/1041210782 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98003ba0 con 0x7f8ca814f330 2023-06-02T15:30:55.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8c8f7fe640 1 -- 172.21.15.78:0/1041210782 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c98003d00 con 0x7f8ca814f330 2023-06-02T15:30:55.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8cad1e2640 1 -- 172.21.15.78:0/1041210782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca80bcb90 con 0x7f8ca814f330 2023-06-02T15:30:55.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8c8f7fe640 1 -- 172.21.15.78:0/1041210782 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98004240 con 0x7f8ca814f330 2023-06-02T15:30:55.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8cad1e2640 1 -- 172.21.15.78:0/1041210782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca80bca00 con 0x7f8ca814f330 2023-06-02T15:30:55.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8cad1e2640 1 -- 172.21.15.78:0/1041210782 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca81564c0 con 0x7f8ca814f330 2023-06-02T15:30:55.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8c8f7fe640 1 -- 172.21.15.78:0/1041210782 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f8c980043a0 con 0x7f8ca814f330 2023-06-02T15:30:55.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8c8f7fe640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8c94065c00 0x7f8c940680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:55.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8ca6d9d640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8c94065c00 0x7f8c940680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:55.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.874+0000 7f8c8f7fe640 1 -- 172.21.15.78:0/1041210782 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8c98012070 con 0x7f8ca814f330 2023-06-02T15:30:55.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.878+0000 7f8ca6d9d640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8c94065c00 0x7f8c940680b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8072110 tx=0x7f8ca0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:55.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:55.878+0000 7f8c8f7fe640 1 -- 172.21.15.78:0/1041210782 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f8c980516b0 con 0x7f8ca814f330 2023-06-02T15:30:56.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.026+0000 7f8cad1e2640 1 -- 172.21.15.78:0/1041210782 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ca8157840 con 0x7f8c94065c00 2023-06-02T15:30:56.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.042+0000 7f8c8f7fe640 1 -- 172.21.15.78:0/1041210782 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367574 (secure 0 0 0) 0x7f8ca8157840 con 0x7f8c94065c00 2023-06-02T15:30:56.051 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:56.054 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:30:56.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 -- 172.21.15.78:0/1041210782 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8c94065c00 msgr2=0x7f8c940680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8c94065c00 0x7f8c940680b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8072110 tx=0x7f8ca0008040 comp rx=0 tx=0).stop 2023-06-02T15:30:56.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 -- 172.21.15.78:0/1041210782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca814f330 msgr2=0x7f8ca80c0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca814f330 0x7f8ca80c0b80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c9800cd70 tx=0x7f8c9800a660 comp rx=0 tx=0).stop 2023-06-02T15:30:56.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 -- 172.21.15.78:0/1041210782 shutdown_connections 2023-06-02T15:30:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8c94065c00 0x7f8c940680b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ca814f330 0x7f8ca80c0b80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8ca80bc1c0 0x7f8ca80c0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 --2- 172.21.15.78:0/1041210782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ca80a0020 0x7f8ca80b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 -- 172.21.15.78:0/1041210782 >> 172.21.15.78:0/1041210782 conn(0x7f8ca80bcf50 msgr2=0x7f8ca80bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 -- 172.21.15.78:0/1041210782 shutdown_connections 2023-06-02T15:30:56.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.046+0000 7f8cad1e2640 1 -- 172.21.15.78:0/1041210782 wait complete. 2023-06-02T15:30:56.071 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-06-02T15:30:55.223967+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594753,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69464,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":754905256,"statfs":{"total":773094113280,"available":773022982144,"internally_reserved":0,"allocated":2318336,"data_stored":2065630,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2055,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004480"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.713456+0000","last_change":"2023-06-02T15:30:42.711237+0000","last_active":"2023-06-02T15:30:42.713456+0000","last_peered":"2023-06-02T15:30:42.713456+0000","last_clean":"2023-06-02T15:30:42.713456+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:30:42.713456+0000","last_undegraded":"2023-06-02T15:30:42.713456+0000","last_fullsized":"2023-06-02T15:30:42.713456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669011+0000","last_change":"2023-06-02T15:30:38.275721+0000","last_active":"2023-06-02T15:30:42.669011+0000","last_peered":"2023-06-02T15:30:42.669011+0000","last_clean":"2023-06-02T15:30:42.669011+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:30:42.669011+0000","last_undegraded":"2023-06-02T15:30:42.669011+0000","last_fullsized":"2023-06-02T15:30:42.669011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659411+0000","last_change":"2023-06-02T15:30:38.638911+0000","last_active":"2023-06-02T15:30:42.659411+0000","last_peered":"2023-06-02T15:30:42.659411+0000","last_clean":"2023-06-02T15:30:42.659411+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:30:42.659411+0000","last_undegraded":"2023-06-02T15:30:42.659411+0000","last_fullsized":"2023-06-02T15:30:42.659411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.709825+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:30:42.709825+0000","last_peered":"2023-06-02T15:30:42.709825+0000","last_clean":"2023-06-02T15:30:42.709825+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:30:42.709825+0000","last_undegraded":"2023-06-02T15:30:42.709825+0000","last_fullsized":"2023-06-02T15:30:42.709825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:23:12.455644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674342+0000","last_change":"2023-06-02T15:30:38.282116+0000","last_active":"2023-06-02T15:30:42.674342+0000","last_peered":"2023-06-02T15:30:42.674342+0000","last_clean":"2023-06-02T15:30:42.674342+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:30:42.674342+0000","last_undegraded":"2023-06-02T15:30:42.674342+0000","last_fullsized":"2023-06-02T15:30:42.674342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666523+0000","last_change":"2023-06-02T15:30:38.638342+0000","last_active":"2023-06-02T15:30:42.666523+0000","last_peered":"2023-06-02T15:30:42.666523+0000","last_clean":"2023-06-02T15:30:42.666523+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:30:42.666523+0000","last_undegraded":"2023-06-02T15:30:42.666523+0000","last_fullsized":"2023-06-02T15:30:42.666523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.724432+0000","last_change":"2023-06-02T15:30:42.715416+0000","last_active":"2023-06-02T15:30:42.724432+0000","last_peered":"2023-06-02T15:30:42.724432+0000","last_clean":"2023-06-02T15:30:42.724432+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:30:42.724432+0000","last_undegraded":"2023-06-02T15:30:42.724432+0000","last_fullsized":"2023-06-02T15:30:42.724432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680371+0000","last_change":"2023-06-02T15:30:38.278973+0000","last_active":"2023-06-02T15:30:42.680371+0000","last_peered":"2023-06-02T15:30:42.680371+0000","last_clean":"2023-06-02T15:30:42.680371+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:30:42.680371+0000","last_undegraded":"2023-06-02T15:30:42.680371+0000","last_fullsized":"2023-06-02T15:30:42.680371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661168+0000","last_change":"2023-06-02T15:30:38.644549+0000","last_active":"2023-06-02T15:30:42.661168+0000","last_peered":"2023-06-02T15:30:42.661168+0000","last_clean":"2023-06-02T15:30:42.661168+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:30:42.661168+0000","last_undegraded":"2023-06-02T15:30:42.661168+0000","last_fullsized":"2023-06-02T15:30:42.661168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:26.088195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725079+0000","last_change":"2023-06-02T15:30:42.707090+0000","last_active":"2023-06-02T15:30:42.725079+0000","last_peered":"2023-06-02T15:30:42.725079+0000","last_clean":"2023-06-02T15:30:42.725079+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:30:42.725079+0000","last_undegraded":"2023-06-02T15:30:42.725079+0000","last_fullsized":"2023-06-02T15:30:42.725079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.667871+0000","last_change":"2023-06-02T15:30:38.269876+0000","last_active":"2023-06-02T15:30:42.667871+0000","last_peered":"2023-06-02T15:30:42.667871+0000","last_clean":"2023-06-02T15:30:42.667871+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:30:42.667871+0000","last_undegraded":"2023-06-02T15:30:42.667871+0000","last_fullsized":"2023-06-02T15:30:42.667871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661361+0000","last_change":"2023-06-02T15:30:38.639635+0000","last_active":"2023-06-02T15:30:42.661361+0000","last_peered":"2023-06-02T15:30:42.661361+0000","last_clean":"2023-06-02T15:30:42.661361+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:30:42.661361+0000","last_undegraded":"2023-06-02T15:30:42.661361+0000","last_fullsized":"2023-06-02T15:30:42.661361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:56:57.260064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.702939+0000","last_change":"2023-06-02T15:30:42.699623+0000","last_active":"2023-06-02T15:30:42.702939+0000","last_peered":"2023-06-02T15:30:42.702939+0000","last_clean":"2023-06-02T15:30:42.702939+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:30:42.702939+0000","last_undegraded":"2023-06-02T15:30:42.702939+0000","last_fullsized":"2023-06-02T15:30:42.702939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:18.327051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668971+0000","last_change":"2023-06-02T15:30:38.263534+0000","last_active":"2023-06-02T15:30:42.668971+0000","last_peered":"2023-06-02T15:30:42.668971+0000","last_clean":"2023-06-02T15:30:42.668971+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:30:42.668971+0000","last_undegraded":"2023-06-02T15:30:42.668971+0000","last_fullsized":"2023-06-02T15:30:42.668971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.653780+0000","last_change":"2023-06-02T15:30:38.644102+0000","last_active":"2023-06-02T15:30:42.653780+0000","last_peered":"2023-06-02T15:30:42.653780+0000","last_clean":"2023-06-02T15:30:42.653780+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:30:42.653780+0000","last_undegraded":"2023-06-02T15:30:42.653780+0000","last_fullsized":"2023-06-02T15:30:42.653780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:11.864794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.709755+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:30:42.709755+0000","last_peered":"2023-06-02T15:30:42.709755+0000","last_clean":"2023-06-02T15:30:42.709755+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:30:42.709755+0000","last_undegraded":"2023-06-02T15:30:42.709755+0000","last_fullsized":"2023-06-02T15:30:42.709755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:16:13.363523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661437+0000","last_change":"2023-06-02T15:30:38.272143+0000","last_active":"2023-06-02T15:30:42.661437+0000","last_peered":"2023-06-02T15:30:42.661437+0000","last_clean":"2023-06-02T15:30:42.661437+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:30:42.661437+0000","last_undegraded":"2023-06-02T15:30:42.661437+0000","last_fullsized":"2023-06-02T15:30:42.661437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673969+0000","last_change":"2023-06-02T15:30:38.650795+0000","last_active":"2023-06-02T15:30:42.673969+0000","last_peered":"2023-06-02T15:30:42.673969+0000","last_clean":"2023-06-02T15:30:42.673969+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:30:42.673969+0000","last_undegraded":"2023-06-02T15:30:42.673969+0000","last_fullsized":"2023-06-02T15:30:42.673969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725571+0000","last_change":"2023-06-02T15:30:42.706975+0000","last_active":"2023-06-02T15:30:42.725571+0000","last_peered":"2023-06-02T15:30:42.725571+0000","last_clean":"2023-06-02T15:30:42.725571+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:30:42.725571+0000","last_undegraded":"2023-06-02T15:30:42.725571+0000","last_fullsized":"2023-06-02T15:30:42.725571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:32.007544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675638+0000","last_change":"2023-06-02T15:30:38.290129+0000","last_active":"2023-06-02T15:30:42.675638+0000","last_peered":"2023-06-02T15:30:42.675638+0000","last_clean":"2023-06-02T15:30:42.675638+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:30:42.675638+0000","last_undegraded":"2023-06-02T15:30:42.675638+0000","last_fullsized":"2023-06-02T15:30:42.675638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.670451+0000","last_change":"2023-06-02T15:30:38.656679+0000","last_active":"2023-06-02T15:30:42.670451+0000","last_peered":"2023-06-02T15:30:42.670451+0000","last_clean":"2023-06-02T15:30:42.670451+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:30:42.670451+0000","last_undegraded":"2023-06-02T15:30:42.670451+0000","last_fullsized":"2023-06-02T15:30:42.670451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.707868+0000","last_change":"2023-06-02T15:30:42.705633+0000","last_active":"2023-06-02T15:30:42.707868+0000","last_peered":"2023-06-02T15:30:42.707868+0000","last_clean":"2023-06-02T15:30:42.707868+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:30:42.707868+0000","last_undegraded":"2023-06-02T15:30:42.707868+0000","last_fullsized":"2023-06-02T15:30:42.707868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674076+0000","last_change":"2023-06-02T15:30:38.273154+0000","last_active":"2023-06-02T15:30:42.674076+0000","last_peered":"2023-06-02T15:30:42.674076+0000","last_clean":"2023-06-02T15:30:42.674076+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:30:42.674076+0000","last_undegraded":"2023-06-02T15:30:42.674076+0000","last_fullsized":"2023-06-02T15:30:42.674076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665225+0000","last_change":"2023-06-02T15:30:38.647445+0000","last_active":"2023-06-02T15:30:42.665225+0000","last_peered":"2023-06-02T15:30:42.665225+0000","last_clean":"2023-06-02T15:30:42.665225+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:30:42.665225+0000","last_undegraded":"2023-06-02T15:30:42.665225+0000","last_fullsized":"2023-06-02T15:30:42.665225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:34.366098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675284+0000","last_change":"2023-06-02T15:30:38.650927+0000","last_active":"2023-06-02T15:30:42.675284+0000","last_peered":"2023-06-02T15:30:42.675284+0000","last_clean":"2023-06-02T15:30:42.675284+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:30:42.675284+0000","last_undegraded":"2023-06-02T15:30:42.675284+0000","last_fullsized":"2023-06-02T15:30:42.675284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669099+0000","last_change":"2023-06-02T15:30:38.274472+0000","last_active":"2023-06-02T15:30:42.669099+0000","last_peered":"2023-06-02T15:30:42.669099+0000","last_clean":"2023-06-02T15:30:42.669099+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:30:42.669099+0000","last_undegraded":"2023-06-02T15:30:42.669099+0000","last_fullsized":"2023-06-02T15:30:42.669099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725651+0000","last_change":"2023-06-02T15:30:42.710065+0000","last_active":"2023-06-02T15:30:42.725651+0000","last_peered":"2023-06-02T15:30:42.725651+0000","last_clean":"2023-06-02T15:30:42.725651+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:30:42.725651+0000","last_undegraded":"2023-06-02T15:30:42.725651+0000","last_fullsized":"2023-06-02T15:30:42.725651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666632+0000","last_change":"2023-06-02T15:30:38.656769+0000","last_active":"2023-06-02T15:30:42.666632+0000","last_peered":"2023-06-02T15:30:42.666632+0000","last_clean":"2023-06-02T15:30:42.666632+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:30:42.666632+0000","last_undegraded":"2023-06-02T15:30:42.666632+0000","last_fullsized":"2023-06-02T15:30:42.666632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.677097+0000","last_change":"2023-06-02T15:30:38.275134+0000","last_active":"2023-06-02T15:30:42.677097+0000","last_peered":"2023-06-02T15:30:42.677097+0000","last_clean":"2023-06-02T15:30:42.677097+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:30:42.677097+0000","last_undegraded":"2023-06-02T15:30:42.677097+0000","last_fullsized":"2023-06-02T15:30:42.677097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725199+0000","last_change":"2023-06-02T15:30:42.706722+0000","last_active":"2023-06-02T15:30:42.725199+0000","last_peered":"2023-06-02T15:30:42.725199+0000","last_clean":"2023-06-02T15:30:42.725199+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:30:42.725199+0000","last_undegraded":"2023-06-02T15:30:42.725199+0000","last_fullsized":"2023-06-02T15:30:42.725199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.693560+0000","last_change":"2023-06-02T15:30:38.289736+0000","last_active":"2023-06-02T15:30:42.693560+0000","last_peered":"2023-06-02T15:30:42.693560+0000","last_clean":"2023-06-02T15:30:42.693560+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:30:42.693560+0000","last_undegraded":"2023-06-02T15:30:42.693560+0000","last_fullsized":"2023-06-02T15:30:42.693560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:43:04.205096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675744+0000","last_change":"2023-06-02T15:30:38.642841+0000","last_active":"2023-06-02T15:30:42.675744+0000","last_peered":"2023-06-02T15:30:42.675744+0000","last_clean":"2023-06-02T15:30:42.675744+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:30:42.675744+0000","last_undegraded":"2023-06-02T15:30:42.675744+0000","last_fullsized":"2023-06-02T15:30:42.675744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.722145+0000","last_change":"2023-06-02T15:30:42.720577+0000","last_active":"2023-06-02T15:30:42.722145+0000","last_peered":"2023-06-02T15:30:42.722145+0000","last_clean":"2023-06-02T15:30:42.722145+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:30:42.722145+0000","last_undegraded":"2023-06-02T15:30:42.722145+0000","last_fullsized":"2023-06-02T15:30:42.722145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:48:54.291389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-02T15:30:46.140877+0000","last_change":"2023-06-02T15:30:38.276703+0000","last_active":"2023-06-02T15:30:46.140877+0000","last_peered":"2023-06-02T15:30:46.140877+0000","last_clean":"2023-06-02T15:30:46.140877+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:30:46.140877+0000","last_undegraded":"2023-06-02T15:30:46.140877+0000","last_fullsized":"2023-06-02T15:30:46.140877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661581+0000","last_change":"2023-06-02T15:30:38.634436+0000","last_active":"2023-06-02T15:30:42.661581+0000","last_peered":"2023-06-02T15:30:42.661581+0000","last_clean":"2023-06-02T15:30:42.661581+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:30:42.661581+0000","last_undegraded":"2023-06-02T15:30:42.661581+0000","last_fullsized":"2023-06-02T15:30:42.661581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.710264+0000","last_change":"2023-06-02T15:30:42.707445+0000","last_active":"2023-06-02T15:30:42.710264+0000","last_peered":"2023-06-02T15:30:42.710264+0000","last_clean":"2023-06-02T15:30:42.710264+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:30:42.710264+0000","last_undegraded":"2023-06-02T15:30:42.710264+0000","last_fullsized":"2023-06-02T15:30:42.710264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675836+0000","last_change":"2023-06-02T15:30:38.649326+0000","last_active":"2023-06-02T15:30:42.675836+0000","last_peered":"2023-06-02T15:30:42.675836+0000","last_clean":"2023-06-02T15:30:42.675836+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:30:42.675836+0000","last_undegraded":"2023-06-02T15:30:42.675836+0000","last_fullsized":"2023-06-02T15:30:42.675836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665271+0000","last_change":"2023-06-02T15:30:33.407154+0000","last_active":"2023-06-02T15:30:42.665271+0000","last_peered":"2023-06-02T15:30:42.665271+0000","last_clean":"2023-06-02T15:30:42.665271+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:30:42.665271+0000","last_undegraded":"2023-06-02T15:30:42.665271+0000","last_fullsized":"2023-06-02T15:30:42.665271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680583+0000","last_change":"2023-06-02T15:30:38.279321+0000","last_active":"2023-06-02T15:30:42.680583+0000","last_peered":"2023-06-02T15:30:42.680583+0000","last_clean":"2023-06-02T15:30:42.680583+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:30:42.680583+0000","last_undegraded":"2023-06-02T15:30:42.680583+0000","last_fullsized":"2023-06-02T15:30:42.680583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.717152+0000","last_change":"2023-06-02T15:30:42.715780+0000","last_active":"2023-06-02T15:30:42.717152+0000","last_peered":"2023-06-02T15:30:42.717152+0000","last_clean":"2023-06-02T15:30:42.717152+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:30:42.717152+0000","last_undegraded":"2023-06-02T15:30:42.717152+0000","last_fullsized":"2023-06-02T15:30:42.717152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668772+0000","last_change":"2023-06-02T15:30:38.632171+0000","last_active":"2023-06-02T15:30:42.668772+0000","last_peered":"2023-06-02T15:30:42.668772+0000","last_clean":"2023-06-02T15:30:42.668772+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:30:42.668772+0000","last_undegraded":"2023-06-02T15:30:42.668772+0000","last_fullsized":"2023-06-02T15:30:42.668772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666211+0000","last_change":"2023-06-02T15:30:33.655215+0000","last_active":"2023-06-02T15:30:42.666211+0000","last_peered":"2023-06-02T15:30:42.666211+0000","last_clean":"2023-06-02T15:30:42.666211+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:30:42.666211+0000","last_undegraded":"2023-06-02T15:30:42.666211+0000","last_fullsized":"2023-06-02T15:30:42.666211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678450+0000","last_change":"2023-06-02T15:30:38.277096+0000","last_active":"2023-06-02T15:30:42.678450+0000","last_peered":"2023-06-02T15:30:42.678450+0000","last_clean":"2023-06-02T15:30:42.678450+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:30:42.678450+0000","last_undegraded":"2023-06-02T15:30:42.678450+0000","last_fullsized":"2023-06-02T15:30:42.678450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.720822+0000","last_change":"2023-06-02T15:30:42.698823+0000","last_active":"2023-06-02T15:30:42.720822+0000","last_peered":"2023-06-02T15:30:42.720822+0000","last_clean":"2023-06-02T15:30:42.720822+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:30:42.720822+0000","last_undegraded":"2023-06-02T15:30:42.720822+0000","last_fullsized":"2023-06-02T15:30:42.720822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673925+0000","last_change":"2023-06-02T15:30:38.656372+0000","last_active":"2023-06-02T15:30:42.673925+0000","last_peered":"2023-06-02T15:30:42.673925+0000","last_clean":"2023-06-02T15:30:42.673925+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:30:42.673925+0000","last_undegraded":"2023-06-02T15:30:42.673925+0000","last_fullsized":"2023-06-02T15:30:42.673925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663851+0000","last_change":"2023-06-02T15:30:33.959737+0000","last_active":"2023-06-02T15:30:42.663851+0000","last_peered":"2023-06-02T15:30:42.663851+0000","last_clean":"2023-06-02T15:30:42.663851+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:30:42.663851+0000","last_undegraded":"2023-06-02T15:30:42.663851+0000","last_fullsized":"2023-06-02T15:30:42.663851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674797+0000","last_change":"2023-06-02T15:30:38.281667+0000","last_active":"2023-06-02T15:30:42.674797+0000","last_peered":"2023-06-02T15:30:42.674797+0000","last_clean":"2023-06-02T15:30:42.674797+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:30:42.674797+0000","last_undegraded":"2023-06-02T15:30:42.674797+0000","last_fullsized":"2023-06-02T15:30:42.674797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.718942+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:30:42.718942+0000","last_peered":"2023-06-02T15:30:42.718942+0000","last_clean":"2023-06-02T15:30:42.718942+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:30:42.718942+0000","last_undegraded":"2023-06-02T15:30:42.718942+0000","last_fullsized":"2023-06-02T15:30:42.718942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:02:01.714482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.660273+0000","last_change":"2023-06-02T15:30:38.646642+0000","last_active":"2023-06-02T15:30:42.660273+0000","last_peered":"2023-06-02T15:30:42.660273+0000","last_clean":"2023-06-02T15:30:42.660273+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:30:42.660273+0000","last_undegraded":"2023-06-02T15:30:42.660273+0000","last_fullsized":"2023-06-02T15:30:42.660273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669807+0000","last_change":"2023-06-02T15:30:33.413542+0000","last_active":"2023-06-02T15:30:42.669807+0000","last_peered":"2023-06-02T15:30:42.669807+0000","last_clean":"2023-06-02T15:30:42.669807+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:30:42.669807+0000","last_undegraded":"2023-06-02T15:30:42.669807+0000","last_fullsized":"2023-06-02T15:30:42.669807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-02T15:30:43.440541+0000","last_change":"2023-06-02T15:30:38.270941+0000","last_active":"2023-06-02T15:30:43.440541+0000","last_peered":"2023-06-02T15:30:43.440541+0000","last_clean":"2023-06-02T15:30:43.440541+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:30:43.440541+0000","last_undegraded":"2023-06-02T15:30:43.440541+0000","last_fullsized":"2023-06-02T15:30:43.440541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.711091+0000","last_change":"2023-06-02T15:30:42.702383+0000","last_active":"2023-06-02T15:30:42.711091+0000","last_peered":"2023-06-02T15:30:42.711091+0000","last_clean":"2023-06-02T15:30:42.711091+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:30:42.711091+0000","last_undegraded":"2023-06-02T15:30:42.711091+0000","last_fullsized":"2023-06-02T15:30:42.711091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:49:31.222291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.670681+0000","last_change":"2023-06-02T15:30:38.642398+0000","last_active":"2023-06-02T15:30:42.670681+0000","last_peered":"2023-06-02T15:30:42.670681+0000","last_clean":"2023-06-02T15:30:42.670681+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:30:42.670681+0000","last_undegraded":"2023-06-02T15:30:42.670681+0000","last_fullsized":"2023-06-02T15:30:42.670681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665469+0000","last_change":"2023-06-02T15:30:38.263733+0000","last_active":"2023-06-02T15:30:42.665469+0000","last_peered":"2023-06-02T15:30:42.665469+0000","last_clean":"2023-06-02T15:30:42.665469+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:30:42.665469+0000","last_undegraded":"2023-06-02T15:30:42.665469+0000","last_fullsized":"2023-06-02T15:30:42.665469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687342+0000","last_change":"2023-06-02T15:30:34.413807+0000","last_active":"2023-06-02T15:30:42.687342+0000","last_peered":"2023-06-02T15:30:42.687342+0000","last_clean":"2023-06-02T15:30:42.687342+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:30:42.687342+0000","last_undegraded":"2023-06-02T15:30:42.687342+0000","last_fullsized":"2023-06-02T15:30:42.687342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_clean_scrub_stamp":"2023-06-02T15:30:33.390390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:47:50.762629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678965+0000","last_change":"2023-06-02T15:30:33.411973+0000","last_active":"2023-06-02T15:30:42.678965+0000","last_peered":"2023-06-02T15:30:42.678965+0000","last_clean":"2023-06-02T15:30:42.678965+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:30:42.678965+0000","last_undegraded":"2023-06-02T15:30:42.678965+0000","last_fullsized":"2023-06-02T15:30:42.678965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721145+0000","last_change":"2023-06-02T15:30:42.712421+0000","last_active":"2023-06-02T15:30:42.721145+0000","last_peered":"2023-06-02T15:30:42.721145+0000","last_clean":"2023-06-02T15:30:42.721145+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:30:42.721145+0000","last_undegraded":"2023-06-02T15:30:42.721145+0000","last_fullsized":"2023-06-02T15:30:42.721145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:38:29.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679112+0000","last_change":"2023-06-02T15:30:38.653404+0000","last_active":"2023-06-02T15:30:42.679112+0000","last_peered":"2023-06-02T15:30:42.679112+0000","last_clean":"2023-06-02T15:30:42.679112+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:30:42.679112+0000","last_undegraded":"2023-06-02T15:30:42.679112+0000","last_fullsized":"2023-06-02T15:30:42.679112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675372+0000","last_change":"2023-06-02T15:30:38.269833+0000","last_active":"2023-06-02T15:30:42.675372+0000","last_peered":"2023-06-02T15:30:42.675372+0000","last_clean":"2023-06-02T15:30:42.675372+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:30:42.675372+0000","last_undegraded":"2023-06-02T15:30:42.675372+0000","last_fullsized":"2023-06-02T15:30:42.675372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:06:46.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687434+0000","last_change":"2023-06-02T15:30:33.654728+0000","last_active":"2023-06-02T15:30:42.687434+0000","last_peered":"2023-06-02T15:30:42.687434+0000","last_clean":"2023-06-02T15:30:42.687434+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:30:42.687434+0000","last_undegraded":"2023-06-02T15:30:42.687434+0000","last_fullsized":"2023-06-02T15:30:42.687434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:05:26.791938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.710087+0000","last_change":"2023-06-02T15:30:42.705191+0000","last_active":"2023-06-02T15:30:42.710087+0000","last_peered":"2023-06-02T15:30:42.710087+0000","last_clean":"2023-06-02T15:30:42.710087+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:30:42.710087+0000","last_undegraded":"2023-06-02T15:30:42.710087+0000","last_fullsized":"2023-06-02T15:30:42.710087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:22.765485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678163+0000","last_change":"2023-06-02T15:30:38.642359+0000","last_active":"2023-06-02T15:30:42.678163+0000","last_peered":"2023-06-02T15:30:42.678163+0000","last_clean":"2023-06-02T15:30:42.678163+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:30:42.678163+0000","last_undegraded":"2023-06-02T15:30:42.678163+0000","last_fullsized":"2023-06-02T15:30:42.678163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661971+0000","last_change":"2023-06-02T15:30:38.257531+0000","last_active":"2023-06-02T15:30:42.661971+0000","last_peered":"2023-06-02T15:30:42.661971+0000","last_clean":"2023-06-02T15:30:42.661971+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:30:42.661971+0000","last_undegraded":"2023-06-02T15:30:42.661971+0000","last_fullsized":"2023-06-02T15:30:42.661971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668731+0000","last_change":"2023-06-02T15:30:33.655250+0000","last_active":"2023-06-02T15:30:42.668731+0000","last_peered":"2023-06-02T15:30:42.668731+0000","last_clean":"2023-06-02T15:30:42.668731+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:30:42.668731+0000","last_undegraded":"2023-06-02T15:30:42.668731+0000","last_fullsized":"2023-06-02T15:30:42.668731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.695770+0000","last_change":"2023-06-02T15:30:42.693557+0000","last_active":"2023-06-02T15:30:42.695770+0000","last_peered":"2023-06-02T15:30:42.695770+0000","last_clean":"2023-06-02T15:30:42.695770+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:30:42.695770+0000","last_undegraded":"2023-06-02T15:30:42.695770+0000","last_fullsized":"2023-06-02T15:30:42.695770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665084+0000","last_change":"2023-06-02T15:30:38.645488+0000","last_active":"2023-06-02T15:30:42.665084+0000","last_peered":"2023-06-02T15:30:42.665084+0000","last_clean":"2023-06-02T15:30:42.665084+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:30:42.665084+0000","last_undegraded":"2023-06-02T15:30:42.665084+0000","last_fullsized":"2023-06-02T15:30:42.665084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669942+0000","last_change":"2023-06-02T15:30:38.283390+0000","last_active":"2023-06-02T15:30:42.669942+0000","last_peered":"2023-06-02T15:30:42.669942+0000","last_clean":"2023-06-02T15:30:42.669942+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:30:42.669942+0000","last_undegraded":"2023-06-02T15:30:42.669942+0000","last_fullsized":"2023-06-02T15:30:42.669942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687529+0000","last_change":"2023-06-02T15:30:33.653937+0000","last_active":"2023-06-02T15:30:42.687529+0000","last_peered":"2023-06-02T15:30:42.687529+0000","last_clean":"2023-06-02T15:30:42.687529+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:30:42.687529+0000","last_undegraded":"2023-06-02T15:30:42.687529+0000","last_fullsized":"2023-06-02T15:30:42.687529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.727044+0000","last_change":"2023-06-02T15:30:42.723169+0000","last_active":"2023-06-02T15:30:42.727044+0000","last_peered":"2023-06-02T15:30:42.727044+0000","last_clean":"2023-06-02T15:30:42.727044+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:30:42.727044+0000","last_undegraded":"2023-06-02T15:30:42.727044+0000","last_fullsized":"2023-06-02T15:30:42.727044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679007+0000","last_change":"2023-06-02T15:30:38.640964+0000","last_active":"2023-06-02T15:30:42.679007+0000","last_peered":"2023-06-02T15:30:42.679007+0000","last_clean":"2023-06-02T15:30:42.679007+0000","last_became_active":"2023-06-02T15:30:38.640643+0000","last_became_peered":"2023-06-02T15:30:38.640643+0000","last_unstale":"2023-06-02T15:30:42.679007+0000","last_undegraded":"2023-06-02T15:30:42.679007+0000","last_fullsized":"2023-06-02T15:30:42.679007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675412+0000","last_change":"2023-06-02T15:30:38.281851+0000","last_active":"2023-06-02T15:30:42.675412+0000","last_peered":"2023-06-02T15:30:42.675412+0000","last_clean":"2023-06-02T15:30:42.675412+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:30:42.675412+0000","last_undegraded":"2023-06-02T15:30:42.675412+0000","last_fullsized":"2023-06-02T15:30:42.675412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.715894+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:30:42.715894+0000","last_peered":"2023-06-02T15:30:42.715894+0000","last_clean":"2023-06-02T15:30:42.715894+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:30:42.715894+0000","last_undegraded":"2023-06-02T15:30:42.715894+0000","last_fullsized":"2023-06-02T15:30:42.715894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:44.594461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666012+0000","last_change":"2023-06-02T15:30:38.638725+0000","last_active":"2023-06-02T15:30:42.666012+0000","last_peered":"2023-06-02T15:30:42.666012+0000","last_clean":"2023-06-02T15:30:42.666012+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:30:42.666012+0000","last_undegraded":"2023-06-02T15:30:42.666012+0000","last_fullsized":"2023-06-02T15:30:42.666012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.660551+0000","last_change":"2023-06-02T15:30:38.269278+0000","last_active":"2023-06-02T15:30:42.660551+0000","last_peered":"2023-06-02T15:30:42.660551+0000","last_clean":"2023-06-02T15:30:42.660551+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:30:42.660551+0000","last_undegraded":"2023-06-02T15:30:42.660551+0000","last_fullsized":"2023-06-02T15:30:42.660551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721194+0000","last_change":"2023-06-02T15:30:42.713071+0000","last_active":"2023-06-02T15:30:42.721194+0000","last_peered":"2023-06-02T15:30:42.721194+0000","last_clean":"2023-06-02T15:30:42.721194+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:30:42.721194+0000","last_undegraded":"2023-06-02T15:30:42.721194+0000","last_fullsized":"2023-06-02T15:30:42.721194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663661+0000","last_change":"2023-06-02T15:30:38.636565+0000","last_active":"2023-06-02T15:30:42.663661+0000","last_peered":"2023-06-02T15:30:42.663661+0000","last_clean":"2023-06-02T15:30:42.663661+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:30:42.663661+0000","last_undegraded":"2023-06-02T15:30:42.663661+0000","last_fullsized":"2023-06-02T15:30:42.663661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:56:18.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.664010+0000","last_change":"2023-06-02T15:30:38.277404+0000","last_active":"2023-06-02T15:30:42.664010+0000","last_peered":"2023-06-02T15:30:42.664010+0000","last_clean":"2023-06-02T15:30:42.664010+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:30:42.664010+0000","last_undegraded":"2023-06-02T15:30:42.664010+0000","last_fullsized":"2023-06-02T15:30:42.664010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.702894+0000","last_change":"2023-06-02T15:30:42.697724+0000","last_active":"2023-06-02T15:30:42.702894+0000","last_peered":"2023-06-02T15:30:42.702894+0000","last_clean":"2023-06-02T15:30:42.702894+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:30:42.702894+0000","last_undegraded":"2023-06-02T15:30:42.702894+0000","last_fullsized":"2023-06-02T15:30:42.702894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663344+0000","last_change":"2023-06-02T15:30:38.640532+0000","last_active":"2023-06-02T15:30:42.663344+0000","last_peered":"2023-06-02T15:30:42.663344+0000","last_clean":"2023-06-02T15:30:42.663344+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:30:42.663344+0000","last_undegraded":"2023-06-02T15:30:42.663344+0000","last_fullsized":"2023-06-02T15:30:42.663344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674886+0000","last_change":"2023-06-02T15:30:38.281909+0000","last_active":"2023-06-02T15:30:42.674886+0000","last_peered":"2023-06-02T15:30:42.674886+0000","last_clean":"2023-06-02T15:30:42.674886+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:30:42.674886+0000","last_undegraded":"2023-06-02T15:30:42.674886+0000","last_fullsized":"2023-06-02T15:30:42.674886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.717898+0000","last_change":"2023-06-02T15:30:42.716337+0000","last_active":"2023-06-02T15:30:42.717898+0000","last_peered":"2023-06-02T15:30:42.717898+0000","last_clean":"2023-06-02T15:30:42.717898+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:30:42.717898+0000","last_undegraded":"2023-06-02T15:30:42.717898+0000","last_fullsized":"2023-06-02T15:30:42.717898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665919+0000","last_change":"2023-06-02T15:30:38.651270+0000","last_active":"2023-06-02T15:30:42.665919+0000","last_peered":"2023-06-02T15:30:42.665919+0000","last_clean":"2023-06-02T15:30:42.665919+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:30:42.665919+0000","last_undegraded":"2023-06-02T15:30:42.665919+0000","last_fullsized":"2023-06-02T15:30:42.665919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.667614+0000","last_change":"2023-06-02T15:30:38.277304+0000","last_active":"2023-06-02T15:30:42.667614+0000","last_peered":"2023-06-02T15:30:42.667614+0000","last_clean":"2023-06-02T15:30:42.667614+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:30:42.667614+0000","last_undegraded":"2023-06-02T15:30:42.667614+0000","last_fullsized":"2023-06-02T15:30:42.667614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.694829+0000","last_change":"2023-06-02T15:30:42.692861+0000","last_active":"2023-06-02T15:30:42.694829+0000","last_peered":"2023-06-02T15:30:42.694829+0000","last_clean":"2023-06-02T15:30:42.694829+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:30:42.694829+0000","last_undegraded":"2023-06-02T15:30:42.694829+0000","last_fullsized":"2023-06-02T15:30:42.694829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:29.857375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663612+0000","last_change":"2023-06-02T15:30:38.645534+0000","last_active":"2023-06-02T15:30:42.663612+0000","last_peered":"2023-06-02T15:30:42.663612+0000","last_clean":"2023-06-02T15:30:42.663612+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:30:42.663612+0000","last_undegraded":"2023-06-02T15:30:42.663612+0000","last_fullsized":"2023-06-02T15:30:42.663612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.692193+0000","last_change":"2023-06-02T15:30:38.282239+0000","last_active":"2023-06-02T15:30:42.692193+0000","last_peered":"2023-06-02T15:30:42.692193+0000","last_clean":"2023-06-02T15:30:42.692193+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:30:42.692193+0000","last_undegraded":"2023-06-02T15:30:42.692193+0000","last_fullsized":"2023-06-02T15:30:42.692193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:40.807809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.722484+0000","last_change":"2023-06-02T15:30:42.720849+0000","last_active":"2023-06-02T15:30:42.722484+0000","last_peered":"2023-06-02T15:30:42.722484+0000","last_clean":"2023-06-02T15:30:42.722484+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:30:42.722484+0000","last_undegraded":"2023-06-02T15:30:42.722484+0000","last_fullsized":"2023-06-02T15:30:42.722484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659621+0000","last_change":"2023-06-02T15:30:38.641746+0000","last_active":"2023-06-02T15:30:42.659621+0000","last_peered":"2023-06-02T15:30:42.659621+0000","last_clean":"2023-06-02T15:30:42.659621+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:30:42.659621+0000","last_undegraded":"2023-06-02T15:30:42.659621+0000","last_fullsized":"2023-06-02T15:30:42.659621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681113+0000","last_change":"2023-06-02T15:30:38.282724+0000","last_active":"2023-06-02T15:30:42.681113+0000","last_peered":"2023-06-02T15:30:42.681113+0000","last_clean":"2023-06-02T15:30:42.681113+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:30:42.681113+0000","last_undegraded":"2023-06-02T15:30:42.681113+0000","last_fullsized":"2023-06-02T15:30:42.681113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:21.387209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.701266+0000","last_change":"2023-06-02T15:30:42.697662+0000","last_active":"2023-06-02T15:30:42.701266+0000","last_peered":"2023-06-02T15:30:42.701266+0000","last_clean":"2023-06-02T15:30:42.701266+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:30:42.701266+0000","last_undegraded":"2023-06-02T15:30:42.701266+0000","last_fullsized":"2023-06-02T15:30:42.701266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:19.014996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673369+0000","last_change":"2023-06-02T15:30:38.656950+0000","last_active":"2023-06-02T15:30:42.673369+0000","last_peered":"2023-06-02T15:30:42.673369+0000","last_clean":"2023-06-02T15:30:42.673369+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:30:42.673369+0000","last_undegraded":"2023-06-02T15:30:42.673369+0000","last_fullsized":"2023-06-02T15:30:42.673369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.685248+0000","last_change":"2023-06-02T15:30:38.283602+0000","last_active":"2023-06-02T15:30:42.685248+0000","last_peered":"2023-06-02T15:30:42.685248+0000","last_clean":"2023-06-02T15:30:42.685248+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:30:42.685248+0000","last_undegraded":"2023-06-02T15:30:42.685248+0000","last_fullsized":"2023-06-02T15:30:42.685248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:33.362323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.727005+0000","last_change":"2023-06-02T15:30:42.722884+0000","last_active":"2023-06-02T15:30:42.727005+0000","last_peered":"2023-06-02T15:30:42.727005+0000","last_clean":"2023-06-02T15:30:42.727005+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:30:42.727005+0000","last_undegraded":"2023-06-02T15:30:42.727005+0000","last_fullsized":"2023-06-02T15:30:42.727005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.724350+0000","last_change":"2023-06-02T15:30:42.714188+0000","last_active":"2023-06-02T15:30:42.724350+0000","last_peered":"2023-06-02T15:30:42.724350+0000","last_clean":"2023-06-02T15:30:42.724350+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:30:42.724350+0000","last_undegraded":"2023-06-02T15:30:42.724350+0000","last_fullsized":"2023-06-02T15:30:42.724350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663139+0000","last_change":"2023-06-02T15:30:38.261610+0000","last_active":"2023-06-02T15:30:42.663139+0000","last_peered":"2023-06-02T15:30:42.663139+0000","last_clean":"2023-06-02T15:30:42.663139+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:30:42.663139+0000","last_undegraded":"2023-06-02T15:30:42.663139+0000","last_fullsized":"2023-06-02T15:30:42.663139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674925+0000","last_change":"2023-06-02T15:30:38.658984+0000","last_active":"2023-06-02T15:30:42.674925+0000","last_peered":"2023-06-02T15:30:42.674925+0000","last_clean":"2023-06-02T15:30:42.674925+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:30:42.674925+0000","last_undegraded":"2023-06-02T15:30:42.674925+0000","last_fullsized":"2023-06-02T15:30:42.674925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.712889+0000","last_change":"2023-06-02T15:30:42.705561+0000","last_active":"2023-06-02T15:30:42.712889+0000","last_peered":"2023-06-02T15:30:42.712889+0000","last_clean":"2023-06-02T15:30:42.712889+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:30:42.712889+0000","last_undegraded":"2023-06-02T15:30:42.712889+0000","last_fullsized":"2023-06-02T15:30:42.712889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:39:14.247511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.682004+0000","last_change":"2023-06-02T15:30:38.283796+0000","last_active":"2023-06-02T15:30:42.682004+0000","last_peered":"2023-06-02T15:30:42.682004+0000","last_clean":"2023-06-02T15:30:42.682004+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:30:42.682004+0000","last_undegraded":"2023-06-02T15:30:42.682004+0000","last_fullsized":"2023-06-02T15:30:42.682004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.672736+0000","last_change":"2023-06-02T15:30:38.644966+0000","last_active":"2023-06-02T15:30:42.672736+0000","last_peered":"2023-06-02T15:30:42.672736+0000","last_clean":"2023-06-02T15:30:42.672736+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:30:42.672736+0000","last_undegraded":"2023-06-02T15:30:42.672736+0000","last_fullsized":"2023-06-02T15:30:42.672736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666181+0000","last_change":"2023-06-02T15:30:38.265398+0000","last_active":"2023-06-02T15:30:42.666181+0000","last_peered":"2023-06-02T15:30:42.666181+0000","last_clean":"2023-06-02T15:30:42.666181+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:30:42.666181+0000","last_undegraded":"2023-06-02T15:30:42.666181+0000","last_fullsized":"2023-06-02T15:30:42.666181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:10:29.479149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680142+0000","last_change":"2023-06-02T15:30:38.657999+0000","last_active":"2023-06-02T15:30:42.680142+0000","last_peered":"2023-06-02T15:30:42.680142+0000","last_clean":"2023-06-02T15:30:42.680142+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:30:42.680142+0000","last_undegraded":"2023-06-02T15:30:42.680142+0000","last_fullsized":"2023-06-02T15:30:42.680142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.712989+0000","last_change":"2023-06-02T15:30:42.705725+0000","last_active":"2023-06-02T15:30:42.712989+0000","last_peered":"2023-06-02T15:30:42.712989+0000","last_clean":"2023-06-02T15:30:42.712989+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:30:42.712989+0000","last_undegraded":"2023-06-02T15:30:42.712989+0000","last_fullsized":"2023-06-02T15:30:42.712989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.684274+0000","last_change":"2023-06-02T15:30:38.282095+0000","last_active":"2023-06-02T15:30:42.684274+0000","last_peered":"2023-06-02T15:30:42.684274+0000","last_clean":"2023-06-02T15:30:42.684274+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:30:42.684274+0000","last_undegraded":"2023-06-02T15:30:42.684274+0000","last_fullsized":"2023-06-02T15:30:42.684274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668685+0000","last_change":"2023-06-02T15:30:38.651033+0000","last_active":"2023-06-02T15:30:42.668685+0000","last_peered":"2023-06-02T15:30:42.668685+0000","last_clean":"2023-06-02T15:30:42.668685+0000","last_became_active":"2023-06-02T15:30:38.650698+0000","last_became_peered":"2023-06-02T15:30:38.650698+0000","last_unstale":"2023-06-02T15:30:42.668685+0000","last_undegraded":"2023-06-02T15:30:42.668685+0000","last_fullsized":"2023-06-02T15:30:42.668685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721086+0000","last_change":"2023-06-02T15:30:42.702456+0000","last_active":"2023-06-02T15:30:42.721086+0000","last_peered":"2023-06-02T15:30:42.721086+0000","last_clean":"2023-06-02T15:30:42.721086+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:30:42.721086+0000","last_undegraded":"2023-06-02T15:30:42.721086+0000","last_fullsized":"2023-06-02T15:30:42.721086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663108+0000","last_change":"2023-06-02T15:30:38.637380+0000","last_active":"2023-06-02T15:30:42.663108+0000","last_peered":"2023-06-02T15:30:42.663108+0000","last_clean":"2023-06-02T15:30:42.663108+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:30:42.663108+0000","last_undegraded":"2023-06-02T15:30:42.663108+0000","last_fullsized":"2023-06-02T15:30:42.663108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666409+0000","last_change":"2023-06-02T15:30:38.655074+0000","last_active":"2023-06-02T15:30:42.666409+0000","last_peered":"2023-06-02T15:30:42.666409+0000","last_clean":"2023-06-02T15:30:42.666409+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:30:42.666409+0000","last_undegraded":"2023-06-02T15:30:42.666409+0000","last_fullsized":"2023-06-02T15:30:42.666409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661310+0000","last_change":"2023-06-02T15:30:38.637979+0000","last_active":"2023-06-02T15:30:42.661310+0000","last_peered":"2023-06-02T15:30:42.661310+0000","last_clean":"2023-06-02T15:30:42.661310+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:30:42.661310+0000","last_undegraded":"2023-06-02T15:30:42.661310+0000","last_fullsized":"2023-06-02T15:30:42.661310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674658+0000","last_change":"2023-06-02T15:30:38.659430+0000","last_active":"2023-06-02T15:30:42.674658+0000","last_peered":"2023-06-02T15:30:42.674658+0000","last_clean":"2023-06-02T15:30:42.674658+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:30:42.674658+0000","last_undegraded":"2023-06-02T15:30:42.674658+0000","last_fullsized":"2023-06-02T15:30:42.674658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679154+0000","last_change":"2023-06-02T15:30:38.656408+0000","last_active":"2023-06-02T15:30:42.679154+0000","last_peered":"2023-06-02T15:30:42.679154+0000","last_clean":"2023-06-02T15:30:42.679154+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:30:42.679154+0000","last_undegraded":"2023-06-02T15:30:42.679154+0000","last_fullsized":"2023-06-02T15:30:42.679154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679939+0000","last_change":"2023-06-02T15:30:38.658103+0000","last_active":"2023-06-02T15:30:42.679939+0000","last_peered":"2023-06-02T15:30:42.679939+0000","last_clean":"2023-06-02T15:30:42.679939+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:30:42.679939+0000","last_undegraded":"2023-06-02T15:30:42.679939+0000","last_fullsized":"2023-06-02T15:30:42.679939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678672+0000","last_change":"2023-06-02T15:30:38.641657+0000","last_active":"2023-06-02T15:30:42.678672+0000","last_peered":"2023-06-02T15:30:42.678672+0000","last_clean":"2023-06-02T15:30:42.678672+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:30:42.678672+0000","last_undegraded":"2023-06-02T15:30:42.678672+0000","last_fullsized":"2023-06-02T15:30:42.678672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:22.309633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678899+0000","last_change":"2023-06-02T15:30:38.640289+0000","last_active":"2023-06-02T15:30:42.678899+0000","last_peered":"2023-06-02T15:30:42.678899+0000","last_clean":"2023-06-02T15:30:42.678899+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:30:42.678899+0000","last_undegraded":"2023-06-02T15:30:42.678899+0000","last_fullsized":"2023-06-02T15:30:42.678899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687086+0000","last_change":"2023-06-02T15:30:38.656963+0000","last_active":"2023-06-02T15:30:42.687086+0000","last_peered":"2023-06-02T15:30:42.687086+0000","last_clean":"2023-06-02T15:30:42.687086+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:30:42.687086+0000","last_undegraded":"2023-06-02T15:30:42.687086+0000","last_fullsized":"2023-06-02T15:30:42.687086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666294+0000","last_change":"2023-06-02T15:30:38.648546+0000","last_active":"2023-06-02T15:30:42.666294+0000","last_peered":"2023-06-02T15:30:42.666294+0000","last_clean":"2023-06-02T15:30:42.666294+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:30:42.666294+0000","last_undegraded":"2023-06-02T15:30:42.666294+0000","last_fullsized":"2023-06-02T15:30:42.666294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666007+0000","last_change":"2023-06-02T15:30:38.643407+0000","last_active":"2023-06-02T15:30:42.666007+0000","last_peered":"2023-06-02T15:30:42.666007+0000","last_clean":"2023-06-02T15:30:42.666007+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:30:42.666007+0000","last_undegraded":"2023-06-02T15:30:42.666007+0000","last_fullsized":"2023-06-02T15:30:42.666007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.684038+0000","last_change":"2023-06-02T15:30:38.657038+0000","last_active":"2023-06-02T15:30:42.684038+0000","last_peered":"2023-06-02T15:30:42.684038+0000","last_clean":"2023-06-02T15:30:42.684038+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:30:42.684038+0000","last_undegraded":"2023-06-02T15:30:42.684038+0000","last_fullsized":"2023-06-02T15:30:42.684038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663138+0000","last_change":"2023-06-02T15:30:38.638594+0000","last_active":"2023-06-02T15:30:42.663138+0000","last_peered":"2023-06-02T15:30:42.663138+0000","last_clean":"2023-06-02T15:30:42.663138+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:30:42.663138+0000","last_undegraded":"2023-06-02T15:30:42.663138+0000","last_fullsized":"2023-06-02T15:30:42.663138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:28.604626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.654344+0000","last_change":"2023-06-02T15:30:38.638252+0000","last_active":"2023-06-02T15:30:42.654344+0000","last_peered":"2023-06-02T15:30:42.654344+0000","last_clean":"2023-06-02T15:30:42.654344+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:30:42.654344+0000","last_undegraded":"2023-06-02T15:30:42.654344+0000","last_fullsized":"2023-06-02T15:30:42.654344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:24.550049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665765+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:30:42.665765+0000","last_peered":"2023-06-02T15:30:42.665765+0000","last_clean":"2023-06-02T15:30:42.665765+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:30:42.665765+0000","last_undegraded":"2023-06-02T15:30:42.665765+0000","last_fullsized":"2023-06-02T15:30:42.665765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:14.924133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669090+0000","last_change":"2023-06-02T15:30:38.639262+0000","last_active":"2023-06-02T15:30:42.669090+0000","last_peered":"2023-06-02T15:30:42.669090+0000","last_clean":"2023-06-02T15:30:42.669090+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:30:42.669090+0000","last_undegraded":"2023-06-02T15:30:42.669090+0000","last_fullsized":"2023-06-02T15:30:42.669090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659193+0000","last_change":"2023-06-02T15:30:38.636435+0000","last_active":"2023-06-02T15:30:42.659193+0000","last_peered":"2023-06-02T15:30:42.659193+0000","last_clean":"2023-06-02T15:30:42.659193+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:30:42.659193+0000","last_undegraded":"2023-06-02T15:30:42.659193+0000","last_fullsized":"2023-06-02T15:30:42.659193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:41:54.216725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681786+0000","last_change":"2023-06-02T15:30:38.659341+0000","last_active":"2023-06-02T15:30:42.681786+0000","last_peered":"2023-06-02T15:30:42.681786+0000","last_clean":"2023-06-02T15:30:42.681786+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:30:42.681786+0000","last_undegraded":"2023-06-02T15:30:42.681786+0000","last_fullsized":"2023-06-02T15:30:42.681786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.671862+0000","last_change":"2023-06-02T15:30:38.636138+0000","last_active":"2023-06-02T15:30:42.671862+0000","last_peered":"2023-06-02T15:30:42.671862+0000","last_clean":"2023-06-02T15:30:42.671862+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:30:42.671862+0000","last_undegraded":"2023-06-02T15:30:42.671862+0000","last_fullsized":"2023-06-02T15:30:42.671862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.654567+0000","last_change":"2023-06-02T15:30:38.645755+0000","last_active":"2023-06-02T15:30:42.654567+0000","last_peered":"2023-06-02T15:30:42.654567+0000","last_clean":"2023-06-02T15:30:42.654567+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:30:42.654567+0000","last_undegraded":"2023-06-02T15:30:42.654567+0000","last_fullsized":"2023-06-02T15:30:42.654567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:40.298901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.653573+0000","last_change":"2023-06-02T15:30:38.644641+0000","last_active":"2023-06-02T15:30:42.653573+0000","last_peered":"2023-06-02T15:30:42.653573+0000","last_clean":"2023-06-02T15:30:42.653573+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:30:42.653573+0000","last_undegraded":"2023-06-02T15:30:42.653573+0000","last_fullsized":"2023-06-02T15:30:42.653573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:14.588404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663449+0000","last_change":"2023-06-02T15:30:38.650928+0000","last_active":"2023-06-02T15:30:42.663449+0000","last_peered":"2023-06-02T15:30:42.663449+0000","last_clean":"2023-06-02T15:30:42.663449+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:30:42.663449+0000","last_undegraded":"2023-06-02T15:30:42.663449+0000","last_fullsized":"2023-06-02T15:30:42.663449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.676823+0000","last_change":"2023-06-02T15:30:38.640368+0000","last_active":"2023-06-02T15:30:42.676823+0000","last_peered":"2023-06-02T15:30:42.676823+0000","last_clean":"2023-06-02T15:30:42.676823+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:30:42.676823+0000","last_undegraded":"2023-06-02T15:30:42.676823+0000","last_fullsized":"2023-06-02T15:30:42.676823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668907+0000","last_change":"2023-06-02T15:30:38.639440+0000","last_active":"2023-06-02T15:30:42.668907+0000","last_peered":"2023-06-02T15:30:42.668907+0000","last_clean":"2023-06-02T15:30:42.668907+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:30:42.668907+0000","last_undegraded":"2023-06-02T15:30:42.668907+0000","last_fullsized":"2023-06-02T15:30:42.668907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673165+0000","last_change":"2023-06-02T15:30:38.647961+0000","last_active":"2023-06-02T15:30:42.673165+0000","last_peered":"2023-06-02T15:30:42.673165+0000","last_clean":"2023-06-02T15:30:42.673165+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:30:42.673165+0000","last_undegraded":"2023-06-02T15:30:42.673165+0000","last_fullsized":"2023-06-02T15:30:42.673165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681575+0000","last_change":"2023-06-02T15:30:38.659299+0000","last_active":"2023-06-02T15:30:42.681575+0000","last_peered":"2023-06-02T15:30:42.681575+0000","last_clean":"2023-06-02T15:30:42.681575+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:30:42.681575+0000","last_undegraded":"2023-06-02T15:30:42.681575+0000","last_fullsized":"2023-06-02T15:30:42.681575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661036+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:30:42.661036+0000","last_peered":"2023-06-02T15:30:42.661036+0000","last_clean":"2023-06-02T15:30:42.661036+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:30:42.661036+0000","last_undegraded":"2023-06-02T15:30:42.661036+0000","last_fullsized":"2023-06-02T15:30:42.661036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:15:27.850958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666520+0000","last_change":"2023-06-02T15:30:38.639043+0000","last_active":"2023-06-02T15:30:42.666520+0000","last_peered":"2023-06-02T15:30:42.666520+0000","last_clean":"2023-06-02T15:30:42.666520+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:30:42.666520+0000","last_undegraded":"2023-06-02T15:30:42.666520+0000","last_fullsized":"2023-06-02T15:30:42.666520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663732+0000","last_change":"2023-06-02T15:30:38.637413+0000","last_active":"2023-06-02T15:30:42.663732+0000","last_peered":"2023-06-02T15:30:42.663732+0000","last_clean":"2023-06-02T15:30:42.663732+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:30:42.663732+0000","last_undegraded":"2023-06-02T15:30:42.663732+0000","last_fullsized":"2023-06-02T15:30:42.663732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:22.390984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659962+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:30:42.659962+0000","last_peered":"2023-06-02T15:30:42.659962+0000","last_clean":"2023-06-02T15:30:42.659962+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:30:42.659962+0000","last_undegraded":"2023-06-02T15:30:42.659962+0000","last_fullsized":"2023-06-02T15:30:42.659962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:17:55.191725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.676939+0000","last_change":"2023-06-02T15:30:38.650591+0000","last_active":"2023-06-02T15:30:42.676939+0000","last_peered":"2023-06-02T15:30:42.676939+0000","last_clean":"2023-06-02T15:30:42.676939+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:30:42.676939+0000","last_undegraded":"2023-06-02T15:30:42.676939+0000","last_fullsized":"2023-06-02T15:30:42.676939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.655693+0000","last_change":"2023-06-02T15:30:38.639026+0000","last_active":"2023-06-02T15:30:42.655693+0000","last_peered":"2023-06-02T15:30:42.655693+0000","last_clean":"2023-06-02T15:30:42.655693+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:30:42.655693+0000","last_undegraded":"2023-06-02T15:30:42.655693+0000","last_fullsized":"2023-06-02T15:30:42.655693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:49.394624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4385,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9128,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362712,"statfs":{"total":96636764160,"available":96627417088,"internally_reserved":0,"allocated":360448,"data_stored":703949,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8524,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363316,"statfs":{"total":96636764160,"available":96628035584,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92600000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8528,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363312,"statfs":{"total":96636764160,"available":96628031488,"internally_reserved":0,"allocated":270336,"data_stored":109412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8608,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363232,"statfs":{"total":96636764160,"available":96627949568,"internally_reserved":0,"allocated":286720,"data_stored":113421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8528,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363312,"statfs":{"total":96636764160,"available":96628031488,"internally_reserved":0,"allocated":270336,"data_stored":109852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8460,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363380,"statfs":{"total":96636764160,"available":96628101120,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9100,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362740,"statfs":{"total":96636764160,"available":96627445760,"internally_reserved":0,"allocated":331776,"data_stored":700130,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8588,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363252,"statfs":{"total":96636764160,"available":96627970048,"internally_reserved":0,"allocated":266240,"data_stored":109342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:30:56.079 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-06-02T15:30:56.079 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-06-02T15:30:56.079 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-06-02T15:30:56.080 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-06-02T15:30:56.080 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-06-02T15:30:56.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee6ef0c640 1 Processor -- start 2023-06-02T15:30:56.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee6ef0c640 1 -- start start 2023-06-02T15:30:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee6ef0c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fee680bc1c0 0x7fee6814bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee6ef0c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fee6814f330 0x7fee680a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee6ef0c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee680a0020 0x7fee681487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee6ef0c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6814ba90 con 0x7fee6814f330 2023-06-02T15:30:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee6ef0c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6814f7c0 con 0x7fee680a0020 2023-06-02T15:30:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee6ef0c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6814b440 con 0x7fee680bc1c0 2023-06-02T15:30:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee67fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fee6814f330 0x7fee680a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee67fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fee6814f330 0x7fee680a40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57392/0 (socket says 172.21.15.78:57392) 2023-06-02T15:30:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.226+0000 7fee67fff640 1 -- 172.21.15.78:0/1576554110 learned_addr learned my addr 172.21.15.78:0/1576554110 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6cca8640 1 --2- 172.21.15.78:0/1576554110 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fee680bc1c0 0x7fee6814bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6d4a9640 1 --2- 172.21.15.78:0/1576554110 >> v2:172.21.15.132:3300/0 conn(0x7fee680a0020 0x7fee681487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee67fff640 1 -- 172.21.15.78:0/1576554110 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fee680bc1c0 msgr2=0x7fee6814bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee67fff640 1 --2- 172.21.15.78:0/1576554110 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fee680bc1c0 0x7fee6814bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee67fff640 1 -- 172.21.15.78:0/1576554110 >> v2:172.21.15.132:3300/0 conn(0x7fee680a0020 msgr2=0x7fee681487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee67fff640 1 --2- 172.21.15.78:0/1576554110 >> v2:172.21.15.132:3300/0 conn(0x7fee680a0020 0x7fee681487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee67fff640 1 -- 172.21.15.78:0/1576554110 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6814b720 con 0x7fee6814f330 2023-06-02T15:30:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee67fff640 1 --2- 172.21.15.78:0/1576554110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 0x7fee680a40a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee6809fe90 tx=0x7fee5001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bc6d34dc59a5cb1 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:56.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee677fe640 1 -- 172.21.15.78:0/1576554110 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500ab600 con 0x7fee6814f330 2023-06-02T15:30:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee677fe640 1 -- 172.21.15.78:0/1576554110 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee500a7050 con 0x7fee6814f330 2023-06-02T15:30:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee677fe640 1 -- 172.21.15.78:0/1576554110 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee500ab980 con 0x7fee6814f330 2023-06-02T15:30:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1576554110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 msgr2=0x7fee680a40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6ef0c640 1 --2- 172.21.15.78:0/1576554110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 0x7fee680a40a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fee6809fe90 tx=0x7fee5001c3e0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1576554110 shutdown_connections 2023-06-02T15:30:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6ef0c640 1 --2- 172.21.15.78:0/1576554110 >> v2:172.21.15.132:3300/0 conn(0x7fee680a0020 0x7fee681487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6ef0c640 1 --2- 172.21.15.78:0/1576554110 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 0x7fee680a40a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6ef0c640 1 --2- 172.21.15.78:0/1576554110 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fee680bc1c0 0x7fee6814bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1576554110 >> 172.21.15.78:0/1576554110 conn(0x7fee680bcf50 msgr2=0x7fee680bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:56.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1576554110 shutdown_connections 2023-06-02T15:30:56.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.230+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1576554110 wait complete. 2023-06-02T15:30:56.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 Processor -- start 2023-06-02T15:30:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 -- start start 2023-06-02T15:30:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fee680a0020 0x7fee6813d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee680bc1c0 0x7fee680a2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 0x7fee680b9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee6813dd20 con 0x7fee6814f330 2023-06-02T15:30:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee680ba6f0 con 0x7fee680bc1c0 2023-06-02T15:30:56.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee6813d500 con 0x7fee680a0020 2023-06-02T15:30:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6d4a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 0x7fee680b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6d4a9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 0x7fee680b9880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57398/0 (socket says 172.21.15.78:57398) 2023-06-02T15:30:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6d4a9640 1 -- 172.21.15.78:0/1001644892 learned_addr learned my addr 172.21.15.78:0/1001644892 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee67fff640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee680bc1c0 0x7fee680a2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6cca8640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fee680a0020 0x7fee6813d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6d4a9640 1 -- 172.21.15.78:0/1001644892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fee680a0020 msgr2=0x7fee6813d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6d4a9640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fee680a0020 0x7fee6813d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6d4a9640 1 -- 172.21.15.78:0/1001644892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee680bc1c0 msgr2=0x7fee680a2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6d4a9640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee680bc1c0 0x7fee680a2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6d4a9640 1 -- 172.21.15.78:0/1001644892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500094d0 con 0x7fee6814f330 2023-06-02T15:30:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6d4a9640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 0x7fee680b9880 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee5800c590 tx=0x7fee5800ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee657fa640 1 -- 172.21.15.78:0/1001644892 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58004220 con 0x7fee6814f330 2023-06-02T15:30:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee657fa640 1 -- 172.21.15.78:0/1001644892 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee58004380 con 0x7fee6814f330 2023-06-02T15:30:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1001644892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee680a4770 con 0x7fee6814f330 2023-06-02T15:30:56.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee657fa640 1 -- 172.21.15.78:0/1001644892 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58003840 con 0x7fee6814f330 2023-06-02T15:30:56.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1001644892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee680a45e0 con 0x7fee6814f330 2023-06-02T15:30:56.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1001644892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6806c8b0 con 0x7fee6814f330 2023-06-02T15:30:56.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.234+0000 7fee657fa640 1 -- 172.21.15.78:0/1001644892 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fee580039a0 con 0x7fee6814f330 2023-06-02T15:30:56.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.238+0000 7fee657fa640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fee48065c00 0x7fee480680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.238+0000 7fee657fa640 1 -- 172.21.15.78:0/1001644892 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee580832f0 con 0x7fee6814f330 2023-06-02T15:30:56.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.238+0000 7fee6cca8640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fee48065c00 0x7fee480680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.238+0000 7fee6cca8640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fee48065c00 0x7fee480680b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fee600070b0 tx=0x7fee60007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:56.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.242+0000 7fee657fa640 1 -- 172.21.15.78:0/1001644892 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fee58050860 con 0x7fee6814f330 2023-06-02T15:30:56.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.426+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1001644892 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fee6814c640 con 0x7fee6814f330 2023-06-02T15:30:56.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.430+0000 7fee657fa640 1 -- 172.21.15.78:0/1001644892 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163170 (secure 0 0 0) 0x7fee6814c640 con 0x7fee6814f330 2023-06-02T15:30:56.442 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:56.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1001644892 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fee48065c00 msgr2=0x7fee480680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fee48065c00 0x7fee480680b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fee600070b0 tx=0x7fee60007040 comp rx=0 tx=0).stop 2023-06-02T15:30:56.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1001644892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 msgr2=0x7fee680b9880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 0x7fee680b9880 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fee5800c590 tx=0x7fee5800ca50 comp rx=0 tx=0).stop 2023-06-02T15:30:56.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1001644892 shutdown_connections 2023-06-02T15:30:56.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fee48065c00 0x7fee480680b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fee6814f330 0x7fee680b9880 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee680bc1c0 0x7fee680a2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 --2- 172.21.15.78:0/1001644892 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fee680a0020 0x7fee6813d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1001644892 >> 172.21.15.78:0/1001644892 conn(0x7fee680bcf50 msgr2=0x7fee680bb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:56.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1001644892 shutdown_connections 2023-06-02T15:30:56.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.434+0000 7fee6ef0c640 1 -- 172.21.15.78:0/1001644892 wait complete. 2023-06-02T15:30:56.460 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":37044},{"type":"v1","addr":"172.21.15.78:6833","nonce":37044}]},"active_addr":"172.21.15.78:6833/37044","active_change":"2023-06-02T15:30:25.201103+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2788666291}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":565556297}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3262139059}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2607727306}]}]} 2023-06-02T15:30:56.465 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-06-02T15:30:56.466 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-06-02T15:30:56.466 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:56.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50ea887640 1 Processor -- start 2023-06-02T15:30:56.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50ea887640 1 -- start start 2023-06-02T15:30:56.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50ea887640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f50e406bd00 0x7f50e40bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50ea887640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e40c0730 con 0x7f50e40b7fc0 2023-06-02T15:30:56.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50ea887640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e40c0b20 con 0x7f50e40bf2b0 2023-06-02T15:30:56.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50ea887640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e406b5f0 con 0x7f50e406bd00 2023-06-02T15:30:56.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e8e24640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f50e40b7fc0 0x7f50e41521c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55890/0 (socket says 172.21.15.78:55890) 2023-06-02T15:30:56.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e8e24640 1 -- 172.21.15.78:0/4057684469 learned_addr learned my addr 172.21.15.78:0/4057684469 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:56.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e3fff640 1 --2- 172.21.15.78:0/4057684469 >> v2:172.21.15.132:3300/0 conn(0x7f50e406bd00 0x7f50e40bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 381857772 0 0) 0x7f50e40c0730 con 0x7f50e40b7fc0 2023-06-02T15:30:56.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50cc003530 con 0x7f50e40b7fc0 2023-06-02T15:30:56.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3543518165 0 0) 0x7f50cc003530 con 0x7f50e40b7fc0 2023-06-02T15:30:56.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 >> v2:172.21.15.132:3300/0 conn(0x7f50e406bd00 msgr2=0x7f50e40bff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:56.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 --2- 172.21.15.78:0/4057684469 >> v2:172.21.15.132:3300/0 conn(0x7f50e406bd00 0x7f50e40bff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 >> v1:172.21.15.132:6789/0 conn(0x7f50e40bf2b0 legacy=0x7f50e4069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40aa880 con 0x7f50e40b7fc0 2023-06-02T15:30:56.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f50dc001a00 con 0x7f50e40b7fc0 2023-06-02T15:30:56.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 >> v1:172.21.15.78:6789/0 conn(0x7f50e40b7fc0 legacy=0x7f50e41521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 --2- 172.21.15.78:0/4057684469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50cc003980 0x7f50cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 --2- 172.21.15.78:0/4057684469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50cc0047d0 0x7f50cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 --2- 172.21.15.78:0/4057684469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50cc005180 0x7f50cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc00bfb0 con 0x7f50cc005180 2023-06-02T15:30:56.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc00c120 con 0x7f50cc003980 2023-06-02T15:30:56.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50cc00c2e0 con 0x7f50cc0047d0 2023-06-02T15:30:56.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e8e24640 1 --2- 172.21.15.78:0/4057684469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50cc005180 0x7f50cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e37fe640 1 --2- 172.21.15.78:0/4057684469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50cc0047d0 0x7f50cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e8e24640 1 -- 172.21.15.78:0/4057684469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50cc0047d0 msgr2=0x7f50cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:56.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e8e24640 1 --2- 172.21.15.78:0/4057684469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50cc0047d0 0x7f50cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e8e24640 1 -- 172.21.15.78:0/4057684469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50cc003980 msgr2=0x7f50cc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e8e24640 1 --2- 172.21.15.78:0/4057684469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50cc003980 0x7f50cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.582+0000 7f50e8e24640 1 -- 172.21.15.78:0/4057684469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc003530 con 0x7f50cc005180 2023-06-02T15:30:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50e8e24640 1 -- 172.21.15.78:0/4057684469 reap_dead start 2023-06-02T15:30:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50e8e24640 1 --2- 172.21.15.78:0/4057684469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50cc005180 0x7f50cc00b990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00a820 tx=0x7f50dc01d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78766535e805a76b server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc0072d0 con 0x7f50cc005180 2023-06-02T15:30:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50dc0a8070 con 0x7f50cc005180 2023-06-02T15:30:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50e2ffd640 1 -- 172.21.15.78:0/4057684469 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50dc007690 con 0x7f50cc005180 2023-06-02T15:30:56.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50ea887640 1 -- 172.21.15.78:0/4057684469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50cc005180 msgr2=0x7f50cc00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50ea887640 1 --2- 172.21.15.78:0/4057684469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50cc005180 0x7f50cc00b990 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00a820 tx=0x7f50dc01d320 comp rx=0 tx=0).stop 2023-06-02T15:30:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50ea887640 1 -- 172.21.15.78:0/4057684469 shutdown_connections 2023-06-02T15:30:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50ea887640 1 --2- 172.21.15.78:0/4057684469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50cc005180 0x7f50cc00b990 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50ea887640 1 -- 172.21.15.78:0/4057684469 >> 172.21.15.78:0/4057684469 conn(0x7f50e40a6480 msgr2=0x7f50e40a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50ea887640 1 -- 172.21.15.78:0/4057684469 shutdown_connections 2023-06-02T15:30:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50ea887640 1 -- 172.21.15.78:0/4057684469 wait complete. 2023-06-02T15:30:56.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50ea887640 1 Processor -- start 2023-06-02T15:30:56.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.586+0000 7f50ea887640 1 -- start start 2023-06-02T15:30:56.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50ea887640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50cc005180 0x7f50e41e3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50ea887640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e41d25d0 0x7f50e41d4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50ea887640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40bd8f0 0x7f50e41e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50ea887640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e41d3050 con 0x7f50e41d25d0 2023-06-02T15:30:56.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50ea887640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e40bd340 con 0x7f50e40bd8f0 2023-06-02T15:30:56.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50ea887640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e41e3ea0 con 0x7f50cc005180 2023-06-02T15:30:56.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e41d25d0 0x7f50e41d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e41d25d0 0x7f50e41d4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57418/0 (socket says 172.21.15.78:57418) 2023-06-02T15:30:56.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e37fe640 1 -- 172.21.15.78:0/2690515208 learned_addr learned my addr 172.21.15.78:0/2690515208 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:56.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e37fe640 1 -- 172.21.15.78:0/2690515208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50cc005180 msgr2=0x7f50e41e3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e3fff640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50cc005180 0x7f50e41e3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e37fe640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50cc005180 0x7f50e41e3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e37fe640 1 -- 172.21.15.78:0/2690515208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40bd8f0 msgr2=0x7f50e41e64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e37fe640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40bd8f0 0x7f50e41e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e37fe640 1 -- 172.21.15.78:0/2690515208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e40c1310 con 0x7f50e41d25d0 2023-06-02T15:30:56.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e37fe640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e41d25d0 0x7f50e41d4090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f50d800e4b0 tx=0x7f50d800e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:56.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e0ff9640 1 -- 172.21.15.78:0/2690515208 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d80052e0 con 0x7f50e41d25d0 2023-06-02T15:30:56.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e0ff9640 1 -- 172.21.15.78:0/2690515208 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d8005440 con 0x7f50e41d25d0 2023-06-02T15:30:56.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50ea887640 1 -- 172.21.15.78:0/2690515208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e40c0d70 con 0x7f50e41d25d0 2023-06-02T15:30:56.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e0ff9640 1 -- 172.21.15.78:0/2690515208 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d8003840 con 0x7f50e41d25d0 2023-06-02T15:30:56.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50ea887640 1 -- 172.21.15.78:0/2690515208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e406c0d0 con 0x7f50e41d25d0 2023-06-02T15:30:56.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50ea887640 1 -- 172.21.15.78:0/2690515208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e40be530 con 0x7f50e41d25d0 2023-06-02T15:30:56.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e0ff9640 1 -- 172.21.15.78:0/2690515208 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f50d80039a0 con 0x7f50e41d25d0 2023-06-02T15:30:56.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e0ff9640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f50d0065c30 0x7f50d00680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e0ff9640 1 -- 172.21.15.78:0/2690515208 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f50d8083ab0 con 0x7f50e41d25d0 2023-06-02T15:30:56.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.590+0000 7f50e3fff640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f50d0065c30 0x7f50d00680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.594+0000 7f50e3fff640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f50d0065c30 0x7f50d00680e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50d40047c0 tx=0x7f50d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:56.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.594+0000 7f50e0ff9640 1 -- 172.21.15.78:0/2690515208 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f50d8054b00 con 0x7f50e41d25d0 2023-06-02T15:30:56.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.746+0000 7f50ea887640 1 -- 172.21.15.78:0/2690515208 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50e40c4580 con 0x7f50e41d25d0 2023-06-02T15:30:56.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50e0ff9640 1 -- 172.21.15.78:0/2690515208 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f50d8054690 con 0x7f50e41d25d0 2023-06-02T15:30:56.758 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:56.758 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 -- 172.21.15.78:0/2690515208 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f50d0065c30 msgr2=0x7f50d00680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f50d0065c30 0x7f50d00680e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f50d40047c0 tx=0x7f50d4008040 comp rx=0 tx=0).stop 2023-06-02T15:30:56.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 -- 172.21.15.78:0/2690515208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e41d25d0 msgr2=0x7f50e41d4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e41d25d0 0x7f50e41d4090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f50d800e4b0 tx=0x7f50d800e970 comp rx=0 tx=0).stop 2023-06-02T15:30:56.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 -- 172.21.15.78:0/2690515208 shutdown_connections 2023-06-02T15:30:56.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50e40bd8f0 0x7f50e41e64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f50d0065c30 0x7f50d00680e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50e41d25d0 0x7f50e41d4090 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 --2- 172.21.15.78:0/2690515208 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f50cc005180 0x7f50e41e3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 -- 172.21.15.78:0/2690515208 >> 172.21.15.78:0/2690515208 conn(0x7f50e40a6480 msgr2=0x7f50e406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:56.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 -- 172.21.15.78:0/2690515208 shutdown_connections 2023-06-02T15:30:56.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.750+0000 7f50ea887640 1 -- 172.21.15.78:0/2690515208 wait complete. 2023-06-02T15:30:56.779 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-06-02T15:30:56.780 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:30:56.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.886+0000 7f639f810640 1 Processor -- start 2023-06-02T15:30:56.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.886+0000 7f639f810640 1 -- start start 2023-06-02T15:30:56.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f639f810640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63980bc1c0 0x7f639814bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f639f810640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639814ba90 con 0x7f63980a0020 2023-06-02T15:30:56.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f639f810640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63980a47b0 con 0x7f639814f330 2023-06-02T15:30:56.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f639f810640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639814f7c0 con 0x7f63980bc1c0 2023-06-02T15:30:56.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f639d5ac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63980bc1c0 0x7f639814bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f639d5ac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63980bc1c0 0x7f639814bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57424/0 (socket says 172.21.15.78:57424) 2023-06-02T15:30:56.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f639d5ac640 1 -- 172.21.15.78:0/1020495731 learned_addr learned my addr 172.21.15.78:0/1020495731 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:56.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f639d5ac640 1 -- 172.21.15.78:0/1020495731 >> v1:172.21.15.132:6789/0 conn(0x7f639814f330 legacy=0x7f63980a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:56.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f639d5ac640 1 -- 172.21.15.78:0/1020495731 >> v1:172.21.15.78:6789/0 conn(0x7f63980a0020 legacy=0x7f63981487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f638ffff640 1 -- 172.21.15.78:0/1020495731 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2807759070 0 0) 0x7f639814ba90 con 0x7f63980a0020 2023-06-02T15:30:56.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.890+0000 7f639d5ac640 1 -- 172.21.15.78:0/1020495731 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639814b440 con 0x7f63980bc1c0 2023-06-02T15:30:56.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639d5ac640 1 --2- 172.21.15.78:0/1020495731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bc1c0 0x7f639814bf20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6388009870 tx=0x7f638801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=800dca9a12abad69 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:56.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f638ffff640 1 -- 172.21.15.78:0/1020495731 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63880ad680 con 0x7f63980bc1c0 2023-06-02T15:30:56.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f638ffff640 1 -- 172.21.15.78:0/1020495731 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63880ad7e0 con 0x7f63980bc1c0 2023-06-02T15:30:56.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f638ffff640 1 -- 172.21.15.78:0/1020495731 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63880adb70 con 0x7f63980bc1c0 2023-06-02T15:30:56.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 -- 172.21.15.78:0/1020495731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bc1c0 msgr2=0x7f639814bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 --2- 172.21.15.78:0/1020495731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bc1c0 0x7f639814bf20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6388009870 tx=0x7f638801c470 comp rx=0 tx=0).stop 2023-06-02T15:30:56.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 -- 172.21.15.78:0/1020495731 shutdown_connections 2023-06-02T15:30:56.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 --2- 172.21.15.78:0/1020495731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63980bc1c0 0x7f639814bf20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 -- 172.21.15.78:0/1020495731 >> 172.21.15.78:0/1020495731 conn(0x7f63980bcf50 msgr2=0x7f63980bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:56.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 -- 172.21.15.78:0/1020495731 shutdown_connections 2023-06-02T15:30:56.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 -- 172.21.15.78:0/1020495731 wait complete. 2023-06-02T15:30:56.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 Processor -- start 2023-06-02T15:30:56.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 -- start start 2023-06-02T15:30:56.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980a0020 0x7f639806ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63980bc1c0 0x7f63980bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f639814f330 0x7f639806f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980beb30 con 0x7f639814f330 2023-06-02T15:30:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63980bf830 con 0x7f63980bc1c0 2023-06-02T15:30:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639806fbc0 con 0x7f63980a0020 2023-06-02T15:30:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639ddad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f639814f330 0x7f639806f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639ddad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f639814f330 0x7f639806f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57426/0 (socket says 172.21.15.78:57426) 2023-06-02T15:30:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639ddad640 1 -- 172.21.15.78:0/2334913931 learned_addr learned my addr 172.21.15.78:0/2334913931 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639cdab640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63980bc1c0 0x7f63980bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639d5ac640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980a0020 0x7f639806ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639ddad640 1 -- 172.21.15.78:0/2334913931 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980a0020 msgr2=0x7f639806ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639ddad640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980a0020 0x7f639806ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639ddad640 1 -- 172.21.15.78:0/2334913931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63980bc1c0 msgr2=0x7f63980bf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639ddad640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63980bc1c0 0x7f63980bf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639ddad640 1 -- 172.21.15.78:0/2334913931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63880094d0 con 0x7f639814f330 2023-06-02T15:30:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639ddad640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f639814f330 0x7f639806f680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6390002240 tx=0x7f639000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:56.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f638dffb640 1 -- 172.21.15.78:0/2334913931 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390003db0 con 0x7f639814f330 2023-06-02T15:30:56.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f638dffb640 1 -- 172.21.15.78:0/2334913931 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639000ce30 con 0x7f639814f330 2023-06-02T15:30:56.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.894+0000 7f639f810640 1 -- 172.21.15.78:0/2334913931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63980bc720 con 0x7f639814f330 2023-06-02T15:30:56.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.898+0000 7f638dffb640 1 -- 172.21.15.78:0/2334913931 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390005270 con 0x7f639814f330 2023-06-02T15:30:56.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.898+0000 7f639f810640 1 -- 172.21.15.78:0/2334913931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63980bc590 con 0x7f639814f330 2023-06-02T15:30:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.898+0000 7f639f810640 1 -- 172.21.15.78:0/2334913931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63980bca00 con 0x7f639814f330 2023-06-02T15:30:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.898+0000 7f638dffb640 1 -- 172.21.15.78:0/2334913931 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f63900053d0 con 0x7f639814f330 2023-06-02T15:30:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.898+0000 7f638dffb640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f637c065c00 0x7f637c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:56.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.898+0000 7f638dffb640 1 -- 172.21.15.78:0/2334913931 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6390082d20 con 0x7f639814f330 2023-06-02T15:30:56.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.898+0000 7f639d5ac640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f637c065c00 0x7f637c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:56.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.898+0000 7f639d5ac640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f637c065c00 0x7f637c0680b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63880af000 tx=0x7f6388008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:56.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:56.902+0000 7f638dffb640 1 -- 172.21.15.78:0/2334913931 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f639004a6e0 con 0x7f639814f330 2023-06-02T15:30:57.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.050+0000 7f639f810640 1 -- 172.21.15.78:0/2334913931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6398073bc0 con 0x7f639814f330 2023-06-02T15:30:57.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.054+0000 7f638dffb640 1 -- 172.21.15.78:0/2334913931 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f6390017070 con 0x7f639814f330 2023-06-02T15:30:57.062 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:30:57.063 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:30:57.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 -- 172.21.15.78:0/2334913931 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f637c065c00 msgr2=0x7f637c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f637c065c00 0x7f637c0680b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63880af000 tx=0x7f6388008040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 -- 172.21.15.78:0/2334913931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f639814f330 msgr2=0x7f639806f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f639814f330 0x7f639806f680 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6390002240 tx=0x7f639000cbe0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 -- 172.21.15.78:0/2334913931 shutdown_connections 2023-06-02T15:30:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f637c065c00 0x7f637c0680b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f639814f330 0x7f639806f680 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63980bc1c0 0x7f63980bf2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 --2- 172.21.15.78:0/2334913931 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63980a0020 0x7f639806ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 -- 172.21.15.78:0/2334913931 >> 172.21.15.78:0/2334913931 conn(0x7f63980bcf50 msgr2=0x7f63981477d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 -- 172.21.15.78:0/2334913931 shutdown_connections 2023-06-02T15:30:57.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.058+0000 7f639f810640 1 -- 172.21.15.78:0/2334913931 wait complete. 2023-06-02T15:30:57.081 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-06-02T15:30:57.081 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-06-02T15:30:57.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-06-02T15:30:57.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-06-02T15:30:57.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-06-02T15:30:57.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-06-02T15:30:57.084 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-06-02T15:30:57.084 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-06-02T15:30:57.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc775b50640 1 Processor -- start 2023-06-02T15:30:57.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc775b50640 1 -- start start 2023-06-02T15:30:57.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc775b50640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc77006a400 0x7fc7700a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc775b50640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc77014a6d0 0x7fc77014ab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc775b50640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7700bc4c0 con 0x7fc770070ab0 2023-06-02T15:30:57.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc775b50640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7700bb140 con 0x7fc77014a6d0 2023-06-02T15:30:57.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc775b50640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7700bc710 con 0x7fc77006a400 2023-06-02T15:30:57.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc76ffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc77014a6d0 0x7fc77014ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc76effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc770070ab0 0x7fc770070ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:39860/0 (socket says 172.21.15.78:39860) 2023-06-02T15:30:57.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc76effd640 1 -- 172.21.15.78:0/1007180203 learned_addr learned my addr 172.21.15.78:0/1007180203 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc76f7fe640 1 --2- 172.21.15.78:0/1007180203 >> v2:172.21.15.132:3300/0 conn(0x7fc77006a400 0x7fc7700a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc76f7fe640 1 -- 172.21.15.78:0/1007180203 >> v2:172.21.15.78:3300/0 conn(0x7fc77014a6d0 msgr2=0x7fc77014ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc76f7fe640 1 --2- 172.21.15.78:0/1007180203 >> v2:172.21.15.78:3300/0 conn(0x7fc77014a6d0 0x7fc77014ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc76f7fe640 1 -- 172.21.15.78:0/1007180203 >> v1:172.21.15.132:6789/0 conn(0x7fc770070ab0 legacy=0x7fc770070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc76e7fc640 1 -- 172.21.15.78:0/1007180203 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3388387316 0 0) 0x7fc7700bc4c0 con 0x7fc770070ab0 2023-06-02T15:30:57.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc76f7fe640 1 -- 172.21.15.78:0/1007180203 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77014b050 con 0x7fc77006a400 2023-06-02T15:30:57.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f6c3c6f4640 1 Processor -- start 2023-06-02T15:30:57.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f6c3c6f4640 1 -- start start 2023-06-02T15:30:57.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f243d54d640 1 Processor -- start 2023-06-02T15:30:57.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f243d54d640 1 -- start start 2023-06-02T15:30:57.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7fc76ffff640 1 --2- 172.21.15.78:0/1007180203 >> v2:172.21.15.78:3300/0 conn(0x7fc77014a6d0 0x7fc77014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:57.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f6c3c6f4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c340bd010 0x7f6c34153010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f243d54d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24300070c0 0x7f243000b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f6c3c6f4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c34153550 0x7f6c341568f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f243d54d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243000b360 con 0x7f2430041940 2023-06-02T15:30:57.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f243d54d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2430009dd0 con 0x7f2430046b80 2023-06-02T15:30:57.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f243d54d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243000a4e0 con 0x7f24300070c0 2023-06-02T15:30:57.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f6c3c6f4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c340bb7c0 con 0x7f6c340a2280 2023-06-02T15:30:57.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f6c3c6f4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340a2a30 con 0x7f6c34153550 2023-06-02T15:30:57.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f6c3c6f4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c340a18f0 con 0x7f6c340bd010 2023-06-02T15:30:57.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f6c39c8f640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f6c340a2280 0x7f6c341561e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55912/0 (socket says 172.21.15.78:55912) 2023-06-02T15:30:57.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f6c39c8f640 1 -- 172.21.15.78:0/1876889265 learned_addr learned my addr 172.21.15.78:0/1876889265 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.250+0000 7f2436ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2430041940 0x7f24300e3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55910/0 (socket says 172.21.15.78:55910) 2023-06-02T15:30:57.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f2436ffd640 1 -- 172.21.15.78:0/1432724527 learned_addr learned my addr 172.21.15.78:0/1432724527 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f24367fc640 1 --2- 172.21.15.78:0/1432724527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24300070c0 0x7f243000b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f6c3ac91640 1 --2- 172.21.15.78:0/1876889265 >> v2:172.21.15.132:3300/0 conn(0x7f6c34153550 0x7f6c341568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f6c3948e640 1 -- 172.21.15.78:0/1876889265 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 676905383 0 0) 0x7f6c30001120 con 0x7f6c340a2280 2023-06-02T15:30:57.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f6c3948e640 1 -- 172.21.15.78:0/1876889265 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c20003530 con 0x7f6c340a2280 2023-06-02T15:30:57.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f6c3a490640 1 --2- 172.21.15.78:0/1876889265 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c340bd010 0x7f6c34153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f2437fff640 1 -- 172.21.15.78:0/1432724527 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3484033589 0 0) 0x7f243000b360 con 0x7f2430041940 2023-06-02T15:30:57.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f24367fc640 1 -- 172.21.15.78:0/1432724527 >> v1:172.21.15.132:6789/0 conn(0x7f2430046b80 legacy=0x7f2430044ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f24367fc640 1 -- 172.21.15.78:0/1432724527 >> v1:172.21.15.78:6789/0 conn(0x7f2430041940 legacy=0x7f24300e3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f24367fc640 1 -- 172.21.15.78:0/1432724527 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24300265b0 con 0x7f24300070c0 2023-06-02T15:30:57.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f6c3ac91640 1 -- 172.21.15.78:0/1876889265 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c340bd010 msgr2=0x7f6c34153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f6c3ac91640 1 --2- 172.21.15.78:0/1876889265 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c340bd010 0x7f6c34153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f6c3ac91640 1 -- 172.21.15.78:0/1876889265 >> v1:172.21.15.78:6789/0 conn(0x7f6c340a2280 legacy=0x7f6c341561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f6c3ac91640 1 -- 172.21.15.78:0/1876889265 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c341528c0 con 0x7f6c34153550 2023-06-02T15:30:57.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f8ea4709640 1 Processor -- start 2023-06-02T15:30:57.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f86a6921640 1 Processor -- start 2023-06-02T15:30:57.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f8ea4709640 1 -- start start 2023-06-02T15:30:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fc76f7fe640 1 --2- 172.21.15.78:0/1007180203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc77006a400 0x7fc7700a3ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7700c14a0 tx=0x7fc76001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3cadcdec7adc1ab server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fc76e7fc640 1 -- 172.21.15.78:0/1007180203 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600a8950 con 0x7fc77006a400 2023-06-02T15:30:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fc76e7fc640 1 -- 172.21.15.78:0/1007180203 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7600a8ab0 con 0x7fc77006a400 2023-06-02T15:30:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fc76e7fc640 1 -- 172.21.15.78:0/1007180203 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7600a8e40 con 0x7fc77006a400 2023-06-02T15:30:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f8ea4709640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c0bb000 0x7f8e9c0bc890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f8ea4709640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8e9c14dfa0 0x7f8e9c14e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f86a6921640 1 -- start start 2023-06-02T15:30:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f86a6921640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f86a00a2720 0x7f86a014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f86a6921640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a00a1200 con 0x7f86a0153590 2023-06-02T15:30:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f86a6921640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a006cee0 con 0x7f86a00bd790 2023-06-02T15:30:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f86a6921640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a00bbff0 con 0x7f86a00a2720 2023-06-02T15:30:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f8ea4709640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9c0bc290 con 0x7f8e9c14b240 2023-06-02T15:30:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f8ea4709640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c0bbd60 con 0x7f8e9c14dfa0 2023-06-02T15:30:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f8ea4709640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0bc4c0 con 0x7f8e9c0bb000 2023-06-02T15:30:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f8ea24a5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8e9c14b240 0x7f8e9c0a3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:39886/0 (socket says 172.21.15.78:39886) 2023-06-02T15:30:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f8ea24a5640 1 -- 172.21.15.78:0/1747040327 learned_addr learned my addr 172.21.15.78:0/1747040327 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f86a6120640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f86a0153590 0x7f86a015d200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55922/0 (socket says 172.21.15.78:55922) 2023-06-02T15:30:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f86a6120640 1 -- 172.21.15.78:0/3625869181 learned_addr learned my addr 172.21.15.78:0/3625869181 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f8ea1ca4640 1 --2- 172.21.15.78:0/1747040327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c0bb000 0x7f8e9c0bc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f24367fc640 1 --2- 172.21.15.78:0/1432724527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24300070c0 0x7f243000b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f24280097f0 tx=0x7f242801ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb07252e181b0c83 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fc775b50640 1 -- 172.21.15.78:0/1007180203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc77006a400 msgr2=0x7fc7700a3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fc775b50640 1 --2- 172.21.15.78:0/1007180203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc77006a400 0x7fc7700a3ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc7700c14a0 tx=0x7fc76001ec90 comp rx=0 tx=0).stop 2023-06-02T15:30:57.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f86a511e640 1 --2- 172.21.15.78:0/3625869181 >> v2:172.21.15.132:3300/0 conn(0x7f86a00a2720 0x7f86a014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3410466680 0 0) 0x7f86a00a1200 con 0x7f86a0153590 2023-06-02T15:30:57.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f868c003530 con 0x7f86a0153590 2023-06-02T15:30:57.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f8ea2ca6640 1 --2- 172.21.15.78:0/1747040327 >> v2:172.21.15.132:3300/0 conn(0x7f8e9c14dfa0 0x7f8e9c14e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fd7ffeaf640 1 Processor -- start 2023-06-02T15:30:57.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7ffeaf640 1 -- start start 2023-06-02T15:30:57.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fc775b50640 1 -- 172.21.15.78:0/1007180203 shutdown_connections 2023-06-02T15:30:57.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fc775b50640 1 --2- 172.21.15.78:0/1007180203 >> v2:172.21.15.78:3300/0 conn(0x7fc77014a6d0 0x7fc77014ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fc775b50640 1 --2- 172.21.15.78:0/1007180203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc77006a400 0x7fc7700a3ea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.254+0000 7fc775b50640 1 -- 172.21.15.78:0/1007180203 >> 172.21.15.78:0/1007180203 conn(0x7fc7700698f0 msgr2=0x7fc770069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f8ea1ca4640 1 -- 172.21.15.78:0/1747040327 >> v2:172.21.15.132:3300/0 conn(0x7f8e9c14dfa0 msgr2=0x7f8e9c14e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f8ea1ca4640 1 --2- 172.21.15.78:0/1747040327 >> v2:172.21.15.132:3300/0 conn(0x7f8e9c14dfa0 0x7f8e9c14e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f8ea14a3640 1 -- 172.21.15.78:0/1747040327 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420576166 0 0) 0x7f8e9c0bc290 con 0x7f8e9c14b240 2023-06-02T15:30:57.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f8ea1ca4640 1 -- 172.21.15.78:0/1747040327 >> v1:172.21.15.132:6789/0 conn(0x7f8e9c14b240 legacy=0x7f8e9c0a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f8ea1ca4640 1 -- 172.21.15.78:0/1747040327 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c14db10 con 0x7f8e9c0bb000 2023-06-02T15:30:57.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 681070317 0 0) 0x7f868c003530 con 0x7f86a0153590 2023-06-02T15:30:57.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 >> v2:172.21.15.132:3300/0 conn(0x7f86a00a2720 msgr2=0x7f86a014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 --2- 172.21.15.78:0/3625869181 >> v2:172.21.15.132:3300/0 conn(0x7f86a00a2720 0x7f86a014fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 >> v1:172.21.15.132:6789/0 conn(0x7f86a00bd790 legacy=0x7f86a00bad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a006d130 con 0x7f86a0153590 2023-06-02T15:30:57.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3ac91640 1 --2- 172.21.15.78:0/1876889265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c34153550 0x7f6c341568f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c240097c0 tx=0x7f6c2401c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64927584847a7535 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fc775b50640 1 -- 172.21.15.78:0/1007180203 shutdown_connections 2023-06-02T15:30:57.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f2437fff640 1 -- 172.21.15.78:0/1432724527 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280a89d0 con 0x7f24300070c0 2023-06-02T15:30:57.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f2437fff640 1 -- 172.21.15.78:0/1432724527 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24280a8b30 con 0x7f24300070c0 2023-06-02T15:30:57.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f2437fff640 1 -- 172.21.15.78:0/1432724527 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24280b0440 con 0x7f24300070c0 2023-06-02T15:30:57.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fc775b50640 1 -- 172.21.15.78:0/1007180203 wait complete. 2023-06-02T15:30:57.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f243d54d640 1 -- 172.21.15.78:0/1432724527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24300070c0 msgr2=0x7f243000b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f243d54d640 1 --2- 172.21.15.78:0/1432724527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24300070c0 0x7f243000b810 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f24280097f0 tx=0x7f242801ecf0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f869c001680 con 0x7f86a0153590 2023-06-02T15:30:57.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 >> v1:172.21.15.78:6789/0 conn(0x7f86a0153590 legacy=0x7f86a015d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 --2- 172.21.15.78:0/3625869181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868c003a10 0x7f868c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 --2- 172.21.15.78:0/3625869181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c0047d0 0x7f868c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 --2- 172.21.15.78:0/3625869181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868c005180 0x7f868c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00bbff0 con 0x7f868c0047d0 2023-06-02T15:30:57.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c00c0f0 con 0x7f868c005180 2023-06-02T15:30:57.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c00c2b0 con 0x7f868c003a10 2023-06-02T15:30:57.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f243d54d640 1 -- 172.21.15.78:0/1432724527 shutdown_connections 2023-06-02T15:30:57.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f243d54d640 1 --2- 172.21.15.78:0/1432724527 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f24300070c0 0x7f243000b810 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f243d54d640 1 -- 172.21.15.78:0/1432724527 >> 172.21.15.78:0/1432724527 conn(0x7f2430043a40 msgr2=0x7f2430043e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a511e640 1 --2- 172.21.15.78:0/3625869181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c0047d0 0x7f868c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3948e640 1 -- 172.21.15.78:0/1876889265 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240ab600 con 0x7f6c34153550 2023-06-02T15:30:57.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3948e640 1 -- 172.21.15.78:0/1876889265 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c240a7050 con 0x7f6c34153550 2023-06-02T15:30:57.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f243d54d640 1 -- 172.21.15.78:0/1432724527 shutdown_connections 2023-06-02T15:30:57.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f243d54d640 1 -- 172.21.15.78:0/1432724527 wait complete. 2023-06-02T15:30:57.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/1876889265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c34153550 msgr2=0x7f6c341568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3c6f4640 1 --2- 172.21.15.78:0/1876889265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c34153550 0x7f6c341568f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6c240097c0 tx=0x7f6c2401c410 comp rx=0 tx=0).stop 2023-06-02T15:30:57.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3948e640 1 -- 172.21.15.78:0/1876889265 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240ab960 con 0x7f6c34153550 2023-06-02T15:30:57.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/1876889265 shutdown_connections 2023-06-02T15:30:57.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3c6f4640 1 --2- 172.21.15.78:0/1876889265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c34153550 0x7f6c341568f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3c6f4640 1 --2- 172.21.15.78:0/1876889265 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c340bd010 0x7f6c34153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/1876889265 >> 172.21.15.78:0/1876889265 conn(0x7f6c340698f0 msgr2=0x7f6c34069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/1876889265 shutdown_connections 2023-06-02T15:30:57.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fc775b50640 1 Processor -- start 2023-06-02T15:30:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/1876889265 wait complete. 2023-06-02T15:30:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a511e640 1 -- 172.21.15.78:0/3625869181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868c003a10 msgr2=0x7f868c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a511e640 1 --2- 172.21.15.78:0/3625869181 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868c003a10 0x7f868c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a511e640 1 -- 172.21.15.78:0/3625869181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868c005180 msgr2=0x7f868c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a6120640 1 --2- 172.21.15.78:0/3625869181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868c005180 0x7f868c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a511e640 1 --2- 172.21.15.78:0/3625869181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f868c005180 0x7f868c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fc775b50640 1 -- start start 2023-06-02T15:30:57.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a511e640 1 -- 172.21.15.78:0/3625869181 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00a1200 con 0x7f868c0047d0 2023-06-02T15:30:57.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f86a6120640 1 -- 172.21.15.78:0/3625869181 reap_dead start 2023-06-02T15:30:57.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7ffeaf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd7f80a6090 0x7fd7f80a6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7ffeaf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd7f8152240 0x7fd7f80a9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f243d54d640 1 Processor -- start 2023-06-02T15:30:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fc775b50640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc77006a400 0x7fc770138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fc775b50640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc770070ab0 0x7fc770156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fc775b50640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77014a6d0 0x7fc770157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fc775b50640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc770138e40 con 0x7fc77014a6d0 2023-06-02T15:30:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fc775b50640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc770159a00 con 0x7fc770070ab0 2023-06-02T15:30:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fc775b50640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc770159cc0 con 0x7fc77006a400 2023-06-02T15:30:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f6c3c6f4640 1 Processor -- start 2023-06-02T15:30:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f8ea1ca4640 1 --2- 172.21.15.78:0/1747040327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c0bb000 0x7f8e9c0bc890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0097c0 tx=0x7f8e8c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7090fbbcbabbf5b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f8ea14a3640 1 -- 172.21.15.78:0/1747040327 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0ab610 con 0x7f8e9c0bb000 2023-06-02T15:30:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f8ea14a3640 1 -- 172.21.15.78:0/1747040327 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c0ab770 con 0x7f8e9c0bb000 2023-06-02T15:30:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f8ea14a3640 1 -- 172.21.15.78:0/1747040327 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0abb00 con 0x7f8e9c0bb000 2023-06-02T15:30:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f62a5749640 1 Processor -- start 2023-06-02T15:30:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f62a5749640 1 -- start start 2023-06-02T15:30:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7f243d54d640 1 -- start start 2023-06-02T15:30:57.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7fe44c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd7f8152650 0x7fd7f80a9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55936/0 (socket says 172.21.15.78:55936) 2023-06-02T15:30:57.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7fe44c640 1 -- 172.21.15.78:0/3463238684 learned_addr learned my addr 172.21.15.78:0/3463238684 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7fdc4b640 1 --2- 172.21.15.78:0/3463238684 >> v2:172.21.15.132:3300/0 conn(0x7fd7f80a6090 0x7fd7f80a6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/3463238684 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f8151db0 con 0x7fd7f8152650 2023-06-02T15:30:57.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/3463238684 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f814f3d0 con 0x7fd7f8152240 2023-06-02T15:30:57.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/3463238684 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f80c2510 con 0x7fd7f80a6090 2023-06-02T15:30:57.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 260864318 0 0) 0x7fd7f8151db0 con 0x7fd7f8152650 2023-06-02T15:30:57.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.258+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e4003530 con 0x7fd7f8152650 2023-06-02T15:30:57.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 50604352 0 0) 0x7fd7e4003530 con 0x7fd7f8152650 2023-06-02T15:30:57.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 >> v2:172.21.15.132:3300/0 conn(0x7fd7f80a6090 msgr2=0x7fd7f80a6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 --2- 172.21.15.78:0/3463238684 >> v2:172.21.15.132:3300/0 conn(0x7fd7f80a6090 0x7fd7f80a6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 >> v2:172.21.15.78:3300/0 conn(0x7fd7f8152240 msgr2=0x7fd7f80a9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 --2- 172.21.15.78:0/3463238684 >> v2:172.21.15.78:3300/0 conn(0x7fd7f8152240 0x7fd7f80a9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80c2a00 con 0x7fd7f8152650 2023-06-02T15:30:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fd7f4001680 con 0x7fd7f8152650 2023-06-02T15:30:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 >> v1:172.21.15.78:6789/0 conn(0x7fd7f8152650 legacy=0x7fd7f80a9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc76effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc770070ab0 0x7fc770156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc76effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc770070ab0 0x7fc770156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:48970/0 (socket says 172.21.15.78:48970) 2023-06-02T15:30:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc76effd640 1 -- 172.21.15.78:0/4015357342 learned_addr learned my addr 172.21.15.78:0/4015357342 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f243d54d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24300070c0 0x7f2430029ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f243d54d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2430041940 0x7f24300d8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f243d54d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2430046b80 0x7f2430172310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f243d54d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24300d3bf0 con 0x7f24300070c0 2023-06-02T15:30:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f243d54d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243002bd10 con 0x7f2430046b80 2023-06-02T15:30:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f243d54d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243002bf00 con 0x7f2430041940 2023-06-02T15:30:57.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7e40039f0 0x7fd7e4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7e40047d0 0x7fd7e4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7e40051f0 0x7fd7e400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80c2510 con 0x7fd7e40039f0 2023-06-02T15:30:57.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e400c130 con 0x7fd7e40047d0 2023-06-02T15:30:57.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e400c2f0 con 0x7fd7e40051f0 2023-06-02T15:30:57.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 -- 172.21.15.78:0/1747040327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c0bb000 msgr2=0x7f8e9c0bc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 --2- 172.21.15.78:0/1747040327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c0bb000 0x7f8e9c0bc890 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0097c0 tx=0x7f8e8c01c470 comp rx=0 tx=0).stop 2023-06-02T15:30:57.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 -- 172.21.15.78:0/1747040327 shutdown_connections 2023-06-02T15:30:57.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 --2- 172.21.15.78:0/1747040327 >> v2:172.21.15.132:3300/0 conn(0x7f8e9c14dfa0 0x7f8e9c14e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 --2- 172.21.15.78:0/1747040327 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c0bb000 0x7f8e9c0bc890 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 -- 172.21.15.78:0/1747040327 >> 172.21.15.78:0/1747040327 conn(0x7f8e9c0a2170 msgr2=0x7f8e9c0a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fd44a640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7e40047d0 0x7fd7e4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f2435ffb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2430041940 0x7f24300d8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f2436ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2430046b80 0x7f2430172310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3c6f4640 1 -- start start 2023-06-02T15:30:57.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3c6f4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c340a2280 0x7f6c3415c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3c6f4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340bd010 0x7f6c3414a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3c6f4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c34153550 0x7f6c3414a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 -- 172.21.15.78:0/1747040327 shutdown_connections 2023-06-02T15:30:57.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f2436ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2430046b80 0x7f2430172310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:48982/0 (socket says 172.21.15.78:48982) 2023-06-02T15:30:57.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f2436ffd640 1 -- 172.21.15.78:0/2281776486 learned_addr learned my addr 172.21.15.78:0/2281776486 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fe44c640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7e40051f0 0x7fd7e400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3c6f4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341eebe0 con 0x7f6c340bd010 2023-06-02T15:30:57.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3c6f4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3406ea90 con 0x7f6c34153550 2023-06-02T15:30:57.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3c6f4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c341eee80 con 0x7f6c340a2280 2023-06-02T15:30:57.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc76f7fe640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc77006a400 0x7fc770138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f62a5749640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62a014fe90 0x7f62a00a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f62a5749640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 0x7f62a00bc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f62a5749640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a0150260 con 0x7f62a00bcc10 2023-06-02T15:30:57.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f62a5749640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a00c1040 con 0x7f62a014fe90 2023-06-02T15:30:57.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f62a5749640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a00c07a0 con 0x7f62a00bab00 2023-06-02T15:30:57.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f629effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62a014fe90 0x7f62a00a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f629effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f62a014fe90 0x7f62a00a2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57510/0 (socket says 172.21.15.78:57510) 2023-06-02T15:30:57.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f629effd640 1 -- 172.21.15.78:0/2898693230 learned_addr learned my addr 172.21.15.78:0/2898693230 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c39c8f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340bd010 0x7f6c3414a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3ac91640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c34153550 0x7f6c3414a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c39c8f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340bd010 0x7f6c3414a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57502/0 (socket says 172.21.15.78:57502) 2023-06-02T15:30:57.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c39c8f640 1 -- 172.21.15.78:0/95144441 learned_addr learned my addr 172.21.15.78:0/95144441 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc76effd640 1 -- 172.21.15.78:0/4015357342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc77006a400 msgr2=0x7fc770138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc76effd640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc77006a400 0x7fc770138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc76effd640 1 -- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77014a6d0 msgr2=0x7fc770157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc76effd640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc77014a6d0 0x7fc770157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fdc4b640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7e40039f0 0x7fd7e4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc76effd640 1 -- 172.21.15.78:0/4015357342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764009420 con 0x7fc770070ab0 2023-06-02T15:30:57.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f24367fc640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24300070c0 0x7f2430029ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3a490640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c340a2280 0x7f6c3415c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f629e7fc640 1 --2- 172.21.15.78:0/2898693230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 0x7f62a00bc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f629effd640 1 -- 172.21.15.78:0/2898693230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 msgr2=0x7f62a00bc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f629effd640 1 --2- 172.21.15.78:0/2898693230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 0x7f62a00bc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f629effd640 1 -- 172.21.15.78:0/2898693230 >> v1:172.21.15.78:6789/0 conn(0x7f62a00bcc10 legacy=0x7f62a0152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f629effd640 1 -- 172.21.15.78:0/2898693230 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a00c0a80 con 0x7f62a014fe90 2023-06-02T15:30:57.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f2435ffb640 1 -- 172.21.15.78:0/2281776486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2430046b80 msgr2=0x7f2430172310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f2435ffb640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2430046b80 0x7f2430172310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f2435ffb640 1 -- 172.21.15.78:0/2281776486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24300070c0 msgr2=0x7f2430029ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f2435ffb640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f24300070c0 0x7f2430029ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f2435ffb640 1 -- 172.21.15.78:0/2281776486 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2428009420 con 0x7f2430041940 2023-06-02T15:30:57.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c39c8f640 1 -- 172.21.15.78:0/95144441 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c340a2280 msgr2=0x7f6c3415c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c39c8f640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c340a2280 0x7f6c3415c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c39c8f640 1 -- 172.21.15.78:0/95144441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c34153550 msgr2=0x7f6c3414a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c39c8f640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c34153550 0x7f6c3414a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c39c8f640 1 -- 172.21.15.78:0/95144441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c24009420 con 0x7f6c340bd010 2023-06-02T15:30:57.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3ac91640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c34153550 0x7f6c3414a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:57.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc76effd640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc770070ab0 0x7fc770156e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc76800c8c0 tx=0x7fc76800cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f2435ffb640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2430041940 0x7f24300d8d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2430046f90 tx=0x7f242c00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c39c8f640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340bd010 0x7f6c3414a200 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000c500 tx=0x7f6c3000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc757fff640 1 -- 172.21.15.78:0/4015357342 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76800a640 con 0x7fc770070ab0 2023-06-02T15:30:57.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc757fff640 1 -- 172.21.15.78:0/4015357342 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76800a7a0 con 0x7fc770070ab0 2023-06-02T15:30:57.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc760009420 con 0x7fc770070ab0 2023-06-02T15:30:57.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7700bb5d0 con 0x7fc770070ab0 2023-06-02T15:30:57.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fc757fff640 1 -- 172.21.15.78:0/4015357342 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76800ab90 con 0x7fc770070ab0 2023-06-02T15:30:57.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc750000fd0 con 0x7fc770070ab0 2023-06-02T15:30:57.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c2affd640 1 -- 172.21.15.78:0/95144441 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30005cf0 con 0x7f6c340bd010 2023-06-02T15:30:57.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c2affd640 1 -- 172.21.15.78:0/95144441 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c30005e50 con 0x7f6c340bd010 2023-06-02T15:30:57.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c2affd640 1 -- 172.21.15.78:0/95144441 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c30007310 con 0x7f6c340bd010 2023-06-02T15:30:57.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c340a2e80 con 0x7f6c340bd010 2023-06-02T15:30:57.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c340bc7c0 con 0x7f6c340bd010 2023-06-02T15:30:57.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 -- 172.21.15.78:0/1747040327 wait complete. 2023-06-02T15:30:57.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 Processor -- start 2023-06-02T15:30:57.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 -- start start 2023-06-02T15:30:57.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c0bb000 0x7f8e9c1eba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c14b240 0x7f8e9c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e9c14dfa0 0x7f8e9c070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0be880 con 0x7f8e9c14dfa0 2023-06-02T15:30:57.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0bf1f0 con 0x7f8e9c0bb000 2023-06-02T15:30:57.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f8ea4709640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c1ebf80 con 0x7f8e9c14b240 2023-06-02T15:30:57.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea1ca4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c14b240 0x7f8e9c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea1ca4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c14b240 0x7f8e9c15a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49678/0 (socket says 172.21.15.78:49678) 2023-06-02T15:30:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea1ca4640 1 -- 172.21.15.78:0/2868545038 learned_addr learned my addr 172.21.15.78:0/2868545038 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f241f7fe640 1 -- 172.21.15.78:0/2281776486 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c005220 con 0x7f2430041940 2023-06-02T15:30:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24300dd430 con 0x7f2430041940 2023-06-02T15:30:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24300262d0 con 0x7f2430041940 2023-06-02T15:30:57.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f241f7fe640 1 -- 172.21.15.78:0/2281776486 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242c005380 con 0x7f2430041940 2023-06-02T15:30:57.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7f241f7fe640 1 -- 172.21.15.78:0/2281776486 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242c007250 con 0x7f2430041940 2023-06-02T15:30:57.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2418000fd0 con 0x7f2430041940 2023-06-02T15:30:57.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea24a5640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c0bb000 0x7f8e9c1eba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fdc4b640 1 -- 172.21.15.78:0/3463238684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7e40051f0 msgr2=0x7fd7e400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fdc4b640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7e40051f0 0x7fd7e400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fdc4b640 1 -- 172.21.15.78:0/3463238684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7e40047d0 msgr2=0x7fd7e4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fdc4b640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7e40047d0 0x7fd7e4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.262+0000 7fd7fdc4b640 1 -- 172.21.15.78:0/3463238684 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f80c2a00 con 0x7fd7e40039f0 2023-06-02T15:30:57.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea1ca4640 1 -- 172.21.15.78:0/2868545038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c0bb000 msgr2=0x7f8e9c1eba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea1ca4640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c0bb000 0x7f8e9c1eba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea1ca4640 1 -- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e9c14dfa0 msgr2=0x7f8e9c070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea1ca4640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8e9c14dfa0 0x7f8e9c070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea1ca4640 1 -- 172.21.15.78:0/2868545038 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c009420 con 0x7f8e9c14b240 2023-06-02T15:30:57.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7fe44c640 1 -- 172.21.15.78:0/3463238684 reap_dead start 2023-06-02T15:30:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f629effd640 1 --2- 172.21.15.78:0/2898693230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62a014fe90 0x7f62a00a2d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f62a00c1280 tx=0x7f629401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be6e541e00f27b32 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea1ca4640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c14b240 0x7f8e9c15a810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0ad040 tx=0x7f8e8c01acb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8e92ffd640 1 -- 172.21.15.78:0/2868545038 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0b5810 con 0x7f8e9c14b240 2023-06-02T15:30:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7fdc4b640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7e40039f0 0x7fd7e4003e00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800ba10 tx=0x7fd7e801c5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df45807c9ada90a5 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f6c2affd640 1 -- 172.21.15.78:0/95144441 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f6c30007470 con 0x7f6c340bd010 2023-06-02T15:30:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f6c2affd640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c18065c00 0x7f6c180680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f6c2affd640 1 -- 172.21.15.78:0/95144441 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6c30082b00 con 0x7f6c340bd010 2023-06-02T15:30:57.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f6c3a490640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c18065c00 0x7f6c180680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fc757fff640 1 -- 172.21.15.78:0/4015357342 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fc76800acf0 con 0x7fc770070ab0 2023-06-02T15:30:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fc757fff640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc75c065c00 0x7fc75c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fc757fff640 1 -- 172.21.15.78:0/4015357342 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc7680831e0 con 0x7fc770070ab0 2023-06-02T15:30:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fc757fff640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] conn(0x7fc75c06f7d0 0x7fc75c071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fc757fff640 1 -- 172.21.15.78:0/4015357342 --> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc75c0722d0 con 0x7fc75c06f7d0 2023-06-02T15:30:57.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fc757fff640 1 -- 172.21.15.78:0/4015357342 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc768083550 con 0x7fc770070ab0 2023-06-02T15:30:57.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8e92ffd640 1 -- 172.21.15.78:0/2868545038 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c0b5970 con 0x7f8e9c14b240 2023-06-02T15:30:57.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8e92ffd640 1 -- 172.21.15.78:0/2868545038 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c0b5d20 con 0x7f8e9c14b240 2023-06-02T15:30:57.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f6c3a490640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c18065c00 0x7f6c180680b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0113e0 tx=0x7f6c2c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fc76f7fe640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc75c065c00 0x7fc75c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fc76ffff640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] conn(0x7fc75c06f7d0 0x7fc75c071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c14a5a0 con 0x7f8e9c14b240 2023-06-02T15:30:57.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c0a3c80 con 0x7f8e9c14b240 2023-06-02T15:30:57.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8e9c14e940 con 0x7f8e9c14b240 2023-06-02T15:30:57.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80ac660 con 0x7fd7e40039f0 2023-06-02T15:30:57.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e80ac7c0 con 0x7fd7e40039f0 2023-06-02T15:30:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7fcc49640 1 -- 172.21.15.78:0/3463238684 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80acbb0 con 0x7fd7e40039f0 2023-06-02T15:30:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/3463238684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7e40039f0 msgr2=0x7fd7e4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7ffeaf640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7e40039f0 0x7fd7e4003e00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800ba10 tx=0x7fd7e801c5d0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/3463238684 shutdown_connections 2023-06-02T15:30:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7ffeaf640 1 --2- 172.21.15.78:0/3463238684 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7e40039f0 0x7fd7e4003e00 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd7e800ba10 tx=0x7fd7e801c5d0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/3463238684 >> 172.21.15.78:0/3463238684 conn(0x7fd7f80c4610 msgr2=0x7fd7f80c4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f86a511e640 1 --2- 172.21.15.78:0/3625869181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c0047d0 0x7f868c004c40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8690009ae0 tx=0x7f869001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430bb4815ec17ba8 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/3463238684 shutdown_connections 2023-06-02T15:30:57.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f629dffb640 1 -- 172.21.15.78:0/2898693230 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62940a8970 con 0x7f62a014fe90 2023-06-02T15:30:57.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f629dffb640 1 -- 172.21.15.78:0/2898693230 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62940a8ad0 con 0x7f62a014fe90 2023-06-02T15:30:57.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fc76ffff640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] conn(0x7fc75c06f7d0 0x7fc75c071c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fc76f7fe640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc75c065c00 0x7fc75c0680b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc7600b2000 tx=0x7fc7600aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fc757fff640 1 -- 172.21.15.78:0/4015357342 <== osd.0 v2:172.21.15.78:6800/37134 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc75c0722d0 con 0x7fc75c06f7d0 2023-06-02T15:30:57.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86900a5640 con 0x7f868c0047d0 2023-06-02T15:30:57.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86900a57a0 con 0x7f868c0047d0 2023-06-02T15:30:57.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dbd6f640 1 Processor -- start 2023-06-02T15:30:57.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dbd6f640 1 -- start start 2023-06-02T15:30:57.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dbd6f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6cc0427e0 0x7fb6cc0070c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dbd6f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb6cc007600 0x7fb6cc009c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dbd6f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6cc042350 con 0x7fb6cc0d2a30 2023-06-02T15:30:57.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dbd6f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6cc042c30 con 0x7fb6cc007600 2023-06-02T15:30:57.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dbd6f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc00af10 con 0x7fb6cc0427e0 2023-06-02T15:30:57.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dab0d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb6cc007600 0x7fb6cc009c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dab0d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb6cc007600 0x7fb6cc009c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57526/0 (socket says 172.21.15.78:57526) 2023-06-02T15:30:57.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dab0d640 1 -- 172.21.15.78:0/2984293357 learned_addr learned my addr 172.21.15.78:0/2984293357 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f62a5749640 1 -- 172.21.15.78:0/2898693230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62a014fe90 msgr2=0x7f62a00a2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f62a5749640 1 --2- 172.21.15.78:0/2898693230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62a014fe90 0x7f62a00a2d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f62a00c1280 tx=0x7f629401ecd0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7f241f7fe640 1 -- 172.21.15.78:0/2281776486 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f242c0073b0 con 0x7f2430041940 2023-06-02T15:30:57.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f241f7fe640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2424065c00 0x7f24240680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f241f7fe640 1 -- 172.21.15.78:0/2281776486 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f242c082e70 con 0x7f2430041940 2023-06-02T15:30:57.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f241f7fe640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] conn(0x7f242406f850 0x7f2424071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f241f7fe640 1 -- 172.21.15.78:0/2281776486 --> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2424072350 con 0x7f242406f850 2023-06-02T15:30:57.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f241f7fe640 1 -- 172.21.15.78:0/2281776486 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f242c0832c0 con 0x7f2430041940 2023-06-02T15:30:57.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f24367fc640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2424065c00 0x7f24240680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f2436ffd640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] conn(0x7f242406f850 0x7f2424071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.266+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/3463238684 wait complete. 2023-06-02T15:30:57.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7ffeaf640 1 Processor -- start 2023-06-02T15:30:57.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f24367fc640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2424065c00 0x7f24240680b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f24280b2000 tx=0x7f2428008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f86a6921640 1 -- 172.21.15.78:0/3625869181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c0047d0 msgr2=0x7f868c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f86a491d640 1 -- 172.21.15.78:0/3625869181 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86900a5640 con 0x7f868c0047d0 2023-06-02T15:30:57.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f86a6921640 1 --2- 172.21.15.78:0/3625869181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c0047d0 0x7f868c004c40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f8690009ae0 tx=0x7f869001ca50 comp rx=0 tx=0).stop 2023-06-02T15:30:57.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8e92ffd640 1 -- 172.21.15.78:0/2868545038 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f8e8c0bf410 con 0x7f8e9c14b240 2023-06-02T15:30:57.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8e92ffd640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e80065c30 0x7f8e800680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8e92ffd640 1 -- 172.21.15.78:0/2868545038 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8e8c11eaa0 con 0x7f8e9c14b240 2023-06-02T15:30:57.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8e92ffd640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] conn(0x7f8e8006f900 0x7f8e80071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8e92ffd640 1 -- 172.21.15.78:0/2868545038 --> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e80072400 con 0x7f8e8006f900 2023-06-02T15:30:57.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8e92ffd640 1 -- 172.21.15.78:0/2868545038 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e8c11ee50 con 0x7f8e9c14b240 2023-06-02T15:30:57.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f86a6921640 1 -- 172.21.15.78:0/3625869181 shutdown_connections 2023-06-02T15:30:57.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f86a6921640 1 --2- 172.21.15.78:0/3625869181 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f868c0047d0 0x7f868c004c40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f86a6921640 1 -- 172.21.15.78:0/3625869181 >> 172.21.15.78:0/3625869181 conn(0x7f86a00c1030 msgr2=0x7f86a00bce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f86a6921640 1 -- 172.21.15.78:0/3625869181 shutdown_connections 2023-06-02T15:30:57.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8ea24a5640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e80065c30 0x7f8e800680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8ea2ca6640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] conn(0x7f8e8006f900 0x7f8e80071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f62a5749640 1 -- 172.21.15.78:0/2898693230 shutdown_connections 2023-06-02T15:30:57.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f62a5749640 1 --2- 172.21.15.78:0/2898693230 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 0x7f62a00bc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f62a5749640 1 --2- 172.21.15.78:0/2898693230 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62a014fe90 0x7f62a00a2d90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f62a5749640 1 -- 172.21.15.78:0/2898693230 >> 172.21.15.78:0/2898693230 conn(0x7f62a00a3710 msgr2=0x7f62a00a3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f86a6921640 1 -- 172.21.15.78:0/3625869181 wait complete. 2023-06-02T15:30:57.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f62a5749640 1 -- 172.21.15.78:0/2898693230 shutdown_connections 2023-06-02T15:30:57.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8ea24a5640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e80065c30 0x7f8e800680e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8e98000f70 tx=0x7f8e98007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8ea2ca6640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] conn(0x7f8e8006f900 0x7f8e80071d30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7ffeaf640 1 -- start start 2023-06-02T15:30:57.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7ffeaf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f80bdc50 0x7fd7f80a8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7ffeaf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f81eb270 0x7fd7f81e7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7ffeaf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7f80bb650 0x7fd7f80a7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7ffeaf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80a93e0 con 0x7fd7f80bdc50 2023-06-02T15:30:57.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7ffeaf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80a7b10 con 0x7fd7f81eb270 2023-06-02T15:30:57.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7ffeaf640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f80a74e0 con 0x7fd7f80bb650 2023-06-02T15:30:57.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7fd44a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f81eb270 0x7fd7f81e7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7fd44a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f81eb270 0x7fd7f81e7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49016/0 (socket says 172.21.15.78:49016) 2023-06-02T15:30:57.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7fd44a640 1 -- 172.21.15.78:0/91413126 learned_addr learned my addr 172.21.15.78:0/91413126 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fd7fe44c640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7f80bb650 0x7fd7f80a7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f8e92ffd640 1 -- 172.21.15.78:0/2868545038 <== osd.3 v2:172.21.15.78:6808/37137 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8e80072400 con 0x7f8e8006f900 2023-06-02T15:30:57.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6921640 1 Processor -- start 2023-06-02T15:30:57.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7fdc4b640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f80bdc50 0x7fd7f80a8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7f62a5749640 1 -- 172.21.15.78:0/2898693230 wait complete. 2023-06-02T15:30:57.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62a5749640 1 Processor -- start 2023-06-02T15:30:57.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6921640 1 -- start start 2023-06-02T15:30:57.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7fe44c640 1 -- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f81eb270 msgr2=0x7fd7f81e7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7fe44c640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f81eb270 0x7fd7f81e7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7fe44c640 1 -- 172.21.15.78:0/91413126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f80bdc50 msgr2=0x7fd7f80a8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7fe44c640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7f80bdc50 0x7fd7f80a8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7fe44c640 1 -- 172.21.15.78:0/91413126 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f806c190 con 0x7fd7f80bb650 2023-06-02T15:30:57.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dab0d640 1 -- 172.21.15.78:0/2984293357 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6cc0427e0 msgr2=0x7fb6cc0070c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-02T15:30:57.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dab0d640 1 --2- 172.21.15.78:0/2984293357 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6cc0427e0 0x7fb6cc0070c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dab0d640 1 -- 172.21.15.78:0/2984293357 >> v1:172.21.15.132:6789/0 conn(0x7fb6cc0d2a30 legacy=0x7fb6cc03c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.270+0000 7fb6dab0d640 1 -- 172.21.15.78:0/2984293357 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6cc03cbd0 con 0x7fb6cc007600 2023-06-02T15:30:57.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7fe44c640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7f80bb650 0x7fd7f80a7fa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80c0500 tx=0x7fd7f4007060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fb6dab0d640 1 --2- 172.21.15.78:0/2984293357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc007600 0x7fb6cc009c30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009870 tx=0x7fb6c401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81b208a1981d685 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6921640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868c0047d0 0x7f86a0153f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6921640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86a00a5380 0x7f86a0155ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6921640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86a0156020 0x7f86a01eb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6921640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00a5e30 con 0x7f86a00a5380 2023-06-02T15:30:57.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6921640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a0154470 con 0x7f86a0156020 2023-06-02T15:30:57.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6921640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a00a5b50 con 0x7f868c0047d0 2023-06-02T15:30:57.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7ee7fc640 1 -- 172.21.15.78:0/91413126 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4007680 con 0x7fd7f80bb650 2023-06-02T15:30:57.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62a5749640 1 -- start start 2023-06-02T15:30:57.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62a5749640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 0x7f62a006eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62a5749640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62a00bcc10 0x7f62a006fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a591f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868c0047d0 0x7f86a0153f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a591f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868c0047d0 0x7f86a0153f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49702/0 (socket says 172.21.15.78:49702) 2023-06-02T15:30:57.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a591f640 1 -- 172.21.15.78:0/3177696600 learned_addr learned my addr 172.21.15.78:0/3177696600 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62a5749640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a0154680 0x7f62a01f0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6120640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86a0156020 0x7f86a01eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629effd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 0x7f62a006eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62a5749640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a0154b10 con 0x7f62a00bcc10 2023-06-02T15:30:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629effd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 0x7f62a006eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49714/0 (socket says 172.21.15.78:49714) 2023-06-02T15:30:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629effd640 1 -- 172.21.15.78:0/119946026 learned_addr learned my addr 172.21.15.78:0/119946026 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a0153b70 con 0x7f62a0154680 2023-06-02T15:30:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a01f0a50 con 0x7f62a00bab00 2023-06-02T15:30:57.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629f7fe640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a0154680 0x7f62a01f0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a591f640 1 -- 172.21.15.78:0/3177696600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86a0156020 msgr2=0x7f86a01eb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a591f640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86a0156020 0x7f86a01eb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a591f640 1 -- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86a00a5380 msgr2=0x7f86a0155ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a591f640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86a00a5380 0x7f86a0155ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a591f640 1 -- 172.21.15.78:0/3177696600 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a00bb710 con 0x7f868c0047d0 2023-06-02T15:30:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629e7fc640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62a00bcc10 0x7f62a006fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f6c3c6f4640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] conn(0x7f6c3406cb90 0x7f6c341eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 --> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c340bb7c0 con 0x7f6c3406cb90 2023-06-02T15:30:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f80bef90 con 0x7fd7f80bb650 2023-06-02T15:30:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f806c320 con 0x7fd7f80bb650 2023-06-02T15:30:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7f8073bc0 con 0x7fd7f80bb650 2023-06-02T15:30:57.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a591f640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868c0047d0 0x7f86a0153f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f869800c780 tx=0x7f869800c870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fb6d8b09640 1 -- 172.21.15.78:0/2984293357 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40ab600 con 0x7fb6cc007600 2023-06-02T15:30:57.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fb6d8b09640 1 -- 172.21.15.78:0/2984293357 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c40a7050 con 0x7fb6cc007600 2023-06-02T15:30:57.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fb6d8b09640 1 -- 172.21.15.78:0/2984293357 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c40ab980 con 0x7fb6cc007600 2023-06-02T15:30:57.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f6c3ac91640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] conn(0x7f6c3406cb90 0x7f6c341eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629effd640 1 -- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a0154680 msgr2=0x7f62a01f0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629effd640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a0154680 0x7f62a01f0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629effd640 1 -- 172.21.15.78:0/119946026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62a00bcc10 msgr2=0x7f62a006fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629effd640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f62a00bcc10 0x7f62a006fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629effd640 1 -- 172.21.15.78:0/119946026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62940094d0 con 0x7f62a00bab00 2023-06-02T15:30:57.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7ee7fc640 1 -- 172.21.15.78:0/91413126 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f4014450 con 0x7fd7f80bb650 2023-06-02T15:30:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fd7ee7fc640 1 -- 172.21.15.78:0/91413126 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4014800 con 0x7fd7f80bb650 2023-06-02T15:30:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f2436ffd640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] conn(0x7f242406f850 0x7f2424071c80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86967fc640 1 -- 172.21.15.78:0/3177696600 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698003b80 con 0x7f868c0047d0 2023-06-02T15:30:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f6c3ac91640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] conn(0x7f6c3406cb90 0x7f6c341eacd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86967fc640 1 -- 172.21.15.78:0/3177696600 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8698003d00 con 0x7f868c0047d0 2023-06-02T15:30:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a00bbd10 con 0x7f868c0047d0 2023-06-02T15:30:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86967fc640 1 -- 172.21.15.78:0/3177696600 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8698005310 con 0x7f868c0047d0 2023-06-02T15:30:57.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a00ba760 con 0x7f868c0047d0 2023-06-02T15:30:57.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f629effd640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 0x7f62a006eed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f629401c900 tx=0x7f629401ba70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/2984293357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc007600 msgr2=0x7fb6cc009c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7fb6dbd6f640 1 --2- 172.21.15.78:0/2984293357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc007600 0x7fb6cc009c30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4009870 tx=0x7fb6c401c4d0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62877fe640 1 -- 172.21.15.78:0/119946026 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62940b0ac0 con 0x7f62a00bab00 2023-06-02T15:30:57.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a006d560 con 0x7f62a00bab00 2023-06-02T15:30:57.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a00c0d60 con 0x7f62a00bab00 2023-06-02T15:30:57.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8688000fd0 con 0x7f868c0047d0 2023-06-02T15:30:57.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62877fe640 1 -- 172.21.15.78:0/119946026 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62940b0c20 con 0x7f62a00bab00 2023-06-02T15:30:57.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.274+0000 7f62877fe640 1 -- 172.21.15.78:0/119946026 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62940ba440 con 0x7f62a00bab00 2023-06-02T15:30:57.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f6c2affd640 1 -- 172.21.15.78:0/95144441 <== osd.2 v2:172.21.15.78:6816/37136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6c340bb7c0 con 0x7f6c3406cb90 2023-06-02T15:30:57.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/2984293357 shutdown_connections 2023-06-02T15:30:57.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 --2- 172.21.15.78:0/2984293357 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc007600 0x7fb6cc009c30 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 --2- 172.21.15.78:0/2984293357 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6cc0427e0 0x7fb6cc0070c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/2984293357 >> 172.21.15.78:0/2984293357 conn(0x7fb6cc043a40 msgr2=0x7fb6cc043e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/2984293357 shutdown_connections 2023-06-02T15:30:57.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f62a0153220 con 0x7f62a00bab00 2023-06-02T15:30:57.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f241f7fe640 1 -- 172.21.15.78:0/2281776486 <== osd.6 v2:172.21.15.132:6824/37341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2424072350 con 0x7f242406f850 2023-06-02T15:30:57.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fd7ee7fc640 1 -- 172.21.15.78:0/91413126 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fd7f401c360 con 0x7fd7f80bb650 2023-06-02T15:30:57.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/2984293357 wait complete. 2023-06-02T15:30:57.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 Processor -- start 2023-06-02T15:30:57.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fd7ee7fc640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd7dc065c00 0x7fd7dc0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fd7ee7fc640 1 -- 172.21.15.78:0/91413126 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd7f4082a50 con 0x7fd7f80bb650 2023-06-02T15:30:57.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fd7ee7fc640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] conn(0x7fd7dc06f850 0x7fd7dc071c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fd7ee7fc640 1 -- 172.21.15.78:0/91413126 --> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7dc072350 con 0x7fd7dc06f850 2023-06-02T15:30:57.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fd7ee7fc640 1 -- 172.21.15.78:0/91413126 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7f4082dc0 con 0x7fd7f80bb650 2023-06-02T15:30:57.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f86967fc640 1 -- 172.21.15.78:0/3177696600 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f8698005470 con 0x7f868c0047d0 2023-06-02T15:30:57.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f86967fc640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8684065cc0 0x7f8684068170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f86967fc640 1 -- 172.21.15.78:0/3177696600 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8698083160 con 0x7f868c0047d0 2023-06-02T15:30:57.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f86967fc640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] conn(0x7f868406f990 0x7f8684071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f86967fc640 1 -- 172.21.15.78:0/3177696600 --> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8684072490 con 0x7f868406f990 2023-06-02T15:30:57.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f86967fc640 1 -- 172.21.15.78:0/3177696600 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8698083510 con 0x7f868c0047d0 2023-06-02T15:30:57.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fd7fd44a640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] conn(0x7fd7dc06f850 0x7fd7dc071c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fd7fdc4b640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd7dc065c00 0x7fd7dc0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f86a6120640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] conn(0x7f868406f990 0x7f8684071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f86a511e640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8684065cc0 0x7f8684068170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f86a6120640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] conn(0x7f868406f990 0x7f8684071dc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f62877fe640 1 -- 172.21.15.78:0/119946026 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f62940ba5a0 con 0x7f62a00bab00 2023-06-02T15:30:57.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f62877fe640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f628c065c30 0x7f628c0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f62877fe640 1 -- 172.21.15.78:0/119946026 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6294121970 con 0x7f62a00bab00 2023-06-02T15:30:57.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f629e7fc640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f628c065c30 0x7f628c0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f62877fe640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] conn(0x7f628c06f880 0x7f628c071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f62877fe640 1 -- 172.21.15.78:0/119946026 --> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f628c072380 con 0x7f628c06f880 2023-06-02T15:30:57.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7f62877fe640 1 -- 172.21.15.78:0/119946026 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6294121ce0 con 0x7f62a00bab00 2023-06-02T15:30:57.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fd7fd44a640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] conn(0x7fd7dc06f850 0x7fd7dc071c80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 -- start start 2023-06-02T15:30:57.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc007600 0x7fb6cc03ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6cc0427e0 0x7fb6cc03fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6cc0d2a30 0x7fb6cc168940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc0cd380 con 0x7fb6cc007600 2023-06-02T15:30:57.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc0cd5f0 con 0x7fb6cc0d2a30 2023-06-02T15:30:57.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.278+0000 7fb6dbd6f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6cc040ca0 con 0x7fb6cc0427e0 2023-06-02T15:30:57.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6d930a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6cc0427e0 0x7fb6cc03fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6d9b0b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc007600 0x7fb6cc03ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6d9b0b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc007600 0x7fb6cc03ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57564/0 (socket says 172.21.15.78:57564) 2023-06-02T15:30:57.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6d9b0b640 1 -- 172.21.15.78:0/1112527602 learned_addr learned my addr 172.21.15.78:0/1112527602 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7f629f7fe640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] conn(0x7f628c06f880 0x7f628c071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7f629e7fc640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f628c065c30 0x7f628c0680e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f62a014d850 tx=0x7f6290008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7f86a511e640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8684065cc0 0x7f8684068170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f86900af000 tx=0x7f8690008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fd7fdc4b640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd7dc065c00 0x7fd7dc0680b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80b0000 tx=0x7fd7e80b7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7f86967fc640 1 -- 172.21.15.78:0/3177696600 <== osd.1 v2:172.21.15.78:6824/37135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8684072490 con 0x7f868406f990 2023-06-02T15:30:57.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6d9b0b640 1 -- 172.21.15.78:0/1112527602 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6cc0427e0 msgr2=0x7fb6cc03fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6d9b0b640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb6cc0427e0 0x7fb6cc03fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6d9b0b640 1 -- 172.21.15.78:0/1112527602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6cc0d2a30 msgr2=0x7fb6cc168940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-02T15:30:57.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6d9b0b640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6cc0d2a30 0x7fb6cc168940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6d9b0b640 1 -- 172.21.15.78:0/1112527602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c40094d0 con 0x7fb6cc007600 2023-06-02T15:30:57.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6d9b0b640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc007600 0x7fb6cc03ef60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4068000 tx=0x7fb6d4066ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7f629f7fe640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] conn(0x7f628c06f880 0x7f628c071cb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6ca7fc640 1 -- 172.21.15.78:0/1112527602 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4066030 con 0x7fb6cc007600 2023-06-02T15:30:57.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6cc0456d0 con 0x7fb6cc007600 2023-06-02T15:30:57.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6cc0436f0 con 0x7fb6cc007600 2023-06-02T15:30:57.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb6cc0cd760 con 0x7fb6cc007600 2023-06-02T15:30:57.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7f62877fe640 1 -- 172.21.15.78:0/119946026 <== osd.5 v2:172.21.15.132:6808/37340 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f628c072380 con 0x7f628c06f880 2023-06-02T15:30:57.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6ca7fc640 1 -- 172.21.15.78:0/1112527602 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6d40661d0 con 0x7fb6cc007600 2023-06-02T15:30:57.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fb6ca7fc640 1 -- 172.21.15.78:0/1112527602 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6d4072de0 con 0x7fb6cc007600 2023-06-02T15:30:57.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.282+0000 7fd7ee7fc640 1 -- 172.21.15.78:0/91413126 <== osd.7 v2:172.21.15.132:6800/37343 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd7dc072350 con 0x7fd7dc06f850 2023-06-02T15:30:57.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.286+0000 7fb6ca7fc640 1 -- 172.21.15.78:0/1112527602 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fb6d4073000 con 0x7fb6cc007600 2023-06-02T15:30:57.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.286+0000 7fb6ca7fc640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fb6b8065d00 0x7fb6b80681b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.286+0000 7fb6ca7fc640 1 -- 172.21.15.78:0/1112527602 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb6d40fcbd0 con 0x7fb6cc007600 2023-06-02T15:30:57.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.286+0000 7fb6ca7fc640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] conn(0x7fb6b806f9d0 0x7fb6b8071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.286+0000 7fb6ca7fc640 1 -- 172.21.15.78:0/1112527602 --> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb6b80724d0 con 0x7fb6b806f9d0 2023-06-02T15:30:57.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.286+0000 7fb6ca7fc640 1 -- 172.21.15.78:0/1112527602 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6d40fcf80 con 0x7fb6cc007600 2023-06-02T15:30:57.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.286+0000 7fb6dab0d640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] conn(0x7fb6b806f9d0 0x7fb6b8071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.286+0000 7fb6dab0d640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] conn(0x7fb6b806f9d0 0x7fb6b8071e00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.290+0000 7fb6ca7fc640 1 -- 172.21.15.78:0/1112527602 <== osd.4 v2:172.21.15.132:6816/37342 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb6b80724d0 con 0x7fb6b806f9d0 2023-06-02T15:30:57.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.290+0000 7fb6d930a640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fb6b8065d00 0x7fb6b80681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.290+0000 7fb6d930a640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fb6b8065d00 0x7fb6b80681b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0e2be0 tx=0x7fb6d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.290+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 --> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8e9c073bc0 con 0x7f8e8006f900 2023-06-02T15:30:57.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.290+0000 7f8e92ffd640 1 -- 172.21.15.78:0/2868545038 <== osd.3 v2:172.21.15.78:6808/37137 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8e9c073bc0 con 0x7f8e8006f900 2023-06-02T15:30:57.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.290+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] conn(0x7f8e8006f900 msgr2=0x7f8e80071d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.290+0000 7f8ea4709640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] conn(0x7f8e8006f900 0x7f8e80071d30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e80065c30 msgr2=0x7f8e800680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f8ea4709640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e80065c30 0x7f8e800680e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8e98000f70 tx=0x7f8e98007240 comp rx=0 tx=0).stop 2023-06-02T15:30:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c14b240 msgr2=0x7f8e9c15a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f8ea4709640 1 --2- 172.21.15.78:0/2868545038 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8e9c14b240 0x7f8e9c15a810 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c0ad040 tx=0x7f8e8c01acb0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f8ea2ca6640 1 -- 172.21.15.78:0/2868545038 reap_dead start 2023-06-02T15:30:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 shutdown_connections 2023-06-02T15:30:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 >> 172.21.15.78:0/2868545038 conn(0x7f8e9c0a2170 msgr2=0x7f8e9c149dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 shutdown_connections 2023-06-02T15:30:57.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f8ea4709640 1 -- 172.21.15.78:0/2868545038 wait complete. 2023-06-02T15:30:57.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 --> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c341503d0 con 0x7f6c3406cb90 2023-06-02T15:30:57.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 --> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc750002cc0 con 0x7fc75c06f7d0 2023-06-02T15:30:57.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7f6c2affd640 1 -- 172.21.15.78:0/95144441 <== osd.2 v2:172.21.15.78:6816/37136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6c341503d0 con 0x7f6c3406cb90 2023-06-02T15:30:57.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.294+0000 7fc757fff640 1 -- 172.21.15.78:0/4015357342 <== osd.0 v2:172.21.15.78:6800/37134 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc750002cc0 con 0x7fc75c06f7d0 2023-06-02T15:30:57.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.298+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] conn(0x7f6c3406cb90 msgr2=0x7f6c341eacd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.298+0000 7f6c3c6f4640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] conn(0x7f6c3406cb90 0x7f6c341eacd0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c18065c00 msgr2=0x7f6c180680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7f6c3c6f4640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6c18065c00 0x7f6c180680b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0113e0 tx=0x7f6c2c00b040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340bd010 msgr2=0x7f6c3414a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7f6c3c6f4640 1 --2- 172.21.15.78:0/95144441 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c340bd010 0x7f6c3414a200 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000c500 tx=0x7f6c3000c9c0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] conn(0x7fc75c06f7d0 msgr2=0x7fc75c071c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc775b50640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] conn(0x7fc75c06f7d0 0x7fc75c071c00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7f6c3ac91640 1 -- 172.21.15.78:0/95144441 reap_dead start 2023-06-02T15:30:57.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc75c065c00 msgr2=0x7fc75c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc775b50640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc75c065c00 0x7fc75c0680b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc7600b2000 tx=0x7fc7600aa070 comp rx=0 tx=0).stop 2023-06-02T15:30:57.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc770070ab0 msgr2=0x7fc770156e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc775b50640 1 --2- 172.21.15.78:0/4015357342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc770070ab0 0x7fc770156e40 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc76800c8c0 tx=0x7fc76800cd80 comp rx=0 tx=0).stop 2023-06-02T15:30:57.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc76ffff640 1 -- 172.21.15.78:0/4015357342 reap_dead start 2023-06-02T15:30:57.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 shutdown_connections 2023-06-02T15:30:57.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 >> 172.21.15.78:0/4015357342 conn(0x7fc7700698f0 msgr2=0x7fc770069cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 shutdown_connections 2023-06-02T15:30:57.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.302+0000 7fc775b50640 1 -- 172.21.15.78:0/4015357342 wait complete. 2023-06-02T15:30:57.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 shutdown_connections 2023-06-02T15:30:57.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 >> 172.21.15.78:0/95144441 conn(0x7f6c340698f0 msgr2=0x7f6c34152e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 shutdown_connections 2023-06-02T15:30:57.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7f6c3c6f4640 1 -- 172.21.15.78:0/95144441 wait complete. 2023-06-02T15:30:57.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 --> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2418002cc0 con 0x7f242406f850 2023-06-02T15:30:57.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7f241f7fe640 1 -- 172.21.15.78:0/2281776486 <== osd.6 v2:172.21.15.132:6824/37341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2418002cc0 con 0x7f242406f850 2023-06-02T15:30:57.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 --> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7f80a7970 con 0x7fd7dc06f850 2023-06-02T15:30:57.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ee7fc640 1 -- 172.21.15.78:0/91413126 <== osd.7 v2:172.21.15.132:6800/37343 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd7f0003980 con 0x7fd7dc06f850 2023-06-02T15:30:57.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] conn(0x7fd7dc06f850 msgr2=0x7fd7dc071c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ffeaf640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] conn(0x7fd7dc06f850 0x7fd7dc071c80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd7dc065c00 msgr2=0x7fd7dc0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ffeaf640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd7dc065c00 0x7fd7dc0680b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd7e80b0000 tx=0x7fd7e80b7040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7f80bb650 msgr2=0x7fd7f80a7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ffeaf640 1 --2- 172.21.15.78:0/91413126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd7f80bb650 0x7fd7f80a7fa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80c0500 tx=0x7fd7f4007060 comp rx=0 tx=0).stop 2023-06-02T15:30:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7fe44c640 1 -- 172.21.15.78:0/91413126 reap_dead start 2023-06-02T15:30:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 shutdown_connections 2023-06-02T15:30:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 >> 172.21.15.78:0/91413126 conn(0x7fd7f80c4610 msgr2=0x7fd7f814c610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.306+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 shutdown_connections 2023-06-02T15:30:57.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.310+0000 7fd7ffeaf640 1 -- 172.21.15.78:0/91413126 wait complete. 2023-06-02T15:30:57.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 --> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f62a0153220 con 0x7f628c06f880 2023-06-02T15:30:57.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 >> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] conn(0x7f242406f850 msgr2=0x7f2424071c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f243d54d640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] conn(0x7f242406f850 0x7f2424071c80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2424065c00 msgr2=0x7f24240680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f243d54d640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2424065c00 0x7f24240680b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f24280b2000 tx=0x7f2428008040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2430041940 msgr2=0x7f24300d8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f243d54d640 1 --2- 172.21.15.78:0/2281776486 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2430041940 0x7f24300d8d80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2430046f90 tx=0x7f242c00c820 comp rx=0 tx=0).stop 2023-06-02T15:30:57.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f2436ffd640 1 -- 172.21.15.78:0/2281776486 reap_dead start 2023-06-02T15:30:57.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 shutdown_connections 2023-06-02T15:30:57.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 >> 172.21.15.78:0/2281776486 conn(0x7f2430043a40 msgr2=0x7f243003c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 shutdown_connections 2023-06-02T15:30:57.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f243d54d640 1 -- 172.21.15.78:0/2281776486 wait complete. 2023-06-02T15:30:57.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 --> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb6cc0cd760 con 0x7fb6b806f9d0 2023-06-02T15:30:57.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7f62877fe640 1 -- 172.21.15.78:0/119946026 <== osd.5 v2:172.21.15.132:6808/37340 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f62a0153220 con 0x7f628c06f880 2023-06-02T15:30:57.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7fb6ca7fc640 1 -- 172.21.15.78:0/1112527602 <== osd.4 v2:172.21.15.132:6816/37342 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb6cc0cd760 con 0x7fb6b806f9d0 2023-06-02T15:30:57.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 >> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] conn(0x7fb6b806f9d0 msgr2=0x7fb6b8071e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.314+0000 7fb6dbd6f640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] conn(0x7fb6b806f9d0 0x7fb6b8071e00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fb6b8065d00 msgr2=0x7fb6b80681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7fb6dbd6f640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fb6b8065d00 0x7fb6b80681b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6cc0e2be0 tx=0x7fb6d0008040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc007600 msgr2=0x7fb6cc03ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7fb6dbd6f640 1 --2- 172.21.15.78:0/1112527602 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6cc007600 0x7fb6cc03ef60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb6d4068000 tx=0x7fb6d4066ca0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7fb6dab0d640 1 -- 172.21.15.78:0/1112527602 reap_dead start 2023-06-02T15:30:57.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 shutdown_connections 2023-06-02T15:30:57.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 >> 172.21.15.78:0/1112527602 conn(0x7fb6cc043a40 msgr2=0x7fb6cc041840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 shutdown_connections 2023-06-02T15:30:57.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7fb6dbd6f640 1 -- 172.21.15.78:0/1112527602 wait complete. 2023-06-02T15:30:57.395 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-06-02T15:30:57.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-02T15:30:57.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 --> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8688002cc0 con 0x7f868406f990 2023-06-02T15:30:57.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] conn(0x7f628c06f880 msgr2=0x7f628c071cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f62a5749640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] conn(0x7f628c06f880 0x7f628c071cb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f628c065c30 msgr2=0x7f628c0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f62a5749640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f628c065c30 0x7f628c0680e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f62a014d850 tx=0x7f6290008040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 msgr2=0x7f62a006eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f62a5749640 1 --2- 172.21.15.78:0/119946026 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f62a00bab00 0x7f62a006eed0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f629401c900 tx=0x7f629401ba70 comp rx=0 tx=0).stop 2023-06-02T15:30:57.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f629f7fe640 1 -- 172.21.15.78:0/119946026 reap_dead start 2023-06-02T15:30:57.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86967fc640 1 -- 172.21.15.78:0/3177696600 <== osd.1 v2:172.21.15.78:6824/37135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8688002cc0 con 0x7f868406f990 2023-06-02T15:30:57.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 shutdown_connections 2023-06-02T15:30:57.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 >> 172.21.15.78:0/119946026 conn(0x7f62a00a3710 msgr2=0x7f62a006c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] conn(0x7f868406f990 msgr2=0x7f8684071dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] conn(0x7f868406f990 0x7f8684071dc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8684065cc0 msgr2=0x7f8684068170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8684065cc0 0x7f8684068170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f86900af000 tx=0x7f8690008040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868c0047d0 msgr2=0x7f86a0153f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 --2- 172.21.15.78:0/3177696600 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f868c0047d0 0x7f86a0153f30 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f869800c780 tx=0x7f869800c870 comp rx=0 tx=0).stop 2023-06-02T15:30:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6120640 1 -- 172.21.15.78:0/3177696600 reap_dead start 2023-06-02T15:30:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 shutdown_connections 2023-06-02T15:30:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 >> 172.21.15.78:0/3177696600 conn(0x7f86a00c1030 msgr2=0x7f86a014e330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 shutdown_connections 2023-06-02T15:30:57.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.318+0000 7f86a6921640 1 -- 172.21.15.78:0/3177696600 wait complete. 2023-06-02T15:30:57.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.322+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 shutdown_connections 2023-06-02T15:30:57.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.322+0000 7f62a5749640 1 -- 172.21.15.78:0/119946026 wait complete. 2023-06-02T15:30:57.402 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-06-02T15:30:57.402 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-02T15:30:57.403 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-06-02T15:30:57.403 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-02T15:30:57.404 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-02T15:30:57.404 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-02T15:30:57.405 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-06-02T15:30:57.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-02T15:30:57.406 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-06-02T15:30:57.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-02T15:30:57.407 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-06-02T15:30:57.407 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-02T15:30:57.408 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-06-02T15:30:57.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-02T15:30:57.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f44744dd640 1 Processor -- start 2023-06-02T15:30:57.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f44744dd640 1 -- start start 2023-06-02T15:30:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f8670cd3640 1 Processor -- start 2023-06-02T15:30:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f8670cd3640 1 -- start start 2023-06-02T15:30:57.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f6c0a70d640 1 Processor -- start 2023-06-02T15:30:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f44744dd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f446c0a3ea0 0x7f446c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f44744dd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0bc4c0 con 0x7f446c0bcc70 2023-06-02T15:30:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f44744dd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f446c0bb140 con 0x7f446c070ff0 2023-06-02T15:30:57.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f44744dd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f446c0a42b0 con 0x7f446c0a3ea0 2023-06-02T15:30:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f6c0a70d640 1 -- start start 2023-06-02T15:30:57.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f82275c8640 1 Processor -- start 2023-06-02T15:30:57.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.606+0000 7f4471a78640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f446c0a3ea0 0x7f446c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4472a7a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f446c070ff0 0x7f446c14a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:39916/0 (socket says 172.21.15.78:39916) 2023-06-02T15:30:57.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4472a7a640 1 -- 172.21.15.78:0/1037950078 learned_addr learned my addr 172.21.15.78:0/1037950078 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8670cd3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f866c14bda0 0x7f866c06cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8670cd3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f866c06bf70 0x7f866c151a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8670cd3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f866c151f90 0x7f866c0a2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8670cd3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c0a6440 con 0x7f866c151f90 2023-06-02T15:30:57.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8670cd3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c0bb990 con 0x7f866c14bda0 2023-06-02T15:30:57.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8670cd3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0a5da0 con 0x7f866c06bf70 2023-06-02T15:30:57.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866ad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f866c151f90 0x7f866c0a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f82275c8640 1 -- start start 2023-06-02T15:30:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866ad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f866c151f90 0x7f866c0a2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57580/0 (socket says 172.21.15.78:57580) 2023-06-02T15:30:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866ad9d640 1 -- 172.21.15.78:0/2792615660 learned_addr learned my addr 172.21.15.78:0/2792615660 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b7ce4a640 1 Processor -- start 2023-06-02T15:30:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819eb6f640 1 Processor -- start 2023-06-02T15:30:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101820627 0 0) 0x7f446c0bb140 con 0x7f446c070ff0 2023-06-02T15:30:57.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4458003450 con 0x7f446c070ff0 2023-06-02T15:30:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866a59c640 1 --2- 172.21.15.78:0/2792615660 >> v2:172.21.15.132:3300/0 conn(0x7f866c14bda0 0x7f866c06cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8669d9b640 1 --2- 172.21.15.78:0/2792615660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f866c06bf70 0x7f866c151a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866ad9d640 1 -- 172.21.15.78:0/2792615660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f866c06bf70 msgr2=0x7f866c151a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866ad9d640 1 --2- 172.21.15.78:0/2792615660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f866c06bf70 0x7f866c151a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866ad9d640 1 -- 172.21.15.78:0/2792615660 >> v2:172.21.15.132:3300/0 conn(0x7f866c14bda0 msgr2=0x7f866c06cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866ad9d640 1 --2- 172.21.15.78:0/2792615660 >> v2:172.21.15.132:3300/0 conn(0x7f866c14bda0 0x7f866c06cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866ad9d640 1 -- 172.21.15.78:0/2792615660 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c0baa80 con 0x7f866c151f90 2023-06-02T15:30:57.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866a59c640 1 --2- 172.21.15.78:0/2792615660 >> v2:172.21.15.132:3300/0 conn(0x7f866c14bda0 0x7f866c06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:57.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c0a70d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c040bc890 0x7f6c0414e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c0a70d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c040bc290 con 0x7f6c040bb000 2023-06-02T15:30:57.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c03fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6c0414b240 0x7f6c040a3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:39920/0 (socket says 172.21.15.78:39920) 2023-06-02T15:30:57.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c03fff640 1 -- 172.21.15.78:0/2005368912 learned_addr learned my addr 172.21.15.78:0/2005368912 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f82275c8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f82200c0aa0 0x7f82200a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f82275c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f82200a9fa0 0x7f822014ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f82275c8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82200c0e70 con 0x7f82200a65e0 2023-06-02T15:30:57.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f82275c8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82200bf780 con 0x7f82200c0aa0 2023-06-02T15:30:57.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f82275c8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8220151d20 con 0x7f82200a9fa0 2023-06-02T15:30:57.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c0a70d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c0414db10 con 0x7f6c0414b240 2023-06-02T15:30:57.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c0a70d640 1 -- 172.21.15.78:0/2005368912 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c040bbd60 con 0x7f6c040bc890 2023-06-02T15:30:57.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 <== mon.1 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1803394945 0 0) 0x7f4458003450 con 0x7f446c070ff0 2023-06-02T15:30:57.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 >> v2:172.21.15.132:3300/0 conn(0x7f446c0a3ea0 msgr2=0x7f446c070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 --2- 172.21.15.78:0/1037950078 >> v2:172.21.15.132:3300/0 conn(0x7f446c0a3ea0 0x7f446c070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 >> v1:172.21.15.78:6789/0 conn(0x7f446c0bcc70 legacy=0x7f446c0bd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0bbb80 con 0x7f446c070ff0 2023-06-02T15:30:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 <== mon.1 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f4464001a00 con 0x7f446c070ff0 2023-06-02T15:30:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 >> v1:172.21.15.132:6789/0 conn(0x7f446c070ff0 legacy=0x7f446c14a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4458003ae0 0x7f4458003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4458008860 0x7f445800ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f445800b4e0 0x7f445800d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445800e230 con 0x7f4458008860 2023-06-02T15:30:57.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445800e3a0 con 0x7f4458003ae0 2023-06-02T15:30:57.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f445800e560 con 0x7f445800b4e0 2023-06-02T15:30:57.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c08caa640 1 --2- 172.21.15.78:0/2005368912 >> v2:172.21.15.132:3300/0 conn(0x7f6c040bc890 0x7f6c0414e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8224b63640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f82200a65e0 0x7f822014e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55958/0 (socket says 172.21.15.78:55958) 2023-06-02T15:30:57.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8224b63640 1 -- 172.21.15.78:0/2911307908 learned_addr learned my addr 172.21.15.78:0/2911307908 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8225b65640 1 --2- 172.21.15.78:0/2911307908 >> v2:172.21.15.132:3300/0 conn(0x7f82200a9fa0 0x7f822014ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8225364640 1 --2- 172.21.15.78:0/2911307908 >> v2:172.21.15.78:3300/0 conn(0x7f82200c0aa0 0x7f82200a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819eb6f640 1 -- start start 2023-06-02T15:30:57.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819eb6f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81900d6b70 0x7f8190026320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819eb6f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8190046910 0x7f8190006ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819eb6f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819000b350 con 0x7f8190009a20 2023-06-02T15:30:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819eb6f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81900d6f40 con 0x7f8190046910 2023-06-02T15:30:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819eb6f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819000a7b0 con 0x7f81900d6b70 2023-06-02T15:30:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819c90b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81900d6b70 0x7f8190026320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819c90b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81900d6b70 0x7f8190026320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49756/0 (socket says 172.21.15.78:49756) 2023-06-02T15:30:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819c90b640 1 -- 172.21.15.78:0/2518142548 learned_addr learned my addr 172.21.15.78:0/2518142548 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b7ce4a640 1 -- start start 2023-06-02T15:30:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b7ce4a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780bb870 0x7f9b7806d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b7ce4a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b780a5800 0x7f9b780a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b7ce4a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b780bdbb0 con 0x7f9b7806fe10 2023-06-02T15:30:57.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b7ce4a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7806dbc0 con 0x7f9b780a5800 2023-06-02T15:30:57.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b7ce4a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b78071b90 con 0x7f9b780bb870 2023-06-02T15:30:57.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c02ffd640 1 -- 172.21.15.78:0/2005368912 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437869117 0 0) 0x7f6c0414db10 con 0x7f6c0414b240 2023-06-02T15:30:57.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c02ffd640 1 -- 172.21.15.78:0/2005368912 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6bec003530 con 0x7f6c0414b240 2023-06-02T15:30:57.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8225364640 1 -- 172.21.15.78:0/2911307908 >> v2:172.21.15.132:3300/0 conn(0x7f82200a9fa0 msgr2=0x7f822014ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8225364640 1 --2- 172.21.15.78:0/2911307908 >> v2:172.21.15.132:3300/0 conn(0x7f82200a9fa0 0x7f822014ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8225364640 1 -- 172.21.15.78:0/2911307908 >> v1:172.21.15.78:6789/0 conn(0x7f82200a65e0 legacy=0x7f822014e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819d10c640 1 --2- 172.21.15.78:0/2518142548 >> v2:172.21.15.132:3300/0 conn(0x7f8190046910 0x7f8190006ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b75d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780bb870 0x7f9b7806d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4472a7a640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f445800b4e0 0x7f445800d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b75d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780bb870 0x7f9b7806d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49758/0 (socket says 172.21.15.78:49758) 2023-06-02T15:30:57.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b75d9b640 1 -- 172.21.15.78:0/3989794126 learned_addr learned my addr 172.21.15.78:0/3989794126 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c08caa640 1 -- 172.21.15.78:0/2005368912 >> v1:172.21.15.132:6789/0 conn(0x7f6c0414b240 legacy=0x7f6c040a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c08caa640 1 -- 172.21.15.78:0/2005368912 >> v1:172.21.15.78:6789/0 conn(0x7f6c040bb000 legacy=0x7f6c0414dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f6c08caa640 1 -- 172.21.15.78:0/2005368912 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c040bc4c0 con 0x7f6c040bc890 2023-06-02T15:30:57.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471a78640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4458008860 0x7f445800ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b76d9d640 1 --2- 172.21.15.78:0/3989794126 >> v2:172.21.15.132:3300/0 conn(0x7f9b780a5800 0x7f9b780a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8225364640 1 -- 172.21.15.78:0/2911307908 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8220152000 con 0x7f82200c0aa0 2023-06-02T15:30:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f8225b65640 1 --2- 172.21.15.78:0/2911307908 >> v2:172.21.15.132:3300/0 conn(0x7f82200a9fa0 0x7f822014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819c90b640 1 -- 172.21.15.78:0/2518142548 >> v2:172.21.15.132:3300/0 conn(0x7f8190046910 msgr2=0x7f8190006ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819c90b640 1 --2- 172.21.15.78:0/2518142548 >> v2:172.21.15.132:3300/0 conn(0x7f8190046910 0x7f8190006ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819c90b640 1 -- 172.21.15.78:0/2518142548 >> v1:172.21.15.78:6789/0 conn(0x7f8190009a20 legacy=0x7f8190044cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f819c90b640 1 -- 172.21.15.78:0/2518142548 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81900da220 con 0x7f81900d6b70 2023-06-02T15:30:57.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4472279640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4458003ae0 0x7f4458003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471a78640 1 -- 172.21.15.78:0/1037950078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f445800b4e0 msgr2=0x7f445800d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471a78640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f445800b4e0 0x7f445800d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471a78640 1 -- 172.21.15.78:0/1037950078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4458003ae0 msgr2=0x7f4458003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471a78640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4458003ae0 0x7f4458003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4471a78640 1 -- 172.21.15.78:0/1037950078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c0bbb80 con 0x7f4458008860 2023-06-02T15:30:57.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7feee7fff640 1 Processor -- start 2023-06-02T15:30:57.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4472a7a640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f445800b4e0 0x7f445800d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:57.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f4472a7a640 1 -- 172.21.15.78:0/1037950078 reap_dead start 2023-06-02T15:30:57.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b76d9d640 1 -- 172.21.15.78:0/3989794126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780bb870 msgr2=0x7f9b7806d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b76d9d640 1 --2- 172.21.15.78:0/3989794126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780bb870 0x7f9b7806d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b76d9d640 1 -- 172.21.15.78:0/3989794126 >> v1:172.21.15.132:6789/0 conn(0x7f9b7806fe10 legacy=0x7f9b7806cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f9b76d9d640 1 -- 172.21.15.78:0/3989794126 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b78071e70 con 0x7f9b780a5800 2023-06-02T15:30:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7feee7fff640 1 -- start start 2023-06-02T15:30:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.610+0000 7f866ad9d640 1 --2- 172.21.15.78:0/2792615660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c151f90 0x7f866c0a2880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f866c0bac10 tx=0x7f866001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83180b7533089cb server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee806a6f0 0x7feee806aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feee80c2610 0x7feee814e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee7fff640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee80c4500 con 0x7feee80bf170 2023-06-02T15:30:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee7fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee806b000 con 0x7feee80c2610 2023-06-02T15:30:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee7fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee814f050 con 0x7feee806a6f0 2023-06-02T15:30:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee67fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7feee80bf170 0x7feee80a96c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55974/0 (socket says 172.21.15.78:55974) 2023-06-02T15:30:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee67fc640 1 -- 172.21.15.78:0/2099362752 learned_addr learned my addr 172.21.15.78:0/2099362752 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f866959a640 1 -- 172.21.15.78:0/2792615660 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600a89b0 con 0x7f866c151f90 2023-06-02T15:30:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f866959a640 1 -- 172.21.15.78:0/2792615660 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600a8b10 con 0x7f866c151f90 2023-06-02T15:30:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f866959a640 1 -- 172.21.15.78:0/2792615660 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600a8ea0 con 0x7f866c151f90 2023-06-02T15:30:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 -- 172.21.15.78:0/2792615660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c151f90 msgr2=0x7f866c0a2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 --2- 172.21.15.78:0/2792615660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c151f90 0x7f866c0a2880 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f866c0bac10 tx=0x7f866001ecf0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee6ffd640 1 --2- 172.21.15.78:0/2099362752 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee806a6f0 0x7feee806aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf3fff640 1 Processor -- start 2023-06-02T15:30:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee77fe640 1 --2- 172.21.15.78:0/2099362752 >> v2:172.21.15.132:3300/0 conn(0x7feee80c2610 0x7feee814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf3fff640 1 -- start start 2023-06-02T15:30:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c08caa640 1 --2- 172.21.15.78:0/2005368912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c040bc890 0x7f6c0414e6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00d1e0 tx=0x7f6bfc01ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e5cbcb37b5f29a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee5ffb640 1 -- 172.21.15.78:0/2099362752 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302358929 0 0) 0x7feee80c4500 con 0x7feee80bf170 2023-06-02T15:30:57.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee5ffb640 1 -- 172.21.15.78:0/2099362752 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed0003530 con 0x7feee80bf170 2023-06-02T15:30:57.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f819c90b640 1 --2- 172.21.15.78:0/2518142548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81900d6b70 0x7f8190026320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8184009870 tx=0x7f818401ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91dab35a930188d0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415ef50 0x7fbcf406a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbcf40c4270 0x7fbcf406ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8225364640 1 --2- 172.21.15.78:0/2911307908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200c0aa0 0x7f82200a60a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f821c0097c0 tx=0x7f821c01c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83bfa762a8101ca8 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 -- 172.21.15.78:0/2792615660 shutdown_connections 2023-06-02T15:30:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 --2- 172.21.15.78:0/2792615660 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c151f90 0x7f866c0a2880 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 --2- 172.21.15.78:0/2792615660 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f866c06bf70 0x7f866c151a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 --2- 172.21.15.78:0/2792615660 >> v2:172.21.15.132:3300/0 conn(0x7f866c14bda0 0x7f866c06cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 -- 172.21.15.78:0/2792615660 >> 172.21.15.78:0/2792615660 conn(0x7f866c06a520 msgr2=0x7f866c0a2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf3fff640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf40bfaa0 con 0x7fbcf415eb80 2023-06-02T15:30:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf3fff640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf415f820 con 0x7fbcf40c4270 2023-06-02T15:30:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf3fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf415f440 con 0x7fbcf415ef50 2023-06-02T15:30:57.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf2ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbcf415eb80 0x7fbcf406b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:55980/0 (socket says 172.21.15.78:55980) 2023-06-02T15:30:57.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf2ffd640 1 -- 172.21.15.78:0/2347637205 learned_addr learned my addr 172.21.15.78:0/2347637205 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:57.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf37fe640 1 --2- 172.21.15.78:0/2347637205 >> v2:172.21.15.132:3300/0 conn(0x7fbcf40c4270 0x7fbcf406ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf27fc640 1 --2- 172.21.15.78:0/2347637205 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415ef50 0x7fbcf406a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f81977fe640 1 -- 172.21.15.78:0/2518142548 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840a88b0 con 0x7f81900d6b70 2023-06-02T15:30:57.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f81977fe640 1 -- 172.21.15.78:0/2518142548 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81840a8a10 con 0x7f81900d6b70 2023-06-02T15:30:57.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f81977fe640 1 -- 172.21.15.78:0/2518142548 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81840a8da0 con 0x7f81900d6b70 2023-06-02T15:30:57.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 -- 172.21.15.78:0/2792615660 shutdown_connections 2023-06-02T15:30:57.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c02ffd640 1 -- 172.21.15.78:0/2005368912 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0a7db0 con 0x7f6c040bc890 2023-06-02T15:30:57.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c02ffd640 1 -- 172.21.15.78:0/2005368912 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc0ab070 con 0x7f6c040bc890 2023-06-02T15:30:57.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee77fe640 1 -- 172.21.15.78:0/2099362752 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee806a6f0 msgr2=0x7feee806aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee77fe640 1 --2- 172.21.15.78:0/2099362752 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee806a6f0 0x7feee806aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee77fe640 1 -- 172.21.15.78:0/2099362752 >> v1:172.21.15.78:6789/0 conn(0x7feee80bf170 legacy=0x7feee80a96c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7feee77fe640 1 -- 172.21.15.78:0/2099362752 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee814f330 con 0x7feee80c2610 2023-06-02T15:30:57.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c02ffd640 1 -- 172.21.15.78:0/2005368912 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0b1600 con 0x7f6c040bc890 2023-06-02T15:30:57.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f9b76d9d640 1 --2- 172.21.15.78:0/3989794126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 0x7f9b780a5c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009d90 tx=0x7f9b7001c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da2199f5bf82d359 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f9b7559a640 1 -- 172.21.15.78:0/3989794126 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b700a57a0 con 0x7f9b780a5800 2023-06-02T15:30:57.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f819eb6f640 1 -- 172.21.15.78:0/2518142548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81900d6b70 msgr2=0x7f8190026320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f819eb6f640 1 --2- 172.21.15.78:0/2518142548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81900d6b70 0x7f8190026320 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8184009870 tx=0x7f818401ecf0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 -- 172.21.15.78:0/2792615660 wait complete. 2023-06-02T15:30:57.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f819eb6f640 1 -- 172.21.15.78:0/2518142548 shutdown_connections 2023-06-02T15:30:57.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f819eb6f640 1 --2- 172.21.15.78:0/2518142548 >> v2:172.21.15.132:3300/0 conn(0x7f8190046910 0x7f8190006ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f819eb6f640 1 --2- 172.21.15.78:0/2518142548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f81900d6b70 0x7f8190026320 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f819eb6f640 1 -- 172.21.15.78:0/2518142548 >> 172.21.15.78:0/2518142548 conn(0x7f8190043870 msgr2=0x7f8190043c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c0a70d640 1 -- 172.21.15.78:0/2005368912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c040bc890 msgr2=0x7f6c0414e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c0a70d640 1 --2- 172.21.15.78:0/2005368912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c040bc890 0x7f6c0414e6b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00d1e0 tx=0x7f6bfc01ed20 comp rx=0 tx=0).stop 2023-06-02T15:30:57.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f819eb6f640 1 -- 172.21.15.78:0/2518142548 shutdown_connections 2023-06-02T15:30:57.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f819eb6f640 1 -- 172.21.15.78:0/2518142548 wait complete. 2023-06-02T15:30:57.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c0a70d640 1 -- 172.21.15.78:0/2005368912 shutdown_connections 2023-06-02T15:30:57.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c0a70d640 1 --2- 172.21.15.78:0/2005368912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c040bc890 0x7f6c0414e6b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c0a70d640 1 -- 172.21.15.78:0/2005368912 >> 172.21.15.78:0/2005368912 conn(0x7f6c040a2170 msgr2=0x7f6c040a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c0a70d640 1 -- 172.21.15.78:0/2005368912 shutdown_connections 2023-06-02T15:30:57.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f6c0a70d640 1 -- 172.21.15.78:0/2005368912 wait complete. 2023-06-02T15:30:57.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf37fe640 1 -- 172.21.15.78:0/2347637205 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415ef50 msgr2=0x7fbcf406a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:57.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf37fe640 1 --2- 172.21.15.78:0/2347637205 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415ef50 0x7fbcf406a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf37fe640 1 -- 172.21.15.78:0/2347637205 >> v1:172.21.15.78:6789/0 conn(0x7fbcf415eb80 legacy=0x7fbcf406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7fbcf37fe640 1 -- 172.21.15.78:0/2347637205 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf40bfcf0 con 0x7fbcf40c4270 2023-06-02T15:30:57.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 Processor -- start 2023-06-02T15:30:57.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f8670cd3640 1 -- start start 2023-06-02T15:30:57.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f9b7559a640 1 -- 172.21.15.78:0/3989794126 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b700a5900 con 0x7f9b780a5800 2023-06-02T15:30:57.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.614+0000 7f9b7559a640 1 -- 172.21.15.78:0/3989794126 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b700a5c90 con 0x7f9b780a5800 2023-06-02T15:30:57.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f9b7ce4a640 1 -- 172.21.15.78:0/3989794126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 msgr2=0x7f9b780a5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f9b7ce4a640 1 --2- 172.21.15.78:0/3989794126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 0x7f9b780a5c10 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009d90 tx=0x7f9b7001c930 comp rx=0 tx=0).stop 2023-06-02T15:30:57.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f4471a78640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4458008860 0x7f445800ace0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4468009ae0 tx=0x7f446801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d85c324fb87be39 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f9b7ce4a640 1 -- 172.21.15.78:0/3989794126 shutdown_connections 2023-06-02T15:30:57.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f9b7ce4a640 1 --2- 172.21.15.78:0/3989794126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 0x7f9b780a5c10 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f9b7ce4a640 1 --2- 172.21.15.78:0/3989794126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780bb870 0x7f9b7806d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f9b7ce4a640 1 -- 172.21.15.78:0/3989794126 >> 172.21.15.78:0/3989794126 conn(0x7f9b780c13d0 msgr2=0x7f9b780c17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680a55c0 con 0x7f4458008860 2023-06-02T15:30:57.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44680a5720 con 0x7f4458008860 2023-06-02T15:30:57.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f4471277640 1 -- 172.21.15.78:0/1037950078 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44680a5b10 con 0x7f4458008860 2023-06-02T15:30:57.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8217fff640 1 -- 172.21.15.78:0/2911307908 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c0ab600 con 0x7f82200c0aa0 2023-06-02T15:30:57.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8217fff640 1 -- 172.21.15.78:0/2911307908 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c0a7050 con 0x7f82200c0aa0 2023-06-02T15:30:57.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819eb6f640 1 Processor -- start 2023-06-02T15:30:57.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8217fff640 1 -- 172.21.15.78:0/2911307908 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c0ab980 con 0x7f82200c0aa0 2023-06-02T15:30:57.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8670cd3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866c14bda0 0x7f866c0b82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8670cd3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f866c151f90 0x7f866c0b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8670cd3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14c170 0x7f866c0b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8670cd3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c143f70 con 0x7f866c14c170 2023-06-02T15:30:57.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8670cd3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0b8810 con 0x7f866c14bda0 2023-06-02T15:30:57.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8670cd3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0b9130 con 0x7f866c151f90 2023-06-02T15:30:57.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f866ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14c170 0x7f866c0b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f866ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14c170 0x7f866c0b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57608/0 (socket says 172.21.15.78:57608) 2023-06-02T15:30:57.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f866ad9d640 1 -- 172.21.15.78:0/492926570 learned_addr learned my addr 172.21.15.78:0/492926570 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f866a59c640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866c14bda0 0x7f866c0b82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8669d9b640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f866c151f90 0x7f866c0b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f44744dd640 1 -- 172.21.15.78:0/1037950078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4458008860 msgr2=0x7f445800ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f44744dd640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4458008860 0x7f445800ace0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4468009ae0 tx=0x7f446801ca10 comp rx=0 tx=0).stop 2023-06-02T15:30:57.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f44744dd640 1 -- 172.21.15.78:0/1037950078 shutdown_connections 2023-06-02T15:30:57.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f44744dd640 1 --2- 172.21.15.78:0/1037950078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4458008860 0x7f445800ace0 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4468009ae0 tx=0x7f446801ca10 comp rx=0 tx=0).stop 2023-06-02T15:30:57.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f44744dd640 1 -- 172.21.15.78:0/1037950078 >> 172.21.15.78:0/1037950078 conn(0x7f446c0698f0 msgr2=0x7f446c069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c0a70d640 1 Processor -- start 2023-06-02T15:30:57.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7feee77fe640 1 --2- 172.21.15.78:0/2099362752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee80c2610 0x7feee814e530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feedc0097c0 tx=0x7feedc01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0075d0b06c13e1d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819eb6f640 1 -- start start 2023-06-02T15:30:57.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f866ad9d640 1 -- 172.21.15.78:0/492926570 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f866c151f90 msgr2=0x7f866c0b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f866ad9d640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f866c151f90 0x7f866c0b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f866ad9d640 1 -- 172.21.15.78:0/492926570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866c14bda0 msgr2=0x7f866c0b82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f866ad9d640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866c14bda0 0x7f866c0b82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f866ad9d640 1 -- 172.21.15.78:0/492926570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86600094d0 con 0x7f866c14c170 2023-06-02T15:30:57.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f44744dd640 1 -- 172.21.15.78:0/1037950078 shutdown_connections 2023-06-02T15:30:57.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7feee5ffb640 1 -- 172.21.15.78:0/2099362752 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc0a8970 con 0x7feee80c2610 2023-06-02T15:30:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f82275c8640 1 -- 172.21.15.78:0/2911307908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200c0aa0 msgr2=0x7f82200a60a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f82275c8640 1 --2- 172.21.15.78:0/2911307908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200c0aa0 0x7f82200a60a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f821c0097c0 tx=0x7f821c01c3b0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f82275c8640 1 -- 172.21.15.78:0/2911307908 shutdown_connections 2023-06-02T15:30:57.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f82275c8640 1 --2- 172.21.15.78:0/2911307908 >> v2:172.21.15.132:3300/0 conn(0x7f82200a9fa0 0x7f822014ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f82275c8640 1 --2- 172.21.15.78:0/2911307908 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200c0aa0 0x7f82200a60a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f82275c8640 1 -- 172.21.15.78:0/2911307908 >> 172.21.15.78:0/2911307908 conn(0x7f82200c4620 msgr2=0x7f82200c4a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7feee5ffb640 1 -- 172.21.15.78:0/2099362752 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc0a8ad0 con 0x7feee80c2610 2023-06-02T15:30:57.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7feee5ffb640 1 -- 172.21.15.78:0/2099362752 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc0a8e40 con 0x7feee80c2610 2023-06-02T15:30:57.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f9b7ce4a640 1 -- 172.21.15.78:0/3989794126 shutdown_connections 2023-06-02T15:30:57.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f82275c8640 1 -- 172.21.15.78:0/2911307908 shutdown_connections 2023-06-02T15:30:57.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f82275c8640 1 -- 172.21.15.78:0/2911307908 wait complete. 2023-06-02T15:30:57.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f866ad9d640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14c170 0x7f866c0b6710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f866001c920 tx=0x7f866001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819eb6f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8190009a20 0x7f819002c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819eb6f640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8190046910 0x7f8190027c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819eb6f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81900d6b70 0x7f81900c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819eb6f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81900c5a00 con 0x7f81900d6b70 2023-06-02T15:30:57.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819eb6f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81900c5720 con 0x7f8190009a20 2023-06-02T15:30:57.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819eb6f640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81900dd8f0 con 0x7f8190046910 2023-06-02T15:30:57.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f9b7ce4a640 1 -- 172.21.15.78:0/3989794126 wait complete. 2023-06-02T15:30:57.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7feee7fff640 1 -- 172.21.15.78:0/2099362752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee80c2610 msgr2=0x7feee814e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7feee7fff640 1 --2- 172.21.15.78:0/2099362752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee80c2610 0x7feee814e530 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7feedc0097c0 tx=0x7feedc01ec90 comp rx=0 tx=0).stop 2023-06-02T15:30:57.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c0a70d640 1 -- start start 2023-06-02T15:30:57.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c0a70d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c040bb000 0x7f6c0406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819d10c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81900d6b70 0x7f81900c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c0a70d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c040bc890 0x7f6c040bf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c0a70d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c0414b240 0x7f6c040b59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c0a70d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c04071810 con 0x7f6c0414b240 2023-06-02T15:30:57.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c0a70d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c0406f070 con 0x7f6c040bc890 2023-06-02T15:30:57.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c0a70d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c040bfd40 con 0x7f6c040bb000 2023-06-02T15:30:57.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819d10c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81900d6b70 0x7f81900c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57614/0 (socket says 172.21.15.78:57614) 2023-06-02T15:30:57.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819d10c640 1 -- 172.21.15.78:0/102533675 learned_addr learned my addr 172.21.15.78:0/102533675 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8197fff640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8190046910 0x7f8190027c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f819c90b640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8190009a20 0x7f819002c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c040bb000 0x7f6c0406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c037fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c040bc890 0x7f6c040bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c03fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c040bb000 0x7f6c0406eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49814/0 (socket says 172.21.15.78:49814) 2023-06-02T15:30:57.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c03fff640 1 -- 172.21.15.78:0/530383202 learned_addr learned my addr 172.21.15.78:0/530383202 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c08caa640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c0414b240 0x7f6c040b59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f9b7ce4a640 1 Processor -- start 2023-06-02T15:30:57.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c08caa640 1 -- 172.21.15.78:0/530383202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c040bb000 msgr2=0x7f6c0406eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c08caa640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c040bb000 0x7f6c0406eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c08caa640 1 -- 172.21.15.78:0/530383202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c040bc890 msgr2=0x7f6c040bf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c08caa640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c040bc890 0x7f6c040bf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f6c08caa640 1 -- 172.21.15.78:0/530383202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bfc007910 con 0x7f6c0414b240 2023-06-02T15:30:57.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8197fff640 1 -- 172.21.15.78:0/102533675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8190009a20 msgr2=0x7f819002c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8197fff640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8190009a20 0x7f819002c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8197fff640 1 -- 172.21.15.78:0/102533675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81900d6b70 msgr2=0x7f81900c2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8197fff640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81900d6b70 0x7f81900c2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f82275c8640 1 Processor -- start 2023-06-02T15:30:57.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8197fff640 1 -- 172.21.15.78:0/102533675 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81840094d0 con 0x7f8190046910 2023-06-02T15:30:57.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f865affd640 1 -- 172.21.15.78:0/492926570 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600b1d10 con 0x7f866c14c170 2023-06-02T15:30:57.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f865affd640 1 -- 172.21.15.78:0/492926570 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86600b1e70 con 0x7f866c14c170 2023-06-02T15:30:57.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f8670cd3640 1 -- 172.21.15.78:0/492926570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c0a6160 con 0x7f866c14c170 2023-06-02T15:30:57.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f865affd640 1 -- 172.21.15.78:0/492926570 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600b9610 con 0x7f866c14c170 2023-06-02T15:30:57.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 -- 172.21.15.78:0/2099362752 shutdown_connections 2023-06-02T15:30:57.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 --2- 172.21.15.78:0/2099362752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee80c2610 0x7feee814e530 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 --2- 172.21.15.78:0/2099362752 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee806a6f0 0x7feee806aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 -- 172.21.15.78:0/2099362752 >> 172.21.15.78:0/2099362752 conn(0x7feee80a62a0 msgr2=0x7feee80a66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f8670cd3640 1 -- 172.21.15.78:0/492926570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c0bbbe0 con 0x7f866c14c170 2023-06-02T15:30:57.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.618+0000 7f9b7ce4a640 1 -- start start 2023-06-02T15:30:57.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b7ce4a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b7806fe10 0x7f9b781e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b7ce4a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 0x7f9b7814de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b7ce4a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780a3cb0 0x7f9b7814e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b7ce4a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781e4900 con 0x7f9b7806fe10 2023-06-02T15:30:57.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b7ce4a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781f73c0 con 0x7f9b780a5800 2023-06-02T15:30:57.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b7ce4a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b781e7db0 con 0x7f9b780a3cb0 2023-06-02T15:30:57.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b75d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 0x7f9b7814de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b75d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 0x7f9b7814de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49124/0 (socket says 172.21.15.78:49124) 2023-06-02T15:30:57.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b75d9b640 1 -- 172.21.15.78:0/3771888495 learned_addr learned my addr 172.21.15.78:0/3771888495 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f8197fff640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8190046910 0x7f8190027c40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f818c00c360 tx=0x7f818c00c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f44744dd640 1 -- 172.21.15.78:0/1037950078 wait complete. 2023-06-02T15:30:57.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 -- 172.21.15.78:0/2099362752 shutdown_connections 2023-06-02T15:30:57.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 -- 172.21.15.78:0/2099362752 wait complete. 2023-06-02T15:30:57.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b7659c640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b7806fe10 0x7f9b781e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b76d9d640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780a3cb0 0x7f9b7814e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b75d9b640 1 -- 172.21.15.78:0/3771888495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780a3cb0 msgr2=0x7f9b7814e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b75d9b640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780a3cb0 0x7f9b7814e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b75d9b640 1 -- 172.21.15.78:0/3771888495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b7806fe10 msgr2=0x7f9b781e7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b75d9b640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b7806fe10 0x7f9b781e7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7fbcf37fe640 1 --2- 172.21.15.78:0/2347637205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40c4270 0x7fbcf406ac30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbce80097c0 tx=0x7fbce801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14e4ea532e14cdb9 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b75d9b640 1 -- 172.21.15.78:0/3771888495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b70009a70 con 0x7f9b780a5800 2023-06-02T15:30:57.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f8670cd3640 1 -- 172.21.15.78:0/492926570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c06c7b0 con 0x7f866c14c170 2023-06-02T15:30:57.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f6c08caa640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c0414b240 0x7f6c040b59a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c040a3150 tx=0x7f6bfc01bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f81957fa640 1 -- 172.21.15.78:0/102533675 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c003600 con 0x7f8190046910 2023-06-02T15:30:57.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b75d9b640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 0x7f9b7814de30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00d990 tx=0x7f9b6c00de50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b66ffd640 1 -- 172.21.15.78:0/3771888495 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c00ab60 con 0x7f9b780a5800 2023-06-02T15:30:57.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b66ffd640 1 -- 172.21.15.78:0/3771888495 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b6c00acc0 con 0x7f9b780a5800 2023-06-02T15:30:57.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 Processor -- start 2023-06-02T15:30:57.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 -- start start 2023-06-02T15:30:57.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7fbcf1ffb640 1 -- 172.21.15.78:0/2347637205 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce80ab5f0 con 0x7fbcf40c4270 2023-06-02T15:30:57.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f44744dd640 1 Processor -- start 2023-06-02T15:30:57.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7fbcf1ffb640 1 -- 172.21.15.78:0/2347637205 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce80ab750 con 0x7fbcf40c4270 2023-06-02T15:30:57.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7fbcf1ffb640 1 -- 172.21.15.78:0/2347637205 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce80abae0 con 0x7fbcf40c4270 2023-06-02T15:30:57.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee806a6f0 0x7feee80a9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee80bf170 0x7feee80bb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee80c2610 0x7feee80bbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80a59a0 con 0x7feee80bf170 2023-06-02T15:30:57.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80be710 con 0x7feee806a6f0 2023-06-02T15:30:57.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee7fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee80be470 con 0x7feee80c2610 2023-06-02T15:30:57.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b66ffd640 1 -- 172.21.15.78:0/3771888495 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b6c0106b0 con 0x7f9b780a5800 2023-06-02T15:30:57.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b7ce4a640 1 -- 172.21.15.78:0/3771888495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b78070370 con 0x7f9b780a5800 2023-06-02T15:30:57.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee806a6f0 0x7feee80a9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee77fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee80c2610 0x7feee80bbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f9b7ce4a640 1 -- 172.21.15.78:0/3771888495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b780701e0 con 0x7f9b780a5800 2023-06-02T15:30:57.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee806a6f0 0x7feee80a9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49136/0 (socket says 172.21.15.78:49136) 2023-06-02T15:30:57.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7feee6ffd640 1 -- 172.21.15.78:0/108957149 learned_addr learned my addr 172.21.15.78:0/108957149 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f865affd640 1 -- 172.21.15.78:0/492926570 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f86600b7040 con 0x7f866c14c170 2023-06-02T15:30:57.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f865affd640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f864c065d00 0x7f864c0681b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f865affd640 1 -- 172.21.15.78:0/492926570 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8660120760 con 0x7f866c14c170 2023-06-02T15:30:57.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feee77fe640 1 -- 172.21.15.78:0/108957149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee806a6f0 msgr2=0x7feee80a9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feee77fe640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee806a6f0 0x7feee80a9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feee77fe640 1 -- 172.21.15.78:0/108957149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee80bf170 msgr2=0x7feee80bb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feee77fe640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee80bf170 0x7feee80bb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feee77fe640 1 -- 172.21.15.78:0/108957149 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc009420 con 0x7feee80c2610 2023-06-02T15:30:57.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f866a59c640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f864c065d00 0x7f864c0681b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feee77fe640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee80c2610 0x7feee80bbd20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feedc0af000 tx=0x7feedc01ba30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f9b7ce4a640 1 -- 172.21.15.78:0/3771888495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b7806a100 con 0x7f9b780a5800 2023-06-02T15:30:57.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f82275c8640 1 -- start start 2023-06-02T15:30:57.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f82275c8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f82200a65e0 0x7f82200bd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f82275c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200a9fa0 0x7f822006f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f82275c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82200c0aa0 0x7f822006fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f82275c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82200bdf80 con 0x7f82200a9fa0 2023-06-02T15:30:57.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f82275c8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f822014afe0 con 0x7f82200c0aa0 2023-06-02T15:30:57.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.622+0000 7f82275c8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82200bb700 con 0x7f82200a65e0 2023-06-02T15:30:57.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8225364640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f82200a65e0 0x7f82200bd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8225364640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f82200a65e0 0x7f82200bd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49842/0 (socket says 172.21.15.78:49842) 2023-06-02T15:30:57.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8225364640 1 -- 172.21.15.78:0/1120191059 learned_addr learned my addr 172.21.15.78:0/1120191059 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8224b63640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200a9fa0 0x7f822006f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7fbcf3fff640 1 -- 172.21.15.78:0/2347637205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40c4270 msgr2=0x7fbcf406ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7fbcf3fff640 1 --2- 172.21.15.78:0/2347637205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40c4270 0x7fbcf406ac30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbce80097c0 tx=0x7fbce801c450 comp rx=0 tx=0).stop 2023-06-02T15:30:57.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8225364640 1 -- 172.21.15.78:0/1120191059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82200c0aa0 msgr2=0x7f822006fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8225364640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82200c0aa0 0x7f822006fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8225364640 1 -- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200a9fa0 msgr2=0x7f822006f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8225364640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200a9fa0 0x7f822006f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8225364640 1 -- 172.21.15.78:0/1120191059 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c009420 con 0x7f82200a65e0 2023-06-02T15:30:57.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feecf7fe640 1 -- 172.21.15.78:0/108957149 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc004440 con 0x7feee80c2610 2023-06-02T15:30:57.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feecf7fe640 1 -- 172.21.15.78:0/108957149 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feedc003620 con 0x7feee80c2610 2023-06-02T15:30:57.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feecf7fe640 1 -- 172.21.15.78:0/108957149 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc003990 con 0x7feee80c2610 2023-06-02T15:30:57.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8224b63640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200a9fa0 0x7f822006f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:57.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f866a59c640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f864c065d00 0x7f864c0681b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8664003ab0 tx=0x7f86640098f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8225364640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f82200a65e0 0x7f82200bd2d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f821c018fc0 tx=0x7f821c019150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8215ffb640 1 -- 172.21.15.78:0/1120191059 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c0b4600 con 0x7f82200a65e0 2023-06-02T15:30:57.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8215ffb640 1 -- 172.21.15.78:0/1120191059 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f821c0b47a0 con 0x7f82200a65e0 2023-06-02T15:30:57.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f8215ffb640 1 -- 172.21.15.78:0/1120191059 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f821c0b4b50 con 0x7f82200a65e0 2023-06-02T15:30:57.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f44744dd640 1 -- start start 2023-06-02T15:30:57.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f44744dd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c0be460 0x7f446c1d4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f44744dd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f446c1d3df0 0x7f446c0b9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f44744dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f446c0b9cd0 0x7f446c1d2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f44744dd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c146580 con 0x7f446c0b9cd0 2023-06-02T15:30:57.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f44744dd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f446c1d4fe0 con 0x7f446c1d3df0 2023-06-02T15:30:57.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f44744dd640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f446c1d1b50 con 0x7f446c0be460 2023-06-02T15:30:57.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4472a7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f446c0b9cd0 0x7f446c1d2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4472a7a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f446c0b9cd0 0x7f446c1d2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57668/0 (socket says 172.21.15.78:57668) 2023-06-02T15:30:57.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4472a7a640 1 -- 172.21.15.78:0/3287959301 learned_addr learned my addr 172.21.15.78:0/3287959301 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4471a78640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f446c1d3df0 0x7f446c0b9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4472279640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c0be460 0x7f446c1d4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4472a7a640 1 -- 172.21.15.78:0/3287959301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c0be460 msgr2=0x7f446c1d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4472a7a640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c0be460 0x7f446c1d4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4472a7a640 1 -- 172.21.15.78:0/3287959301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f446c1d3df0 msgr2=0x7f446c0b9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4472a7a640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f446c1d3df0 0x7f446c0b9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4472a7a640 1 -- 172.21.15.78:0/3287959301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f446c071410 con 0x7f446c0b9cd0 2023-06-02T15:30:57.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feee7fff640 1 -- 172.21.15.78:0/108957149 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee80a9dd0 con 0x7feee80c2610 2023-06-02T15:30:57.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feee7fff640 1 -- 172.21.15.78:0/108957149 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee806b2c0 con 0x7feee80c2610 2023-06-02T15:30:57.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7feee7fff640 1 -- 172.21.15.78:0/108957149 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee80a9f60 con 0x7feee80c2610 2023-06-02T15:30:57.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f9b66ffd640 1 -- 172.21.15.78:0/3771888495 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f9b6c023480 con 0x7f9b780a5800 2023-06-02T15:30:57.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f9b66ffd640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b58065c00 0x7f9b580680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f9b66ffd640 1 -- 172.21.15.78:0/3771888495 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9b6c083c80 con 0x7f9b780a5800 2023-06-02T15:30:57.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f9b7659c640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b58065c00 0x7f9b580680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f4472a7a640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f446c0b9cd0 0x7f446c1d2540 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f446c0a64e0 tx=0x7f446400ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7fbcf3fff640 1 -- 172.21.15.78:0/2347637205 shutdown_connections 2023-06-02T15:30:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7fbcf3fff640 1 --2- 172.21.15.78:0/2347637205 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40c4270 0x7fbcf406ac30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7fbcf3fff640 1 --2- 172.21.15.78:0/2347637205 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415ef50 0x7fbcf406a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7fbcf3fff640 1 -- 172.21.15.78:0/2347637205 >> 172.21.15.78:0/2347637205 conn(0x7fbcf40c4710 msgr2=0x7fbcf40c4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f82275c8640 1 -- 172.21.15.78:0/1120191059 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8220151940 con 0x7f82200a65e0 2023-06-02T15:30:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f9b7659c640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b58065c00 0x7f9b580680b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9b680016c0 tx=0x7f9b68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.626+0000 7f82275c8640 1 -- 172.21.15.78:0/1120191059 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f822014f190 con 0x7f82200a65e0 2023-06-02T15:30:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f81957fa640 1 -- 172.21.15.78:0/102533675 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c003760 con 0x7f8190046910 2023-06-02T15:30:57.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f865affd640 1 -- 172.21.15.78:0/492926570 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f86600edcd0 con 0x7f866c14c170 2023-06-02T15:30:57.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f6c00ff9640 1 -- 172.21.15.78:0/530383202 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc004240 con 0x7f6c0414b240 2023-06-02T15:30:57.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f6c00ff9640 1 -- 172.21.15.78:0/530383202 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bfc003e90 con 0x7f6c0414b240 2023-06-02T15:30:57.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f6c00ff9640 1 -- 172.21.15.78:0/530383202 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0045a0 con 0x7f6c0414b240 2023-06-02T15:30:57.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f82037fe640 1 -- 172.21.15.78:0/1120191059 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81fc005260 con 0x7f82200a65e0 2023-06-02T15:30:57.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf3fff640 1 -- 172.21.15.78:0/2347637205 shutdown_connections 2023-06-02T15:30:57.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf3fff640 1 -- 172.21.15.78:0/2347637205 wait complete. 2023-06-02T15:30:57.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf3fff640 1 Processor -- start 2023-06-02T15:30:57.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7feecf7fe640 1 -- 172.21.15.78:0/108957149 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7feedc0b7040 con 0x7feee80c2610 2023-06-02T15:30:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7feecf7fe640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feed4065c00 0x7feed40680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7feecf7fe640 1 -- 172.21.15.78:0/108957149 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feedc120690 con 0x7feee80c2610 2023-06-02T15:30:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7feee6ffd640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feed4065c00 0x7feed40680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7feee6ffd640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feed4065c00 0x7feed40680b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feed8009c20 tx=0x7feed8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f819eb6f640 1 -- 172.21.15.78:0/102533675 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819000b860 con 0x7f8190046910 2023-06-02T15:30:57.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f819eb6f640 1 -- 172.21.15.78:0/102533675 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819000b580 con 0x7f8190046910 2023-06-02T15:30:57.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f81957fa640 1 -- 172.21.15.78:0/102533675 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c003b50 con 0x7f8190046910 2023-06-02T15:30:57.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f819eb6f640 1 -- 172.21.15.78:0/102533675 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8178005260 con 0x7f8190046910 2023-06-02T15:30:57.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f4462ffd640 1 -- 172.21.15.78:0/3287959301 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464007450 con 0x7f446c0b9cd0 2023-06-02T15:30:57.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f44744dd640 1 -- 172.21.15.78:0/3287959301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f446c0bc710 con 0x7f446c0b9cd0 2023-06-02T15:30:57.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f44744dd640 1 -- 172.21.15.78:0/3287959301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f446c0bc1c0 con 0x7f446c0b9cd0 2023-06-02T15:30:57.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f44744dd640 1 -- 172.21.15.78:0/3287959301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f446c073bc0 con 0x7f446c0b9cd0 2023-06-02T15:30:57.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f8215ffb640 1 -- 172.21.15.78:0/1120191059 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f821c0b2040 con 0x7f82200a65e0 2023-06-02T15:30:57.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f8215ffb640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8204065c00 0x7f82040680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f8215ffb640 1 -- 172.21.15.78:0/1120191059 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f821c11df20 con 0x7f82200a65e0 2023-06-02T15:30:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf3fff640 1 -- start start 2023-06-02T15:30:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40c4270 0x7fbcf40bd820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf3fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415eb80 0x7fbcf41f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf415ef50 0x7fbcf40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf3fff640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40c2830 con 0x7fbcf415ef50 2023-06-02T15:30:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf3fff640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf40bdd60 con 0x7fbcf40c4270 2023-06-02T15:30:57.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf3fff640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf41f4150 con 0x7fbcf415eb80 2023-06-02T15:30:57.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40c4270 0x7fbcf40bd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf27fc640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415eb80 0x7fbcf41f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40c4270 0x7fbcf40bd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49162/0 (socket says 172.21.15.78:49162) 2023-06-02T15:30:57.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf2ffd640 1 -- 172.21.15.78:0/220327016 learned_addr learned my addr 172.21.15.78:0/220327016 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:57.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf37fe640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf415ef50 0x7fbcf40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f4462ffd640 1 -- 172.21.15.78:0/3287959301 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44640075b0 con 0x7f446c0b9cd0 2023-06-02T15:30:57.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f4462ffd640 1 -- 172.21.15.78:0/3287959301 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4464007960 con 0x7f446c0b9cd0 2023-06-02T15:30:57.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f8224b63640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8204065c00 0x7f82040680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf27fc640 1 -- 172.21.15.78:0/220327016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40c4270 msgr2=0x7fbcf40bd820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf27fc640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40c4270 0x7fbcf40bd820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf27fc640 1 -- 172.21.15.78:0/220327016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf415ef50 msgr2=0x7fbcf40b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf27fc640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf415ef50 0x7fbcf40b8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7fbcf27fc640 1 -- 172.21.15.78:0/220327016 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce8009420 con 0x7fbcf415eb80 2023-06-02T15:30:57.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7fbcf27fc640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415eb80 0x7fbcf41f3c10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbce400e870 tx=0x7fbce400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f8224b63640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8204065c00 0x7f82040680b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8210007fd0 tx=0x7f8210009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f4462ffd640 1 -- 172.21.15.78:0/3287959301 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f44640133f0 con 0x7f446c0b9cd0 2023-06-02T15:30:57.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f4462ffd640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4450065cd0 0x7f4450068180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f4462ffd640 1 -- 172.21.15.78:0/3287959301 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4464083e70 con 0x7f446c0b9cd0 2023-06-02T15:30:57.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f4472279640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4450065cd0 0x7f4450068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f6c0a70d640 1 -- 172.21.15.78:0/530383202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c0414a5a0 con 0x7f6c0414b240 2023-06-02T15:30:57.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.630+0000 7f6c0a70d640 1 -- 172.21.15.78:0/530383202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c040a3c80 con 0x7f6c0414b240 2023-06-02T15:30:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f6c00ff9640 1 -- 172.21.15.78:0/530383202 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f6bfc004700 con 0x7f6c0414b240 2023-06-02T15:30:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f6c00ff9640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6bf0065cd0 0x7f6bf0068180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f6c00ff9640 1 -- 172.21.15.78:0/530383202 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6bfc11dce0 con 0x7f6c0414b240 2023-06-02T15:30:57.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f6c03fff640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6bf0065cd0 0x7f6bf0068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f4472279640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4450065cd0 0x7f4450068180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f445c000fc0 tx=0x7f445c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f6c03fff640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6bf0065cd0 0x7f6bf0068180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80011f0 tx=0x7f6bf8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.634+0000 7f6c0a70d640 1 -- 172.21.15.78:0/530383202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c04158690 con 0x7f6c0414b240 2023-06-02T15:30:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.638+0000 7f4462ffd640 1 -- 172.21.15.78:0/3287959301 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f44640513c0 con 0x7f446c0b9cd0 2023-06-02T15:30:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.642+0000 7f9b66ffd640 1 -- 172.21.15.78:0/3771888495 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f9b6c0510b0 con 0x7f9b780a5800 2023-06-02T15:30:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.642+0000 7f6c00ff9640 1 -- 172.21.15.78:0/530383202 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f6bfc0eb250 con 0x7f6c0414b240 2023-06-02T15:30:57.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.642+0000 7feecf7fe640 1 -- 172.21.15.78:0/108957149 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7feedc0edc10 con 0x7feee80c2610 2023-06-02T15:30:57.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.654+0000 7fbcdbfff640 1 -- 172.21.15.78:0/220327016 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce400ee60 con 0x7fbcf415eb80 2023-06-02T15:30:57.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.654+0000 7fbcf3fff640 1 -- 172.21.15.78:0/220327016 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf406bdd0 con 0x7fbcf415eb80 2023-06-02T15:30:57.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.654+0000 7fbcf3fff640 1 -- 172.21.15.78:0/220327016 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf40c04f0 con 0x7fbcf415eb80 2023-06-02T15:30:57.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.654+0000 7f8215ffb640 1 -- 172.21.15.78:0/1120191059 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f821c0eb400 con 0x7f82200a65e0 2023-06-02T15:30:57.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7fbcf3fff640 1 -- 172.21.15.78:0/220327016 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf406bf60 con 0x7fbcf415eb80 2023-06-02T15:30:57.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7fbcdbfff640 1 -- 172.21.15.78:0/220327016 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce40059a0 con 0x7fbcf415eb80 2023-06-02T15:30:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7fbcdbfff640 1 -- 172.21.15.78:0/220327016 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce4005d30 con 0x7fbcf415eb80 2023-06-02T15:30:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7fbcdbfff640 1 -- 172.21.15.78:0/220327016 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fbce400c940 con 0x7fbcf415eb80 2023-06-02T15:30:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7f81957fa640 1 -- 172.21.15.78:0/102533675 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f818c003cb0 con 0x7f8190046910 2023-06-02T15:30:57.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7f81957fa640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f817c065c00 0x7f817c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7fbcdbfff640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbce0065c00 0x7fbce00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7fbcf2ffd640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbce0065c00 0x7fbce00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7fbcf2ffd640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbce0065c00 0x7fbce00680b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbcec001f60 tx=0x7fbcec001ad0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7f81957fa640 1 -- 172.21.15.78:0/102533675 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f818c082680 con 0x7f8190046910 2023-06-02T15:30:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7f819c90b640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f817c065c00 0x7f817c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.658+0000 7f819c90b640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f817c065c00 0x7f817c0680b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f81840b2000 tx=0x7f8184009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.670+0000 7f81957fa640 1 -- 172.21.15.78:0/102533675 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f818c04fd80 con 0x7f8190046910 2023-06-02T15:30:57.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.670+0000 7fbcdbfff640 1 -- 172.21.15.78:0/220327016 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbce4054f70 con 0x7fbcf415eb80 2023-06-02T15:30:57.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.678+0000 7fbcdbfff640 1 -- 172.21.15.78:0/220327016 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fbce40512b0 con 0x7fbcf415eb80 2023-06-02T15:30:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.926+0000 7f8670cd3640 1 -- 172.21.15.78:0/492926570 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f866c0bc560 con 0x7f866c14c170 2023-06-02T15:30:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.930+0000 7f865affd640 1 -- 172.21.15.78:0/492926570 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86600f12f0 con 0x7f866c14c170 2023-06-02T15:30:57.939 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-02T15:30:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.930+0000 7f8658ff9640 1 -- 172.21.15.78:0/492926570 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f864c065d00 msgr2=0x7f864c0681b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.930+0000 7f8658ff9640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f864c065d00 0x7f864c0681b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8664003ab0 tx=0x7f86640098f0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.930+0000 7f8658ff9640 1 -- 172.21.15.78:0/492926570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14c170 msgr2=0x7f866c0b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.930+0000 7f8658ff9640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14c170 0x7f866c0b6710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f866001c920 tx=0x7f866001ba90 comp rx=0 tx=0).stop 2023-06-02T15:30:57.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.930+0000 7f6c0a70d640 1 -- 172.21.15.78:0/530383202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6c04073bc0 con 0x7f6c0414b240 2023-06-02T15:30:57.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.930+0000 7f6c00ff9640 1 -- 172.21.15.78:0/530383202 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bfc0ad020 con 0x7f6c0414b240 2023-06-02T15:30:57.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.930+0000 7f8658ff9640 1 -- 172.21.15.78:0/492926570 shutdown_connections 2023-06-02T15:30:57.941 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-06-02T15:30:57.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f44744dd640 1 -- 172.21.15.78:0/3287959301 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f446c14b920 con 0x7f446c0b9cd0 2023-06-02T15:30:57.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f4462ffd640 1 -- 172.21.15.78:0/3287959301 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44640549e0 con 0x7f446c0b9cd0 2023-06-02T15:30:57.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.930+0000 7f8658ff9640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f864c065d00 0x7f864c0681b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f8658ff9640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f866c14c170 0x7f866c0b6710 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f8658ff9640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f866c151f90 0x7f866c0b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f8658ff9640 1 --2- 172.21.15.78:0/492926570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866c14bda0 0x7f866c0b82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f8658ff9640 1 -- 172.21.15.78:0/492926570 >> 172.21.15.78:0/492926570 conn(0x7f866c06bf70 msgr2=0x7f866c0b9950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f8658ff9640 1 -- 172.21.15.78:0/492926570 shutdown_connections 2023-06-02T15:30:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f8658ff9640 1 -- 172.21.15.78:0/492926570 wait complete. 2023-06-02T15:30:57.945 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-02T15:30:57.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 -- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6bf0065cd0 msgr2=0x7f6bf0068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6bf0065cd0 0x7f6bf0068180 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80011f0 tx=0x7f6bf8009040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 -- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c0414b240 msgr2=0x7f6c040b59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c0414b240 0x7f6c040b59a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6c040a3150 tx=0x7f6bfc01bac0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 -- 172.21.15.78:0/530383202 shutdown_connections 2023-06-02T15:30:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6bf0065cd0 0x7f6bf0068180 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6c0414b240 0x7f6c040b59a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c040bc890 0x7f6c040bf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 --2- 172.21.15.78:0/530383202 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6c040bb000 0x7f6c0406eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 -- 172.21.15.78:0/530383202 >> 172.21.15.78:0/530383202 conn(0x7f6c040a2170 msgr2=0x7f6c040a5c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 -- 172.21.15.78:0/530383202 shutdown_connections 2023-06-02T15:30:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.934+0000 7f6c0a70d640 1 -- 172.21.15.78:0/530383202 wait complete. 2023-06-02T15:30:57.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7feee7fff640 1 -- 172.21.15.78:0/108957149 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7feee81e4420 con 0x7feee80c2610 2023-06-02T15:30:57.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 -- 172.21.15.78:0/3287959301 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4450065cd0 msgr2=0x7f4450068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4450065cd0 0x7f4450068180 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f445c000fc0 tx=0x7f445c009040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 -- 172.21.15.78:0/3287959301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f446c0b9cd0 msgr2=0x7f446c1d2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f446c0b9cd0 0x7f446c1d2540 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f446c0a64e0 tx=0x7f446400ad70 comp rx=0 tx=0).stop 2023-06-02T15:30:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 -- 172.21.15.78:0/3287959301 shutdown_connections 2023-06-02T15:30:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4450065cd0 0x7f4450068180 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f446c0b9cd0 0x7f446c1d2540 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f446c1d3df0 0x7f446c0b9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 --2- 172.21.15.78:0/3287959301 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f446c0be460 0x7f446c1d4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 -- 172.21.15.78:0/3287959301 >> 172.21.15.78:0/3287959301 conn(0x7f446c0698f0 msgr2=0x7f446c146a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 -- 172.21.15.78:0/3287959301 shutdown_connections 2023-06-02T15:30:57.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7f44744dd640 1 -- 172.21.15.78:0/3287959301 wait complete. 2023-06-02T15:30:57.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.938+0000 7feecf7fe640 1 -- 172.21.15.78:0/108957149 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feee81e4420 con 0x7feee80c2610 2023-06-02T15:30:57.950 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-02T15:30:57.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 -- 172.21.15.78:0/108957149 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feed4065c00 msgr2=0x7feed40680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feed4065c00 0x7feed40680b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7feed8009c20 tx=0x7feed8009190 comp rx=0 tx=0).stop 2023-06-02T15:30:57.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 -- 172.21.15.78:0/108957149 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee80c2610 msgr2=0x7feee80bbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee80c2610 0x7feee80bbd20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7feedc0af000 tx=0x7feedc01ba30 comp rx=0 tx=0).stop 2023-06-02T15:30:57.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 -- 172.21.15.78:0/108957149 shutdown_connections 2023-06-02T15:30:57.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feee80c2610 0x7feee80bbd20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feed4065c00 0x7feed40680b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feee80bf170 0x7feee80bb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 --2- 172.21.15.78:0/108957149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feee806a6f0 0x7feee80a9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7f9b7ce4a640 1 -- 172.21.15.78:0/3771888495 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9b78073bc0 con 0x7f9b780a5800 2023-06-02T15:30:57.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 -- 172.21.15.78:0/108957149 >> 172.21.15.78:0/108957149 conn(0x7feee80a62a0 msgr2=0x7feee80a7d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 -- 172.21.15.78:0/108957149 shutdown_connections 2023-06-02T15:30:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7feecd7fa640 1 -- 172.21.15.78:0/108957149 wait complete. 2023-06-02T15:30:57.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.942+0000 7f9b66ffd640 1 -- 172.21.15.78:0/3771888495 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9b6c0546d0 con 0x7f9b780a5800 2023-06-02T15:30:57.954 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-02T15:30:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.946+0000 7f9b64ff9640 1 -- 172.21.15.78:0/3771888495 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b58065c00 msgr2=0x7f9b580680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.946+0000 7f9b64ff9640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b58065c00 0x7f9b580680b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9b680016c0 tx=0x7f9b68009040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.946+0000 7f9b64ff9640 1 -- 172.21.15.78:0/3771888495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 msgr2=0x7f9b7814de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.946+0000 7f9b64ff9640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 0x7f9b7814de30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9b6c00d990 tx=0x7f9b6c00de50 comp rx=0 tx=0).stop 2023-06-02T15:30:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.946+0000 7f9b64ff9640 1 -- 172.21.15.78:0/3771888495 shutdown_connections 2023-06-02T15:30:57.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.946+0000 7f9b64ff9640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b780a3cb0 0x7f9b7814e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.946+0000 7f9b64ff9640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b780a5800 0x7f9b7814de30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.946+0000 7f9b64ff9640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b58065c00 0x7f9b580680b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.946+0000 7f9b64ff9640 1 --2- 172.21.15.78:0/3771888495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b7806fe10 0x7f9b781e7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.950+0000 7f9b64ff9640 1 -- 172.21.15.78:0/3771888495 >> 172.21.15.78:0/3771888495 conn(0x7f9b780c13d0 msgr2=0x7f9b7806cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.950+0000 7f9b64ff9640 1 -- 172.21.15.78:0/3771888495 shutdown_connections 2023-06-02T15:30:57.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.950+0000 7f9b64ff9640 1 -- 172.21.15.78:0/3771888495 wait complete. 2023-06-02T15:30:57.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.0 2023-06-02T15:30:57.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.970+0000 7f82037fe640 1 -- 172.21.15.78:0/1120191059 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f81fc0057e0 con 0x7f82200a65e0 2023-06-02T15:30:57.979 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2023-06-02T15:30:57.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.970+0000 7f8215ffb640 1 -- 172.21.15.78:0/1120191059 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f821c0b0090 con 0x7f82200a65e0 2023-06-02T15:30:57.979 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-02T15:30:57.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 -- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8204065c00 msgr2=0x7f82040680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8204065c00 0x7f82040680b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8210007fd0 tx=0x7f8210009040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 -- 172.21.15.78:0/1120191059 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f82200a65e0 msgr2=0x7f82200bd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f82200a65e0 0x7f82200bd2d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f821c018fc0 tx=0x7f821c019150 comp rx=0 tx=0).stop 2023-06-02T15:30:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 -- 172.21.15.78:0/1120191059 shutdown_connections 2023-06-02T15:30:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f82200c0aa0 0x7f822006fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8204065c00 0x7f82040680b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f82200a9fa0 0x7f822006f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 --2- 172.21.15.78:0/1120191059 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f82200a65e0 0x7f82200bd2d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 -- 172.21.15.78:0/1120191059 >> 172.21.15.78:0/1120191059 conn(0x7f82200c4620 msgr2=0x7f822014c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 -- 172.21.15.78:0/1120191059 shutdown_connections 2023-06-02T15:30:57.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.974+0000 7f82037fe640 1 -- 172.21.15.78:0/1120191059 wait complete. 2023-06-02T15:30:57.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.3 2023-06-02T15:30:57.984 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.4 2023-06-02T15:30:57.985 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.2 2023-06-02T15:30:57.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.978+0000 7fbcf3fff640 1 -- 172.21.15.78:0/220327016 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbcf40be1a0 con 0x7fbcf415eb80 2023-06-02T15:30:57.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.978+0000 7fbcdbfff640 1 -- 172.21.15.78:0/220327016 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbcf40be1a0 con 0x7fbcf415eb80 2023-06-02T15:30:57.987 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-02T15:30:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.978+0000 7f819eb6f640 1 -- 172.21.15.78:0/102533675 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f81780057e0 con 0x7f8190046910 2023-06-02T15:30:57.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.978+0000 7f81957fa640 1 -- 172.21.15.78:0/102533675 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f818c0533a0 con 0x7f8190046910 2023-06-02T15:30:57.988 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-02T15:30:57.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 -- 172.21.15.78:0/220327016 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbce0065c00 msgr2=0x7fbce00680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbce0065c00 0x7fbce00680b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbcec001f60 tx=0x7fbcec001ad0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 -- 172.21.15.78:0/220327016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415eb80 msgr2=0x7fbcf41f3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415eb80 0x7fbcf41f3c10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbce400e870 tx=0x7fbce400ed30 comp rx=0 tx=0).stop 2023-06-02T15:30:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 -- 172.21.15.78:0/220327016 shutdown_connections 2023-06-02T15:30:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbce0065c00 0x7fbce00680b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf415ef50 0x7fbcf40b8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbcf415eb80 0x7fbcf41f3c10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 --2- 172.21.15.78:0/220327016 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbcf40c4270 0x7fbcf40bd820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 -- 172.21.15.78:0/220327016 >> 172.21.15.78:0/220327016 conn(0x7fbcf40c4710 msgr2=0x7fbcf40c4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 -- 172.21.15.78:0/220327016 shutdown_connections 2023-06-02T15:30:57.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7fbcf3fff640 1 -- 172.21.15.78:0/220327016 wait complete. 2023-06-02T15:30:57.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 -- 172.21.15.78:0/102533675 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f817c065c00 msgr2=0x7f817c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f817c065c00 0x7f817c0680b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f81840b2000 tx=0x7f8184009040 comp rx=0 tx=0).stop 2023-06-02T15:30:57.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 -- 172.21.15.78:0/102533675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8190046910 msgr2=0x7f8190027c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:57.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8190046910 0x7f8190027c40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f818c00c360 tx=0x7f818c00c820 comp rx=0 tx=0).stop 2023-06-02T15:30:57.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 -- 172.21.15.78:0/102533675 shutdown_connections 2023-06-02T15:30:57.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f817c065c00 0x7f817c0680b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f81900d6b70 0x7f81900c2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8190046910 0x7f8190027c40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 --2- 172.21.15.78:0/102533675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8190009a20 0x7f819002c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:57.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 -- 172.21.15.78:0/102533675 >> 172.21.15.78:0/102533675 conn(0x7f8190043870 msgr2=0x7f819003cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:57.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 -- 172.21.15.78:0/102533675 shutdown_connections 2023-06-02T15:30:57.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:57.982+0000 7f819eb6f640 1 -- 172.21.15.78:0/102533675 wait complete. 2023-06-02T15:30:58.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.6 2023-06-02T15:30:58.007 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2023-06-02T15:30:58.013 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.5 2023-06-02T15:30:58.975 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-02T15:30:58.979 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-02T15:30:58.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-02T15:30:58.986 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-02T15:30:58.986 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-02T15:30:59.008 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-02T15:30:59.008 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-02T15:30:59.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-02T15:30:59.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.146+0000 7f694a39c640 1 Processor -- start 2023-06-02T15:30:59.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.146+0000 7f694a39c640 1 -- start start 2023-06-02T15:30:59.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.146+0000 7f694a39c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69440bcc70 0x7f69440a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.146+0000 7f694a39c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69440bd040 0x7f6944070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.146+0000 7f694a39c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69440bc4c0 con 0x7f6944070ff0 2023-06-02T15:30:59.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.146+0000 7f694a39c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69440bb140 con 0x7f69440bcc70 2023-06-02T15:30:59.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.146+0000 7f694a39c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6944071470 con 0x7f69440bd040 2023-06-02T15:30:59.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.150+0000 7f69437fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69440bd040 0x7f6944070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.150+0000 7f69437fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69440bd040 0x7f6944070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49872/0 (socket says 172.21.15.78:49872) 2023-06-02T15:30:59.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.150+0000 7f69437fe640 1 -- 172.21.15.78:0/1052700542 learned_addr learned my addr 172.21.15.78:0/1052700542 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.150+0000 7f69437fe640 1 -- 172.21.15.78:0/1052700542 >> v2:172.21.15.78:3300/0 conn(0x7f69440bcc70 msgr2=0x7f69440a3ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-02T15:30:59.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.150+0000 7f6943fff640 1 --2- 172.21.15.78:0/1052700542 >> v2:172.21.15.78:3300/0 conn(0x7f69440bcc70 0x7f69440a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.150+0000 7f69437fe640 1 --2- 172.21.15.78:0/1052700542 >> v2:172.21.15.78:3300/0 conn(0x7f69440bcc70 0x7f69440a3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.150+0000 7f69437fe640 1 -- 172.21.15.78:0/1052700542 >> v1:172.21.15.78:6789/0 conn(0x7f6944070ff0 legacy=0x7f694414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.150+0000 7f69437fe640 1 -- 172.21.15.78:0/1052700542 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69440bbb80 con 0x7f69440bd040 2023-06-02T15:30:59.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f6943fff640 1 --2- 172.21.15.78:0/1052700542 >> v2:172.21.15.78:3300/0 conn(0x7f69440bcc70 0x7f69440a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:59.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f69437fe640 1 --2- 172.21.15.78:0/1052700542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69440bd040 0x7f6944070ab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f693c00d370 tx=0x7f693c01ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8acccd8eec68c47 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f6942ffd640 1 -- 172.21.15.78:0/1052700542 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c0a7d20 con 0x7f69440bd040 2023-06-02T15:30:59.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f6942ffd640 1 -- 172.21.15.78:0/1052700542 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c0ab070 con 0x7f69440bd040 2023-06-02T15:30:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f694a39c640 1 -- 172.21.15.78:0/1052700542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69440bd040 msgr2=0x7f6944070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f694a39c640 1 --2- 172.21.15.78:0/1052700542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69440bd040 0x7f6944070ab0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f693c00d370 tx=0x7f693c01ecf0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f694a39c640 1 -- 172.21.15.78:0/1052700542 shutdown_connections 2023-06-02T15:30:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f694a39c640 1 --2- 172.21.15.78:0/1052700542 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69440bd040 0x7f6944070ab0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f694a39c640 1 --2- 172.21.15.78:0/1052700542 >> v2:172.21.15.78:3300/0 conn(0x7f69440bcc70 0x7f69440a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f694a39c640 1 -- 172.21.15.78:0/1052700542 >> 172.21.15.78:0/1052700542 conn(0x7f69440698f0 msgr2=0x7f6944069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f694a39c640 1 -- 172.21.15.78:0/1052700542 shutdown_connections 2023-06-02T15:30:59.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.154+0000 7f694a39c640 1 -- 172.21.15.78:0/1052700542 wait complete. 2023-06-02T15:30:59.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f694a39c640 1 Processor -- start 2023-06-02T15:30:59.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f694a39c640 1 -- start start 2023-06-02T15:30:59.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f694a39c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6944070ff0 0x7f69441d0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f694a39c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69440bcc70 0x7f6944146960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f694a39c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6944146ea0 0x7f69440b9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f694a39c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69440b8d90 con 0x7f69440bcc70 2023-06-02T15:30:59.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f694a39c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69440b91f0 con 0x7f6944146ea0 2023-06-02T15:30:59.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f694a39c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69441d20a0 con 0x7f6944070ff0 2023-06-02T15:30:59.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f69437fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69440bcc70 0x7f6944146960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f69437fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69440bcc70 0x7f6944146960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57698/0 (socket says 172.21.15.78:57698) 2023-06-02T15:30:59.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f69437fe640 1 -- 172.21.15.78:0/2031476894 learned_addr learned my addr 172.21.15.78:0/2031476894 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f69437fe640 1 -- 172.21.15.78:0/2031476894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6944070ff0 msgr2=0x7f69441d0850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-02T15:30:59.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f69437fe640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6944070ff0 0x7f69441d0850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f69437fe640 1 -- 172.21.15.78:0/2031476894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6944146ea0 msgr2=0x7f69440b9b10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-02T15:30:59.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f69437fe640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6944146ea0 0x7f69440b9b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f69437fe640 1 -- 172.21.15.78:0/2031476894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f693c00d050 con 0x7f69440bcc70 2023-06-02T15:30:59.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f69437fe640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69440bcc70 0x7f6944146960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f693c0252c0 tx=0x7f693c01ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f6940ff9640 1 -- 172.21.15.78:0/2031476894 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c0b1d60 con 0x7f69440bcc70 2023-06-02T15:30:59.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f694a39c640 1 -- 172.21.15.78:0/2031476894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69440bc1c0 con 0x7f69440bcc70 2023-06-02T15:30:59.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.158+0000 7f694a39c640 1 -- 172.21.15.78:0/2031476894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69440bc710 con 0x7f69440bcc70 2023-06-02T15:30:59.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.162+0000 7f6940ff9640 1 -- 172.21.15.78:0/2031476894 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f693c0ab050 con 0x7f69440bcc70 2023-06-02T15:30:59.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.162+0000 7f6940ff9640 1 -- 172.21.15.78:0/2031476894 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f693c007ca0 con 0x7f69440bcc70 2023-06-02T15:30:59.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.162+0000 7f6940ff9640 1 -- 172.21.15.78:0/2031476894 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f693c0b1400 con 0x7f69440bcc70 2023-06-02T15:30:59.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.162+0000 7f6940ff9640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f692c065e70 0x7f692c068320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.162+0000 7f6943fff640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f692c065e70 0x7f692c068320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.166+0000 7f6943fff640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f692c065e70 0x7f692c068320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6938006b20 tx=0x7f6938008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.166+0000 7f6940ff9640 1 -- 172.21.15.78:0/2031476894 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f693c11df20 con 0x7f69440bcc70 2023-06-02T15:30:59.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.166+0000 7f694a39c640 1 -- 172.21.15.78:0/2031476894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6924005260 con 0x7f69440bcc70 2023-06-02T15:30:59.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.174+0000 7f6940ff9640 1 -- 172.21.15.78:0/2031476894 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f693c0eb470 con 0x7f69440bcc70 2023-06-02T15:30:59.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.186+0000 7fe06d596640 1 Processor -- start 2023-06-02T15:30:59.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.186+0000 7fe06d596640 1 -- start start 2023-06-02T15:30:59.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe06d596640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe068150030 0x7fe0680a2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe06d596640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0680a2dc0 0x7fe068156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe06d596640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe068156580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe06d596640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe06806bf70 con 0x7fe0680a2dc0 2023-06-02T15:30:59.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe06d596640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0680bbb40 con 0x7fe068150030 2023-06-02T15:30:59.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe06d596640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06806c1c0 con 0x7fe0680bbed0 2023-06-02T15:30:59.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe0667fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0680a2dc0 0x7fe068156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe0667fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe0680a2dc0 0x7fe068156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57712/0 (socket says 172.21.15.78:57712) 2023-06-02T15:30:59.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe0677fe640 1 --2- 172.21.15.78:0/4145731135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe068156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe0667fc640 1 -- 172.21.15.78:0/4145731135 learned_addr learned my addr 172.21.15.78:0/4145731135 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe0677fe640 1 -- 172.21.15.78:0/4145731135 >> v2:172.21.15.132:3300/0 conn(0x7fe068150030 msgr2=0x7fe0680a2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:59.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe066ffd640 1 --2- 172.21.15.78:0/4145731135 >> v2:172.21.15.132:3300/0 conn(0x7fe068150030 0x7fe0680a2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe0677fe640 1 --2- 172.21.15.78:0/4145731135 >> v2:172.21.15.132:3300/0 conn(0x7fe068150030 0x7fe0680a2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe0677fe640 1 -- 172.21.15.78:0/4145731135 >> v2:172.21.15.78:3300/0 conn(0x7fe0680a2dc0 msgr2=0x7fe068156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:59.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe0677fe640 1 --2- 172.21.15.78:0/4145731135 >> v2:172.21.15.78:3300/0 conn(0x7fe0680a2dc0 0x7fe068156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe0677fe640 1 -- 172.21.15.78:0/4145731135 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06806c4a0 con 0x7fe0680bbed0 2023-06-02T15:30:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe0667fc640 1 --2- 172.21.15.78:0/4145731135 >> v2:172.21.15.78:3300/0 conn(0x7fe0680a2dc0 0x7fe068156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:30:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.190+0000 7fe066ffd640 1 --2- 172.21.15.78:0/4145731135 >> v2:172.21.15.132:3300/0 conn(0x7fe068150030 0x7fe0680a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:30:59.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c878fb640 1 Processor -- start 2023-06-02T15:30:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c878fb640 1 -- start start 2023-06-02T15:30:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5cdd17640 1 Processor -- start 2023-06-02T15:30:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b94fcb640 1 Processor -- start 2023-06-02T15:30:59.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b94fcb640 1 -- start start 2023-06-02T15:30:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe0677fe640 1 --2- 172.21.15.78:0/4145731135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe068156580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe068066d80 tx=0x7fe06001c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c2af067dd707dac server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c878fb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 0x7f9c800ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c878fb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c800a5f30 con 0x7f9c801485c0 2023-06-02T15:30:59.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c878fb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c8014bcc0 con 0x7f9c800c0570 2023-06-02T15:30:59.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c878fb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800c1100 con 0x7f9c80071780 2023-06-02T15:30:59.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5cdd17640 1 -- start start 2023-06-02T15:30:59.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5cdd17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5c806b180 0x7fd5c8155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9ed8e640 1 Processor -- start 2023-06-02T15:30:59.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c85e98640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9c801485c0 0x7f9c8006bf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56002/0 (socket says 172.21.15.78:56002) 2023-06-02T15:30:59.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c85e98640 1 -- 172.21.15.78:0/2841739490 learned_addr learned my addr 172.21.15.78:0/2841739490 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:59.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5ccd15640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5c806b180 0x7fd5c8155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5ccd15640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5c806b180 0x7fd5c8155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57722/0 (socket says 172.21.15.78:57722) 2023-06-02T15:30:59.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5ccd15640 1 -- 172.21.15.78:0/2999376978 learned_addr learned my addr 172.21.15.78:0/2999376978 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe065ffb640 1 -- 172.21.15.78:0/4145731135 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600a57d0 con 0x7fe0680bbed0 2023-06-02T15:30:59.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c84e96640 1 --2- 172.21.15.78:0/2841739490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 0x7f9c800ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5cdd17640 1 --2- 172.21.15.78:0/2999376978 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5c80bef60 0x7fd5c80bf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe065ffb640 1 -- 172.21.15.78:0/4145731135 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0600a5930 con 0x7fe0680bbed0 2023-06-02T15:30:59.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b94fcb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b900bd790 0x7f2b90149870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b94fcb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b90149db0 0x7f2b9014cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b94fcb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b900bcbf0 con 0x7f2b900a56a0 2023-06-02T15:30:59.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b94fcb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b900bc440 con 0x7f2b90149db0 2023-06-02T15:30:59.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b94fcb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900bbf50 con 0x7f2b900bd790 2023-06-02T15:30:59.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c77fff640 1 -- 172.21.15.78:0/2841739490 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4037431195 0 0) 0x7f9c800a5f30 con 0x7f9c801485c0 2023-06-02T15:30:59.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5cdd17640 1 -- 172.21.15.78:0/2999376978 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c81563f0 con 0x7fd5c80c07a0 2023-06-02T15:30:59.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c77fff640 1 -- 172.21.15.78:0/2841739490 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c6c003530 con 0x7f9c801485c0 2023-06-02T15:30:59.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5cdd17640 1 -- 172.21.15.78:0/2999376978 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c80a2e00 con 0x7fd5c806b180 2023-06-02T15:30:59.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5cdd17640 1 -- 172.21.15.78:0/2999376978 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80c0340 con 0x7fd5c80bef60 2023-06-02T15:30:59.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5c7fff640 1 --2- 172.21.15.78:0/2999376978 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5c80bef60 0x7fd5c80bf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8effd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2b900a56a0 0x7f2b9014c600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56012/0 (socket says 172.21.15.78:56012) 2023-06-02T15:30:59.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8f7fe640 1 --2- 172.21.15.78:0/671087227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b900bd790 0x7f2b90149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8effd640 1 -- 172.21.15.78:0/671087227 learned_addr learned my addr 172.21.15.78:0/671087227 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:59.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8ffff640 1 --2- 172.21.15.78:0/671087227 >> v2:172.21.15.78:3300/0 conn(0x7f2b90149db0 0x7f2b9014cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9ed8e640 1 -- start start 2023-06-02T15:30:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe065ffb640 1 -- 172.21.15.78:0/4145731135 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0600a5cc0 con 0x7fe0680bbed0 2023-06-02T15:30:59.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952532616 0 0) 0x7f2b900bcbf0 con 0x7f2b900a56a0 2023-06-02T15:30:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b78003530 con 0x7f2b900a56a0 2023-06-02T15:30:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9ed8e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb980a1460 0x7ffb9814fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9ed8e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ffb981501e0 0x7ffb981569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9ed8e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb980badc0 con 0x7ffb980ba8f0 2023-06-02T15:30:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9ed8e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb980a3670 con 0x7ffb981501e0 2023-06-02T15:30:59.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9ed8e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb981528e0 con 0x7ffb980a1460 2023-06-02T15:30:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5ccd15640 1 -- 172.21.15.78:0/2999376978 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5c80bef60 msgr2=0x7fd5c80bf7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5ccd15640 1 --2- 172.21.15.78:0/2999376978 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5c80bef60 0x7fd5c80bf7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5ccd15640 1 -- 172.21.15.78:0/2999376978 >> v1:172.21.15.132:6789/0 conn(0x7fd5c80c07a0 legacy=0x7fd5c80a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe06d596640 1 -- 172.21.15.78:0/4145731135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 msgr2=0x7fe068156580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe06d596640 1 --2- 172.21.15.78:0/4145731135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe068156580 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe068066d80 tx=0x7fe06001c930 comp rx=0 tx=0).stop 2023-06-02T15:30:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe06d596640 1 -- 172.21.15.78:0/4145731135 shutdown_connections 2023-06-02T15:30:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe06d596640 1 --2- 172.21.15.78:0/4145731135 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe068156580 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe06d596640 1 --2- 172.21.15.78:0/4145731135 >> v2:172.21.15.78:3300/0 conn(0x7fe0680a2dc0 0x7fe068156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe06d596640 1 --2- 172.21.15.78:0/4145731135 >> v2:172.21.15.132:3300/0 conn(0x7fe068150030 0x7fe0680a2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe06d596640 1 -- 172.21.15.78:0/4145731135 >> 172.21.15.78:0/4145731135 conn(0x7fe06806a520 msgr2=0x7fe0680a2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe06d596640 1 -- 172.21.15.78:0/4145731135 shutdown_connections 2023-06-02T15:30:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fe06d596640 1 -- 172.21.15.78:0/4145731135 wait complete. 2023-06-02T15:30:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c84e96640 1 -- 172.21.15.78:0/2841739490 >> v1:172.21.15.132:6789/0 conn(0x7f9c800c0570 legacy=0x7f9c800bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c84e96640 1 -- 172.21.15.78:0/2841739490 >> v1:172.21.15.78:6789/0 conn(0x7f9c801485c0 legacy=0x7f9c8006bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f9c84e96640 1 -- 172.21.15.78:0/2841739490 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8014bfa0 con 0x7f9c80071780 2023-06-02T15:30:59.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9cb2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb980a1460 0x7ffb9814fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9cb2a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb980a1460 0x7ffb9814fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49920/0 (socket says 172.21.15.78:49920) 2023-06-02T15:30:59.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9cb2a640 1 -- 172.21.15.78:0/4252798352 learned_addr learned my addr 172.21.15.78:0/4252798352 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2662292544 0 0) 0x7f2b78003530 con 0x7f2b900a56a0 2023-06-02T15:30:59.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b900bd790 msgr2=0x7f2b90149870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 --2- 172.21.15.78:0/671087227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b900bd790 0x7f2b90149870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 >> v2:172.21.15.78:3300/0 conn(0x7f2b90149db0 msgr2=0x7f2b9014cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 --2- 172.21.15.78:0/671087227 >> v2:172.21.15.78:3300/0 conn(0x7f2b90149db0 0x7f2b9014cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9006d2c0 con 0x7f2b900a56a0 2023-06-02T15:30:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f2b84001680 con 0x7f2b900a56a0 2023-06-02T15:30:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 >> v1:172.21.15.78:6789/0 conn(0x7f2b900a56a0 legacy=0x7f2b9014c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 --2- 172.21.15.78:0/671087227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b780039f0 0x7f2b78003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 --2- 172.21.15.78:0/671087227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b780047d0 0x7f2b78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 --2- 172.21.15.78:0/671087227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b78005180 0x7f2b7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900bc440 con 0x7f2b780047d0 2023-06-02T15:30:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900bbf50 con 0x7f2b780039f0 2023-06-02T15:30:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7800bed0 con 0x7f2b78005180 2023-06-02T15:30:59.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8effd640 1 --2- 172.21.15.78:0/671087227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b780047d0 0x7f2b78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7ffb9d32b640 1 --2- 172.21.15.78:0/4252798352 >> v2:172.21.15.78:3300/0 conn(0x7ffb981501e0 0x7ffb981569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7ffb9d32b640 1 -- 172.21.15.78:0/4252798352 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb980a1460 msgr2=0x7ffb9814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7ffb9d32b640 1 --2- 172.21.15.78:0/4252798352 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb980a1460 0x7ffb9814fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7ffb9d32b640 1 -- 172.21.15.78:0/4252798352 >> v1:172.21.15.132:6789/0 conn(0x7ffb980ba8f0 legacy=0x7ffb981562a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-02T15:30:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7ffb9d32b640 1 -- 172.21.15.78:0/4252798352 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb9806c3d0 con 0x7ffb981501e0 2023-06-02T15:30:59.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe06d596640 1 Processor -- start 2023-06-02T15:30:59.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8effd640 1 -- 172.21.15.78:0/671087227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b78005180 msgr2=0x7f2b7800b990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-06-02T15:30:59.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8effd640 1 --2- 172.21.15.78:0/671087227 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b78005180 0x7f2b7800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8effd640 1 -- 172.21.15.78:0/671087227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b780039f0 msgr2=0x7f2b78003e00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-06-02T15:30:59.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8effd640 1 --2- 172.21.15.78:0/671087227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b780039f0 0x7f2b78003e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7f2b8effd640 1 -- 172.21.15.78:0/671087227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b9006d2c0 con 0x7f2b780047d0 2023-06-02T15:30:59.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.194+0000 7fd5ccd15640 1 -- 172.21.15.78:0/2999376978 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80a3e30 con 0x7fd5c806b180 2023-06-02T15:30:59.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2728a3c640 1 Processor -- start 2023-06-02T15:30:59.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe06d596640 1 -- start start 2023-06-02T15:30:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2728a3c640 1 -- start start 2023-06-02T15:30:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe06d596640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe0680beb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe06d596640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe068150030 0x7fe068153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe06d596640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0680a4f80 0x7fe06813a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe06d596640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0680be710 con 0x7fe068150030 2023-06-02T15:30:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe06d596640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe068154ec0 con 0x7fe0680a4f80 2023-06-02T15:30:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe06d596640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe068155650 con 0x7fe0680bbed0 2023-06-02T15:30:59.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f9c84e96640 1 --2- 172.21.15.78:0/2841739490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 0x7f9c800ba640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009df0 tx=0x7f9c7801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ef332e6e55b5a5c server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe066ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe0680beb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe066ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe0680beb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49932/0 (socket says 172.21.15.78:49932) 2023-06-02T15:30:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe066ffd640 1 -- 172.21.15.78:0/3568207203 learned_addr learned my addr 172.21.15.78:0/3568207203 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe0677fe640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0680a4f80 0x7fe06813a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f9c77fff640 1 -- 172.21.15.78:0/2841739490 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780a5830 con 0x7f9c80071780 2023-06-02T15:30:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fd5ccd15640 1 --2- 172.21.15.78:0/2999376978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5c806b180 0x7fd5c8155eb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009870 tx=0x7fd5bc01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d505ee761cc0bb1b server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe0667fc640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe068150030 0x7fe068153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fd5c77fe640 1 -- 172.21.15.78:0/2999376978 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0ab600 con 0x7fd5c806b180 2023-06-02T15:30:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fd5c77fe640 1 -- 172.21.15.78:0/2999376978 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5bc0a7050 con 0x7fd5c806b180 2023-06-02T15:30:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fd5c77fe640 1 -- 172.21.15.78:0/2999376978 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc0ab980 con 0x7fd5c806b180 2023-06-02T15:30:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe066ffd640 1 -- 172.21.15.78:0/3568207203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0680a4f80 msgr2=0x7fe06813a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe066ffd640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0680a4f80 0x7fe06813a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe066ffd640 1 -- 172.21.15.78:0/3568207203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe068150030 msgr2=0x7fe068153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe066ffd640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe068150030 0x7fe068153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe066ffd640 1 -- 172.21.15.78:0/3568207203 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0580094d0 con 0x7fe0680bbed0 2023-06-02T15:30:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2b8effd640 1 --2- 172.21.15.78:0/671087227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b780047d0 0x7f2b78004c40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b900a5ab0 tx=0x7f2b84023800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a3033f7fcc3f01 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f9c77fff640 1 -- 172.21.15.78:0/2841739490 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c780a5990 con 0x7f9c80071780 2023-06-02T15:30:59.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f9c77fff640 1 -- 172.21.15.78:0/2841739490 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c780a5d00 con 0x7f9c80071780 2023-06-02T15:30:59.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2728a3c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f272414b280 0x7f27240a3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2728a3c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240a3ab0 0x7f272414df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2728a3c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f272414b650 con 0x7f27240bbeb0 2023-06-02T15:30:59.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2728a3c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27240bb370 con 0x7f272414b280 2023-06-02T15:30:59.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2728a3c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27240c0e80 con 0x7f27240a3ab0 2023-06-02T15:30:59.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84005ae0 con 0x7f2b780047d0 2023-06-02T15:30:59.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b840af070 con 0x7f2b780047d0 2023-06-02T15:30:59.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2b8e7fc640 1 -- 172.21.15.78:0/671087227 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b84007070 con 0x7f2b780047d0 2023-06-02T15:30:59.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe066ffd640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe0680beb10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00c820 tx=0x7fe05c00cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f9c878fb640 1 -- 172.21.15.78:0/2841739490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 msgr2=0x7f9c800ba640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f9c878fb640 1 --2- 172.21.15.78:0/2841739490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 0x7f9c800ba640 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009df0 tx=0x7f9c7801c970 comp rx=0 tx=0).stop 2023-06-02T15:30:59.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f9c878fb640 1 -- 172.21.15.78:0/2841739490 shutdown_connections 2023-06-02T15:30:59.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f9c878fb640 1 --2- 172.21.15.78:0/2841739490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 0x7f9c800ba640 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f9c878fb640 1 -- 172.21.15.78:0/2841739490 >> 172.21.15.78:0/2841739490 conn(0x7f9c800a2170 msgr2=0x7f9c800a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f9c878fb640 1 -- 172.21.15.78:0/2841739490 shutdown_connections 2023-06-02T15:30:59.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2721d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240a3ab0 0x7f272414df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2722d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f27240bbeb0 0x7f272414e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56022/0 (socket says 172.21.15.78:56022) 2023-06-02T15:30:59.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2722d9d640 1 -- 172.21.15.78:0/2936929138 learned_addr learned my addr 172.21.15.78:0/2936929138 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:30:59.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7f2721d9b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240a3ab0 0x7f272414df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:49934/0 (socket says 172.21.15.78:49934) 2023-06-02T15:30:59.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f272159a640 1 -- 172.21.15.78:0/2936929138 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164197169 0 0) 0x7f272414b650 con 0x7f27240bbeb0 2023-06-02T15:30:59.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fd5cdd17640 1 -- 172.21.15.78:0/2999376978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5c806b180 msgr2=0x7fd5c8155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fd5cdd17640 1 --2- 172.21.15.78:0/2999376978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5c806b180 0x7fd5c8155eb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009870 tx=0x7fd5bc01c3d0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fd5cdd17640 1 -- 172.21.15.78:0/2999376978 shutdown_connections 2023-06-02T15:30:59.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fd5cdd17640 1 --2- 172.21.15.78:0/2999376978 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5c80bef60 0x7fd5c80bf7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fd5cdd17640 1 --2- 172.21.15.78:0/2999376978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5c806b180 0x7fd5c8155eb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fd5cdd17640 1 -- 172.21.15.78:0/2999376978 >> 172.21.15.78:0/2999376978 conn(0x7fd5c80c45e0 msgr2=0x7fd5c80c49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f272159a640 1 -- 172.21.15.78:0/2936929138 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f270c003530 con 0x7f27240bbeb0 2023-06-02T15:30:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2721d9b640 1 -- 172.21.15.78:0/2936929138 >> v2:172.21.15.78:3300/0 conn(0x7f272414b280 msgr2=0x7f27240a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2721d9b640 1 --2- 172.21.15.78:0/2936929138 >> v2:172.21.15.78:3300/0 conn(0x7f272414b280 0x7f27240a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c878fb640 1 -- 172.21.15.78:0/2841739490 wait complete. 2023-06-02T15:30:59.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5cdd17640 1 -- 172.21.15.78:0/2999376978 shutdown_connections 2023-06-02T15:30:59.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2721d9b640 1 -- 172.21.15.78:0/2936929138 >> v1:172.21.15.78:6789/0 conn(0x7f27240bbeb0 legacy=0x7f272414e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2721d9b640 1 -- 172.21.15.78:0/2936929138 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272414a680 con 0x7f27240a3ab0 2023-06-02T15:30:59.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb9d32b640 1 --2- 172.21.15.78:0/4252798352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb981501e0 0x7ffb981569b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb900097c0 tx=0x7ffb9001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d5eb39fd3817a server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe04f7fe640 1 -- 172.21.15.78:0/3568207203 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c007a30 con 0x7fe0680bbed0 2023-06-02T15:30:59.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe04f7fe640 1 -- 172.21.15.78:0/3568207203 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe05c007b90 con 0x7fe0680bbed0 2023-06-02T15:30:59.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe04f7fe640 1 -- 172.21.15.78:0/3568207203 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe05c00ce10 con 0x7fe0680bbed0 2023-06-02T15:30:59.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe06d596640 1 -- 172.21.15.78:0/3568207203 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe060009a70 con 0x7fe0680bbed0 2023-06-02T15:30:59.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.198+0000 7fe06d596640 1 -- 172.21.15.78:0/3568207203 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0680c0cf0 con 0x7fe0680bbed0 2023-06-02T15:30:59.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fe06d596640 1 -- 172.21.15.78:0/3568207203 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0680c0b60 con 0x7fe0680bbed0 2023-06-02T15:30:59.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5cdd17640 1 -- 172.21.15.78:0/2999376978 wait complete. 2023-06-02T15:30:59.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2b94fcb640 1 -- 172.21.15.78:0/671087227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b780047d0 msgr2=0x7f2b78004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2b94fcb640 1 --2- 172.21.15.78:0/671087227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b780047d0 0x7f2b78004c40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2b900a5ab0 tx=0x7f2b84023800 comp rx=0 tx=0).stop 2023-06-02T15:30:59.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2b8ffff640 1 -- 172.21.15.78:0/671087227 reap_dead start 2023-06-02T15:30:59.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2b94fcb640 1 -- 172.21.15.78:0/671087227 shutdown_connections 2023-06-02T15:30:59.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2b94fcb640 1 -- 172.21.15.78:0/671087227 >> 172.21.15.78:0/671087227 conn(0x7f2b900c1030 msgr2=0x7f2b900bce20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb977fe640 1 -- 172.21.15.78:0/4252798352 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb900ab600 con 0x7ffb981501e0 2023-06-02T15:30:59.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb977fe640 1 -- 172.21.15.78:0/4252798352 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb900a7050 con 0x7ffb981501e0 2023-06-02T15:30:59.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb977fe640 1 -- 172.21.15.78:0/4252798352 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb900ab980 con 0x7ffb981501e0 2023-06-02T15:30:59.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c878fb640 1 Processor -- start 2023-06-02T15:30:59.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c878fb640 1 -- start start 2023-06-02T15:30:59.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2b94fcb640 1 -- 172.21.15.78:0/671087227 shutdown_connections 2023-06-02T15:30:59.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5cdd17640 1 Processor -- start 2023-06-02T15:30:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fe04f7fe640 1 -- 172.21.15.78:0/3568207203 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fe05c01a450 con 0x7fe0680bbed0 2023-06-02T15:30:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fe04f7fe640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe054065c00 0x7fe0540680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fe04f7fe640 1 -- 172.21.15.78:0/3568207203 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe05c083930 con 0x7fe0680bbed0 2023-06-02T15:30:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fe0667fc640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe054065c00 0x7fe0540680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c878fb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 0x7f9c801f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c878fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800c0570 0x7f9c800bf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c878fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c801485c0 0x7f9c801465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c878fb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8014ee80 con 0x7f9c800c0570 2023-06-02T15:30:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c878fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c801f49d0 con 0x7f9c801485c0 2023-06-02T15:30:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c878fb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8015ec90 con 0x7f9c80071780 2023-06-02T15:30:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c84e96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800c0570 0x7f9c800bf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c84e96640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800c0570 0x7f9c800bf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57780/0 (socket says 172.21.15.78:57780) 2023-06-02T15:30:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c84e96640 1 -- 172.21.15.78:0/1340332291 learned_addr learned my addr 172.21.15.78:0/1340332291 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c85697640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 0x7f9c801f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c84e96640 1 -- 172.21.15.78:0/1340332291 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 msgr2=0x7f9c801f4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c84e96640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 0x7f9c801f4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c84e96640 1 -- 172.21.15.78:0/1340332291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c801485c0 msgr2=0x7f9c801465c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-06-02T15:30:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c84e96640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c801485c0 0x7f9c801465c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f9c84e96640 1 -- 172.21.15.78:0/1340332291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c78009a70 con 0x7f9c800c0570 2023-06-02T15:30:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5cdd17640 1 -- start start 2023-06-02T15:30:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5cdd17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c806b180 0x7fd5c80a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5cdd17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5c80bef60 0x7fd5c81eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5cdd17640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5c80c07a0 0x7fd5c81eb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5cdd17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80bc3d0 con 0x7fd5c80bef60 2023-06-02T15:30:59.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5cdd17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80a6190 con 0x7fd5c806b180 2023-06-02T15:30:59.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5cdd17640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80bbca0 con 0x7fd5c80c07a0 2023-06-02T15:30:59.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5ccd15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c806b180 0x7fd5c80a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5ccd15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c806b180 0x7fd5c80a5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49196/0 (socket says 172.21.15.78:49196) 2023-06-02T15:30:59.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7fd5ccd15640 1 -- 172.21.15.78:0/670923630 learned_addr learned my addr 172.21.15.78:0/670923630 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c7fff640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5c80bef60 0x7fd5c81eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/4252798352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb981501e0 msgr2=0x7ffb981569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb9ed8e640 1 --2- 172.21.15.78:0/4252798352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb981501e0 0x7ffb981569b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb900097c0 tx=0x7ffb9001c460 comp rx=0 tx=0).stop 2023-06-02T15:30:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/4252798352 shutdown_connections 2023-06-02T15:30:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb9ed8e640 1 --2- 172.21.15.78:0/4252798352 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb981501e0 0x7ffb981569b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb9ed8e640 1 --2- 172.21.15.78:0/4252798352 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb980a1460 0x7ffb9814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/4252798352 >> 172.21.15.78:0/4252798352 conn(0x7ffb980a2170 msgr2=0x7ffb980a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/4252798352 shutdown_connections 2023-06-02T15:30:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/4252798352 wait complete. 2023-06-02T15:30:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2721d9b640 1 --2- 172.21.15.78:0/2936929138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240a3ab0 0x7f272414df60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2714010bb0 tx=0x7f2714020a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=919c998039d3818d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.202+0000 7f2b94fcb640 1 -- 172.21.15.78:0/671087227 wait complete. 2023-06-02T15:30:59.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b94fcb640 1 Processor -- start 2023-06-02T15:30:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fe0667fc640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe054065c00 0x7fe0540680b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe06814f160 tx=0x7fe058009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f9c84e96640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800c0570 0x7f9c800bf930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c78000f90 tx=0x7f9c78019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c7fff640 1 -- 172.21.15.78:0/670923630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5c80c07a0 msgr2=0x7fd5c81eb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c7fff640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5c80c07a0 0x7fd5c81eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c7fff640 1 -- 172.21.15.78:0/670923630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c806b180 msgr2=0x7fd5c80a5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c7fff640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c806b180 0x7fd5c80a5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c7fff640 1 -- 172.21.15.78:0/670923630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5bc0094d0 con 0x7fd5c80bef60 2023-06-02T15:30:59.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c7fff640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5c80bef60 0x7fd5c81eae00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400e870 tx=0x7fd5b400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f9c75ffb640 1 -- 172.21.15.78:0/1340332291 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78003db0 con 0x7f9c800c0570 2023-06-02T15:30:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f9c75ffb640 1 -- 172.21.15.78:0/1340332291 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c780a57b0 con 0x7f9c800c0570 2023-06-02T15:30:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f9c75ffb640 1 -- 172.21.15.78:0/1340332291 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c78004240 con 0x7f9c800c0570 2023-06-02T15:30:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c57fa640 1 -- 172.21.15.78:0/670923630 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b40095d0 con 0x7fd5c80bef60 2023-06-02T15:30:59.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c57fa640 1 -- 172.21.15.78:0/670923630 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b400c940 con 0x7fd5c80bef60 2023-06-02T15:30:59.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c57fa640 1 -- 172.21.15.78:0/670923630 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400ccb0 con 0x7fd5c80bef60 2023-06-02T15:30:59.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5cdd17640 1 -- 172.21.15.78:0/670923630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c80a3b50 con 0x7fd5c80bef60 2023-06-02T15:30:59.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5cdd17640 1 -- 172.21.15.78:0/670923630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c80c0060 con 0x7fd5c80bef60 2023-06-02T15:30:59.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9ed8e640 1 Processor -- start 2023-06-02T15:30:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552ed4b640 1 Processor -- start 2023-06-02T15:30:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f9c878fb640 1 -- 172.21.15.78:0/1340332291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c80148dd0 con 0x7f9c800c0570 2023-06-02T15:30:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f9c878fb640 1 -- 172.21.15.78:0/1340332291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8006ce90 con 0x7f9c800c0570 2023-06-02T15:30:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f9c878fb640 1 -- 172.21.15.78:0/1340332291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c80154b20 con 0x7f9c800c0570 2023-06-02T15:30:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552ed4b640 1 -- start start 2023-06-02T15:30:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9ed8e640 1 -- start start 2023-06-02T15:30:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9ed8e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb980a1460 0x7ffb9814f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9ed8e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb980ba8f0 0x7ffb980a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9ed8e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb981501e0 0x7ffb9814e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9ed8e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb980a6190 con 0x7ffb980a1460 2023-06-02T15:30:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b94fcb640 1 -- start start 2023-06-02T15:30:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9ed8e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb980a5e90 con 0x7ffb981501e0 2023-06-02T15:30:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9ed8e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb980a4760 con 0x7ffb980ba8f0 2023-06-02T15:30:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b94fcb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b90144780 0x7f2b9014d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b94fcb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b901edc60 0x7f2b901ee070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b94fcb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b901f0d90 0x7f2b901f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b94fcb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900bdf90 con 0x7f2b901f0d90 2023-06-02T15:30:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b94fcb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b900be270 con 0x7f2b90144780 2023-06-02T15:30:59.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b94fcb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b901f4e30 con 0x7f2b901edc60 2023-06-02T15:30:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5cdd17640 1 -- 172.21.15.78:0/670923630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a8005260 con 0x7fd5c80bef60 2023-06-02T15:30:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9cb2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb980a1460 0x7ffb9814f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9cb2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb980a1460 0x7ffb9814f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57804/0 (socket says 172.21.15.78:57804) 2023-06-02T15:30:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9cb2a640 1 -- 172.21.15.78:0/1292290876 learned_addr learned my addr 172.21.15.78:0/1292290876 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9d32b640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb981501e0 0x7ffb9814e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b8f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b90144780 0x7f2b9014d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b8f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b90144780 0x7f2b9014d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49200/0 (socket says 172.21.15.78:49200) 2023-06-02T15:30:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b8f7fe640 1 -- 172.21.15.78:0/3865109557 learned_addr learned my addr 172.21.15.78:0/3865109557 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9cb2a640 1 -- 172.21.15.78:0/1292290876 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb980ba8f0 msgr2=0x7ffb980a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9cb2a640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb980ba8f0 0x7ffb980a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9cb2a640 1 -- 172.21.15.78:0/1292290876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb981501e0 msgr2=0x7ffb9814e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9cb2a640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb981501e0 0x7ffb9814e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9cb2a640 1 -- 172.21.15.78:0/1292290876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb90009420 con 0x7ffb980a1460 2023-06-02T15:30:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b8effd640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b901edc60 0x7f2b901ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9d32b640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb981501e0 0x7ffb9814e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:30:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552ed4b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f55280a3fc0 0x7f55280a6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552ed4b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5528069f50 0x7f55280c27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552ed4b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f552814f010 con 0x7f55280a6980 2023-06-02T15:30:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c57fa640 1 -- 172.21.15.78:0/670923630 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fd5b4013470 con 0x7fd5c80bef60 2023-06-02T15:30:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552ed4b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f552814f540 con 0x7f55280a3fc0 2023-06-02T15:30:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552ed4b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552814f260 con 0x7f5528069f50 2023-06-02T15:30:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552cae7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f55280a3fc0 0x7f55280a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552cae7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f55280a3fc0 0x7f55280a6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49204/0 (socket says 172.21.15.78:49204) 2023-06-02T15:30:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552cae7640 1 -- 172.21.15.78:0/2377702844 learned_addr learned my addr 172.21.15.78:0/2377702844 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7ffb9cb2a640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb980a1460 0x7ffb9814f280 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb88007dd0 tx=0x7ffb8800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f5527fff640 1 --2- 172.21.15.78:0/2377702844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5528069f50 0x7f55280c27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b8f7fe640 1 -- 172.21.15.78:0/3865109557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b901edc60 msgr2=0x7f2b901ee070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b8f7fe640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b901edc60 0x7f2b901ee070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b8f7fe640 1 -- 172.21.15.78:0/3865109557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b901f0d90 msgr2=0x7f2b901f1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b8f7fe640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b901f0d90 0x7f2b901f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f2b8f7fe640 1 -- 172.21.15.78:0/3865109557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b900bc160 con 0x7f2b90144780 2023-06-02T15:30:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552cae7640 1 -- 172.21.15.78:0/2377702844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5528069f50 msgr2=0x7f55280c27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552cae7640 1 --2- 172.21.15.78:0/2377702844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5528069f50 0x7f55280c27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552cae7640 1 -- 172.21.15.78:0/2377702844 >> v1:172.21.15.78:6789/0 conn(0x7f55280a6980 legacy=0x7f5528151b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:30:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7f552cae7640 1 -- 172.21.15.78:0/2377702844 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f552806ba70 con 0x7f55280a3fc0 2023-06-02T15:30:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c57fa640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd5ac065cd0 0x7fd5ac068180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.206+0000 7fd5c57fa640 1 -- 172.21.15.78:0/670923630 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd5b40836a0 con 0x7fd5c80bef60 2023-06-02T15:30:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f2b8f7fe640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b90144780 0x7f2b9014d700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000e860 tx=0x7f2b8000e950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7fd5ccd15640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd5ac065cd0 0x7fd5ac068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f2b77fff640 1 -- 172.21.15.78:0/3865109557 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80009650 con 0x7f2b90144780 2023-06-02T15:30:59.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f2b77fff640 1 -- 172.21.15.78:0/3865109557 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b80013680 con 0x7f2b90144780 2023-06-02T15:30:59.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f2b77fff640 1 -- 172.21.15.78:0/3865109557 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b80013a10 con 0x7f2b90144780 2023-06-02T15:30:59.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7fd5ccd15640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd5ac065cd0 0x7fd5ac068180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc000c10 tx=0x7fd5bc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f9c75ffb640 1 -- 172.21.15.78:0/1340332291 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f9c780b4070 con 0x7f9c800c0570 2023-06-02T15:30:59.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f9c75ffb640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9c64065c30 0x7f9c640680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f2b94fcb640 1 -- 172.21.15.78:0/3865109557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b900bc640 con 0x7f2b90144780 2023-06-02T15:30:59.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f2b94fcb640 1 -- 172.21.15.78:0/3865109557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9014d250 con 0x7f2b90144780 2023-06-02T15:30:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f9c75ffb640 1 -- 172.21.15.78:0/1340332291 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9c7811d900 con 0x7f9c800c0570 2023-06-02T15:30:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f9c85697640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9c64065c30 0x7f9c640680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f2b94fcb640 1 -- 172.21.15.78:0/3865109557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b90073bc0 con 0x7f2b90144780 2023-06-02T15:30:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f552cae7640 1 --2- 172.21.15.78:0/2377702844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55280a3fc0 0x7f55280a6440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f551c013150 tx=0x7f551c024c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27a153f7029a5659 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f9c85697640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9c64065c30 0x7f9c640680e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c70001810 tx=0x7f9c70009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f55277fe640 1 -- 172.21.15.78:0/2377702844 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0adaa0 con 0x7f55280a3fc0 2023-06-02T15:30:59.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f55277fe640 1 -- 172.21.15.78:0/2377702844 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f551c0adc00 con 0x7f55280a3fc0 2023-06-02T15:30:59.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f55277fe640 1 -- 172.21.15.78:0/2377702844 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551c0110d0 con 0x7f55280a3fc0 2023-06-02T15:30:59.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f2b77fff640 1 -- 172.21.15.78:0/3865109557 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f2b80013b70 con 0x7f2b90144780 2023-06-02T15:30:59.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f552ed4b640 1 -- 172.21.15.78:0/2377702844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55280a3fc0 msgr2=0x7f55280a6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f552ed4b640 1 --2- 172.21.15.78:0/2377702844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55280a3fc0 0x7f55280a6440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f551c013150 tx=0x7f551c024c10 comp rx=0 tx=0).stop 2023-06-02T15:30:59.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7ffb957fa640 1 -- 172.21.15.78:0/1292290876 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88009e40 con 0x7ffb980a1460 2023-06-02T15:30:59.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f552ed4b640 1 -- 172.21.15.78:0/2377702844 shutdown_connections 2023-06-02T15:30:59.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f552ed4b640 1 --2- 172.21.15.78:0/2377702844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5528069f50 0x7f55280c27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f552ed4b640 1 --2- 172.21.15.78:0/2377702844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55280a3fc0 0x7f55280a6440 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f552ed4b640 1 -- 172.21.15.78:0/2377702844 >> 172.21.15.78:0/2377702844 conn(0x7f55280c48e0 msgr2=0x7f55280c4ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f9c75ffb640 1 -- 172.21.15.78:0/1340332291 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f9c780eaf70 con 0x7f9c800c0570 2023-06-02T15:30:59.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f552ed4b640 1 -- 172.21.15.78:0/2377702844 shutdown_connections 2023-06-02T15:30:59.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7f552ed4b640 1 -- 172.21.15.78:0/2377702844 wait complete. 2023-06-02T15:30:59.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/1292290876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb9806d270 con 0x7ffb980a1460 2023-06-02T15:30:59.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.210+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/1292290876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb9806d0e0 con 0x7ffb980a1460 2023-06-02T15:30:59.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f552ed4b640 1 Processor -- start 2023-06-02T15:30:59.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/1292290876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb98073bc0 con 0x7ffb980a1460 2023-06-02T15:30:59.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f552ed4b640 1 -- start start 2023-06-02T15:30:59.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f2b77fff640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2b7c065c80 0x7f2b7c068130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f2b8effd640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2b7c065c80 0x7f2b7c068130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f2b77fff640 1 -- 172.21.15.78:0/3865109557 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2b80083820 con 0x7f2b90144780 2023-06-02T15:30:59.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f552ed4b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5528069f50 0x7f55281e38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f552ed4b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55280a3fc0 0x7f55280be5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f552ed4b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55280a6980 0x7f552814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f552ed4b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552814bb60 con 0x7f55280a3fc0 2023-06-02T15:30:59.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f552ed4b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55281e3e00 con 0x7f55280a6980 2023-06-02T15:30:59.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f552ed4b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f552814b4c0 con 0x7f5528069f50 2023-06-02T15:30:59.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f5527fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55280a3fc0 0x7f55280be5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f5527fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55280a3fc0 0x7f55280be5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57824/0 (socket says 172.21.15.78:57824) 2023-06-02T15:30:59.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f5527fff640 1 -- 172.21.15.78:0/1115410484 learned_addr learned my addr 172.21.15.78:0/1115410484 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f2b8effd640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2b7c065c80 0x7f2b7c068130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b840b3000 tx=0x7f2b84006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f552d2e8640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55280a6980 0x7f552814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f552cae7640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5528069f50 0x7f55281e38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f5527fff640 1 -- 172.21.15.78:0/1115410484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5528069f50 msgr2=0x7f55281e38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f5527fff640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5528069f50 0x7f55281e38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f5527fff640 1 -- 172.21.15.78:0/1115410484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55280a6980 msgr2=0x7f552814a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f5527fff640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55280a6980 0x7f552814a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f5527fff640 1 -- 172.21.15.78:0/1115410484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c011d70 con 0x7f55280a3fc0 2023-06-02T15:30:59.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.214+0000 7f5527fff640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55280a3fc0 0x7f55280be5c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f552000ef90 tx=0x7f552000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272159a640 1 -- 172.21.15.78:0/2936929138 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140a9a30 con 0x7f27240a3ab0 2023-06-02T15:30:59.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7fe04f7fe640 1 -- 172.21.15.78:0/3568207203 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fe05c050ec0 con 0x7fe0680bbed0 2023-06-02T15:30:59.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7fd5c57fa640 1 -- 172.21.15.78:0/670923630 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fd5b4054730 con 0x7fd5c80bef60 2023-06-02T15:30:59.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7ffb957fa640 1 -- 172.21.15.78:0/1292290876 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8800f040 con 0x7ffb980a1460 2023-06-02T15:30:59.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7ffb957fa640 1 -- 172.21.15.78:0/1292290876 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb88009760 con 0x7ffb980a1460 2023-06-02T15:30:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272159a640 1 -- 172.21.15.78:0/2936929138 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27140a9b90 con 0x7f27240a3ab0 2023-06-02T15:30:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272159a640 1 -- 172.21.15.78:0/2936929138 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27140b1440 con 0x7f27240a3ab0 2023-06-02T15:30:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 -- 172.21.15.78:0/2936929138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240a3ab0 msgr2=0x7f272414df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 --2- 172.21.15.78:0/2936929138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240a3ab0 0x7f272414df60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2714010bb0 tx=0x7f2714020a50 comp rx=0 tx=0).stop 2023-06-02T15:30:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 -- 172.21.15.78:0/2936929138 shutdown_connections 2023-06-02T15:30:59.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 --2- 172.21.15.78:0/2936929138 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240a3ab0 0x7f272414df60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 --2- 172.21.15.78:0/2936929138 >> v2:172.21.15.78:3300/0 conn(0x7f272414b280 0x7f27240a3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 -- 172.21.15.78:0/2936929138 >> 172.21.15.78:0/2936929138 conn(0x7f272406a520 msgr2=0x7f27240a2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 -- 172.21.15.78:0/2936929138 shutdown_connections 2023-06-02T15:30:59.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 -- 172.21.15.78:0/2936929138 wait complete. 2023-06-02T15:30:59.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 Processor -- start 2023-06-02T15:30:59.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 -- start start 2023-06-02T15:30:59.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27240bbeb0 0x7f27240b55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272414b280 0x7f27241e8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240b5b20 0x7f27241eb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27240b7ee0 con 0x7f27240bbeb0 2023-06-02T15:30:59.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27241ef170 con 0x7f272414b280 2023-06-02T15:30:59.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f2728a3c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27241ef450 con 0x7f27240b5b20 2023-06-02T15:30:59.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27240bbeb0 0x7f27240b55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27240bbeb0 0x7f27240b55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57836/0 (socket says 172.21.15.78:57836) 2023-06-02T15:30:59.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272259c640 1 -- 172.21.15.78:0/104881548 learned_addr learned my addr 172.21.15.78:0/104881548 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:30:59.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272259c640 1 -- 172.21.15.78:0/104881548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240b5b20 msgr2=0x7f27241eb300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-02T15:30:59.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272259c640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240b5b20 0x7f27241eb300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272259c640 1 -- 172.21.15.78:0/104881548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272414b280 msgr2=0x7f27241e8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272259c640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272414b280 0x7f27241e8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f272259c640 1 -- 172.21.15.78:0/104881548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714010810 con 0x7f27240bbeb0 2023-06-02T15:30:59.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.222+0000 7f272259c640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27240bbeb0 0x7f27240b55e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f271800b410 tx=0x7f271800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f55257fa640 1 -- 172.21.15.78:0/1115410484 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520009c80 con 0x7f55280a3fc0 2023-06-02T15:30:59.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f552ed4b640 1 -- 172.21.15.78:0/1115410484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f552806ec20 con 0x7f55280a3fc0 2023-06-02T15:30:59.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f552ed4b640 1 -- 172.21.15.78:0/1115410484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55280c3130 con 0x7f55280a3fc0 2023-06-02T15:30:59.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f552ed4b640 1 -- 172.21.15.78:0/1115410484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f552806edb0 con 0x7f55280a3fc0 2023-06-02T15:30:59.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f55257fa640 1 -- 172.21.15.78:0/1115410484 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552000f040 con 0x7f55280a3fc0 2023-06-02T15:30:59.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f55257fa640 1 -- 172.21.15.78:0/1115410484 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5520003ba0 con 0x7f55280a3fc0 2023-06-02T15:30:59.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.218+0000 7f55257fa640 1 -- 172.21.15.78:0/1115410484 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f5520003d00 con 0x7f55280a3fc0 2023-06-02T15:30:59.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.222+0000 7f55257fa640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5514065c00 0x7f55140680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.222+0000 7f552cae7640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5514065c00 0x7f55140680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.222+0000 7f552cae7640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5514065c00 0x7f55140680b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f551c0b6000 tx=0x7f551c0af070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.222+0000 7ffb957fa640 1 -- 172.21.15.78:0/1292290876 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7ffb88015400 con 0x7ffb980a1460 2023-06-02T15:30:59.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.222+0000 7ffb957fa640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ffb84065c30 0x7ffb840680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.222+0000 7ffb957fa640 1 -- 172.21.15.78:0/1292290876 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ffb88083e10 con 0x7ffb980a1460 2023-06-02T15:30:59.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.222+0000 7ffb97fff640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ffb84065c30 0x7ffb840680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.222+0000 7ffb97fff640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ffb84065c30 0x7ffb840680e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffb9814a750 tx=0x7ffb8c006c50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.226+0000 7f2b77fff640 1 -- 172.21.15.78:0/3865109557 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f2b80050e20 con 0x7f2b90144780 2023-06-02T15:30:59.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.226+0000 7f55257fa640 1 -- 172.21.15.78:0/1115410484 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5520055e30 con 0x7f55280a3fc0 2023-06-02T15:30:59.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.226+0000 7ffb957fa640 1 -- 172.21.15.78:0/1292290876 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7ffb88051310 con 0x7ffb980a1460 2023-06-02T15:30:59.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.226+0000 7f2712ffd640 1 -- 172.21.15.78:0/104881548 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718011830 con 0x7f27240bbeb0 2023-06-02T15:30:59.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.226+0000 7f2728a3c640 1 -- 172.21.15.78:0/104881548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27240bb970 con 0x7f27240bbeb0 2023-06-02T15:30:59.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.226+0000 7f2728a3c640 1 -- 172.21.15.78:0/104881548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27240bcb60 con 0x7f27240bbeb0 2023-06-02T15:30:59.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.226+0000 7f2728a3c640 1 -- 172.21.15.78:0/104881548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27241ef690 con 0x7f27240bbeb0 2023-06-02T15:30:59.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.234+0000 7f55257fa640 1 -- 172.21.15.78:0/1115410484 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f5520052170 con 0x7f55280a3fc0 2023-06-02T15:30:59.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.234+0000 7f2712ffd640 1 -- 172.21.15.78:0/104881548 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2718011990 con 0x7f27240bbeb0 2023-06-02T15:30:59.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.234+0000 7f2712ffd640 1 -- 172.21.15.78:0/104881548 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2718011d80 con 0x7f27240bbeb0 2023-06-02T15:30:59.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.246+0000 7f2712ffd640 1 -- 172.21.15.78:0/104881548 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f271801a400 con 0x7f27240bbeb0 2023-06-02T15:30:59.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.246+0000 7f2712ffd640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2704065c30 0x7f27040680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:30:59.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.246+0000 7f2712ffd640 1 -- 172.21.15.78:0/104881548 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f2718083c00 con 0x7f27240bbeb0 2023-06-02T15:30:59.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.246+0000 7f2712ffd640 1 -- 172.21.15.78:0/104881548 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f27180ad760 con 0x7f27240bbeb0 2023-06-02T15:30:59.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.254+0000 7f2721d9b640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2704065c30 0x7f27040680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:30:59.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.254+0000 7f2721d9b640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2704065c30 0x7f27040680e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f27140b3000 tx=0x7f2714004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:30:59.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f694a39c640 1 -- 172.21.15.78:0/2031476894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6924005510 con 0x7f69440bcc70 2023-06-02T15:30:59.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f6940ff9640 1 -- 172.21.15.78:0/2031476894 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f693c0ad020 con 0x7f69440bcc70 2023-06-02T15:30:59.499 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-02T15:30:59.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f692a7fc640 1 -- 172.21.15.78:0/2031476894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f692c065e70 msgr2=0x7f692c068320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f692a7fc640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f692c065e70 0x7f692c068320 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6938006b20 tx=0x7f6938008040 comp rx=0 tx=0).stop 2023-06-02T15:30:59.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f692a7fc640 1 -- 172.21.15.78:0/2031476894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69440bcc70 msgr2=0x7f6944146960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f692a7fc640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69440bcc70 0x7f6944146960 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f693c0252c0 tx=0x7f693c01ba90 comp rx=0 tx=0).stop 2023-06-02T15:30:59.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f692a7fc640 1 -- 172.21.15.78:0/2031476894 shutdown_connections 2023-06-02T15:30:59.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f692a7fc640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6944146ea0 0x7f69440b9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f692a7fc640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f692c065e70 0x7f692c068320 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f692a7fc640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69440bcc70 0x7f6944146960 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f692a7fc640 1 --2- 172.21.15.78:0/2031476894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6944070ff0 0x7f69441d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.490+0000 7f692a7fc640 1 -- 172.21.15.78:0/2031476894 >> 172.21.15.78:0/2031476894 conn(0x7f69440698f0 msgr2=0x7f6944070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.494+0000 7f692a7fc640 1 -- 172.21.15.78:0/2031476894 shutdown_connections 2023-06-02T15:30:59.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.494+0000 7f692a7fc640 1 -- 172.21.15.78:0/2031476894 wait complete. 2023-06-02T15:30:59.522 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.0 2023-06-02T15:30:59.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.514+0000 7fd5cdd17640 1 -- 172.21.15.78:0/670923630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd5a8005510 con 0x7fd5c80bef60 2023-06-02T15:30:59.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5c57fa640 1 -- 172.21.15.78:0/670923630 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd5b40542c0 con 0x7fd5c80bef60 2023-06-02T15:30:59.525 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-02T15:30:59.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fe06d596640 1 -- 172.21.15.78:0/3568207203 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe0680c0e80 con 0x7fe0680bbed0 2023-06-02T15:30:59.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 -- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd5ac065cd0 msgr2=0x7fd5ac068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd5ac065cd0 0x7fd5ac068180 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc000c10 tx=0x7fd5bc0a6000 comp rx=0 tx=0).stop 2023-06-02T15:30:59.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 -- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5c80bef60 msgr2=0x7fd5c81eae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5c80bef60 0x7fd5c81eae00 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400e870 tx=0x7fd5b400ed30 comp rx=0 tx=0).stop 2023-06-02T15:30:59.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 -- 172.21.15.78:0/670923630 shutdown_connections 2023-06-02T15:30:59.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd5c80c07a0 0x7fd5c81eb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd5ac065cd0 0x7fd5ac068180 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5c80bef60 0x7fd5c81eae00 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 --2- 172.21.15.78:0/670923630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5c806b180 0x7fd5c80a5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 -- 172.21.15.78:0/670923630 >> 172.21.15.78:0/670923630 conn(0x7fd5c80c45e0 msgr2=0x7fd5c80a1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 -- 172.21.15.78:0/670923630 shutdown_connections 2023-06-02T15:30:59.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fd5cdd17640 1 -- 172.21.15.78:0/670923630 wait complete. 2023-06-02T15:30:59.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.518+0000 7fe04f7fe640 1 -- 172.21.15.78:0/3568207203 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe05c0544e0 con 0x7fe0680bbed0 2023-06-02T15:30:59.530 INFO:teuthology.orchestra.run.smithi078.stdout:55834574853 2023-06-02T15:30:59.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7f9c878fb640 1 -- 172.21.15.78:0/1340332291 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9c8014e580 con 0x7f9c800c0570 2023-06-02T15:30:59.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7f9c75ffb640 1 -- 172.21.15.78:0/1340332291 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9c8014e580 con 0x7f9c800c0570 2023-06-02T15:30:59.531 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-02T15:30:59.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 -- 172.21.15.78:0/3568207203 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe054065c00 msgr2=0x7fe0540680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe054065c00 0x7fe0540680b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe06814f160 tx=0x7fe058009240 comp rx=0 tx=0).stop 2023-06-02T15:30:59.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 -- 172.21.15.78:0/3568207203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 msgr2=0x7fe0680beb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe0680beb10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe05c00c820 tx=0x7fe05c00cce0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 -- 172.21.15.78:0/3568207203 shutdown_connections 2023-06-02T15:30:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0680a4f80 0x7fe06813a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe054065c00 0x7fe0540680b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe068150030 0x7fe068153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 --2- 172.21.15.78:0/3568207203 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0680bbed0 0x7fe0680beb10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 -- 172.21.15.78:0/3568207203 >> 172.21.15.78:0/3568207203 conn(0x7fe0680a2dc0 msgr2=0x7fe068072f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 -- 172.21.15.78:0/3568207203 shutdown_connections 2023-06-02T15:30:59.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.522+0000 7fe06d596640 1 -- 172.21.15.78:0/3568207203 wait complete. 2023-06-02T15:30:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 -- 172.21.15.78:0/1340332291 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9c64065c30 msgr2=0x7f9c640680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9c64065c30 0x7f9c640680e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9c70001810 tx=0x7f9c70009040 comp rx=0 tx=0).stop 2023-06-02T15:30:59.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 -- 172.21.15.78:0/1340332291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800c0570 msgr2=0x7f9c800bf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800c0570 0x7f9c800bf930 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9c78000f90 tx=0x7f9c78019710 comp rx=0 tx=0).stop 2023-06-02T15:30:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 -- 172.21.15.78:0/1340332291 shutdown_connections 2023-06-02T15:30:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c801485c0 0x7f9c801465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9c64065c30 0x7f9c640680e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9c800c0570 0x7f9c800bf930 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 --2- 172.21.15.78:0/1340332291 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9c80071780 0x7f9c801f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 -- 172.21.15.78:0/1340332291 >> 172.21.15.78:0/1340332291 conn(0x7f9c800a2170 msgr2=0x7f9c8014a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 -- 172.21.15.78:0/1340332291 shutdown_connections 2023-06-02T15:30:59.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.526+0000 7f9c878fb640 1 -- 172.21.15.78:0/1340332291 wait complete. 2023-06-02T15:30:59.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.534+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/1292290876 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ffb9806c810 con 0x7ffb980a1460 2023-06-02T15:30:59.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.534+0000 7ffb957fa640 1 -- 172.21.15.78:0/1292290876 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffb88024020 con 0x7ffb980a1460 2023-06-02T15:30:59.544 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-02T15:30:59.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/1292290876 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ffb84065c30 msgr2=0x7ffb840680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ffb84065c30 0x7ffb840680e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ffb9814a750 tx=0x7ffb8c006c50 comp rx=0 tx=0).stop 2023-06-02T15:30:59.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7f2b94fcb640 1 -- 172.21.15.78:0/3865109557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2b900716d0 con 0x7f2b90144780 2023-06-02T15:30:59.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/1292290876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb980a1460 msgr2=0x7ffb9814f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb980a1460 0x7ffb9814f280 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb88007dd0 tx=0x7ffb8800d4a0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/1292290876 shutdown_connections 2023-06-02T15:30:59.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb981501e0 0x7ffb9814e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ffb980ba8f0 0x7ffb980a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ffb84065c30 0x7ffb840680e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 --2- 172.21.15.78:0/1292290876 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ffb980a1460 0x7ffb9814f280 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7f2b77fff640 1 -- 172.21.15.78:0/3865109557 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b80054440 con 0x7f2b90144780 2023-06-02T15:30:59.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/1292290876 >> 172.21.15.78:0/1292290876 conn(0x7ffb980a2170 msgr2=0x7ffb9814b110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.550 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-02T15:30:59.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/1292290876 shutdown_connections 2023-06-02T15:30:59.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.538+0000 7ffb9ed8e640 1 -- 172.21.15.78:0/1292290876 wait complete. 2023-06-02T15:30:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 -- 172.21.15.78:0/3865109557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2b7c065c80 msgr2=0x7f2b7c068130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2b7c065c80 0x7f2b7c068130 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f2b840b3000 tx=0x7f2b84006040 comp rx=0 tx=0).stop 2023-06-02T15:30:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 -- 172.21.15.78:0/3865109557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b90144780 msgr2=0x7f2b9014d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b90144780 0x7f2b9014d700 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000e860 tx=0x7f2b8000e950 comp rx=0 tx=0).stop 2023-06-02T15:30:59.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 -- 172.21.15.78:0/3865109557 shutdown_connections 2023-06-02T15:30:59.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2b7c065c80 0x7f2b7c068130 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b901f0d90 0x7f2b901f1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f2b901edc60 0x7f2b901ee070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 --2- 172.21.15.78:0/3865109557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b90144780 0x7f2b9014d700 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 -- 172.21.15.78:0/3865109557 >> 172.21.15.78:0/3865109557 conn(0x7f2b900c1030 msgr2=0x7f2b9014c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 -- 172.21.15.78:0/3865109557 shutdown_connections 2023-06-02T15:30:59.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f2b94fcb640 1 -- 172.21.15.78:0/3865109557 wait complete. 2023-06-02T15:30:59.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.542+0000 7f552ed4b640 1 -- 172.21.15.78:0/1115410484 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f552814b2f0 con 0x7f55280a3fc0 2023-06-02T15:30:59.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f55257fa640 1 -- 172.21.15.78:0/1115410484 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5520018070 con 0x7f55280a3fc0 2023-06-02T15:30:59.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2023-06-02T15:30:59.555 INFO:teuthology.orchestra.run.smithi078.stdout:55834574854 2023-06-02T15:30:59.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 -- 172.21.15.78:0/1115410484 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5514065c00 msgr2=0x7f55140680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5514065c00 0x7f55140680b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f551c0b6000 tx=0x7f551c0af070 comp rx=0 tx=0).stop 2023-06-02T15:30:59.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 -- 172.21.15.78:0/1115410484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55280a3fc0 msgr2=0x7f55280be5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55280a3fc0 0x7f55280be5c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f552000ef90 tx=0x7f552000c490 comp rx=0 tx=0).stop 2023-06-02T15:30:59.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 -- 172.21.15.78:0/1115410484 shutdown_connections 2023-06-02T15:30:59.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55280a6980 0x7f552814a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5514065c00 0x7f55140680b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f55280a3fc0 0x7f55280be5c0 secure :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f552000ef90 tx=0x7f552000c490 comp rx=0 tx=0).stop 2023-06-02T15:30:59.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 --2- 172.21.15.78:0/1115410484 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5528069f50 0x7f55281e38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 -- 172.21.15.78:0/1115410484 >> 172.21.15.78:0/1115410484 conn(0x7f55280c48e0 msgr2=0x7f55280a4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 -- 172.21.15.78:0/1115410484 shutdown_connections 2023-06-02T15:30:59.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.546+0000 7f552ed4b640 1 -- 172.21.15.78:0/1115410484 wait complete. 2023-06-02T15:30:59.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.550+0000 7f2728a3c640 1 -- 172.21.15.78:0/104881548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f27241ef690 con 0x7f27240bbeb0 2023-06-02T15:30:59.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.550+0000 7f2712ffd640 1 -- 172.21.15.78:0/104881548 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27241ef690 con 0x7f27240bbeb0 2023-06-02T15:30:59.561 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-02T15:30:59.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.4 2023-06-02T15:30:59.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 -- 172.21.15.78:0/104881548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2704065c30 msgr2=0x7f27040680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2704065c30 0x7f27040680e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f27140b3000 tx=0x7f2714004740 comp rx=0 tx=0).stop 2023-06-02T15:30:59.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 -- 172.21.15.78:0/104881548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27240bbeb0 msgr2=0x7f27240b55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:30:59.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27240bbeb0 0x7f27240b55e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f271800b410 tx=0x7f271800b8d0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 -- 172.21.15.78:0/104881548 shutdown_connections 2023-06-02T15:30:59.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27240b5b20 0x7f27241eb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f272414b280 0x7f27241e8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2704065c30 0x7f27040680e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 --2- 172.21.15.78:0/104881548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27240bbeb0 0x7f27240b55e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:30:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 -- 172.21.15.78:0/104881548 >> 172.21.15.78:0/104881548 conn(0x7f27240a3ab0 msgr2=0x7f27240a5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:30:59.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 -- 172.21.15.78:0/104881548 shutdown_connections 2023-06-02T15:30:59.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:30:59.554+0000 7f2728a3c640 1 -- 172.21.15.78:0/104881548 wait complete. 2023-06-02T15:30:59.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.3 2023-06-02T15:30:59.578 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.6 2023-06-02T15:30:59.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.5 2023-06-02T15:30:59.583 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.2 2023-06-02T15:30:59.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2023-06-02T15:31:00.524 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-06-02T15:31:00.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-06-02T15:31:00.564 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-06-02T15:31:00.569 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-06-02T15:31:00.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-06-02T15:31:00.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-06-02T15:31:00.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-06-02T15:31:00.585 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-06-02T15:31:00.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.666+0000 7f85047c8640 1 Processor -- start 2023-06-02T15:31:00.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.666+0000 7f85047c8640 1 -- start start 2023-06-02T15:31:00.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f85047c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f84fc0bcc70 0x7f84fc0a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f85047c8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84fc0bd040 0x7f84fc070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f85047c8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc070ff0 0x7f84fc14a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f85047c8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0bc4c0 con 0x7f84fc0bd040 2023-06-02T15:31:00.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f85047c8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84fc0bb140 con 0x7f84fc0bcc70 2023-06-02T15:31:00.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f85047c8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc0bbb80 con 0x7f84fc070ff0 2023-06-02T15:31:00.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f8501d63640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84fc0bd040 0x7f84fc070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f8501d63640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f84fc0bd040 0x7f84fc070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57848/0 (socket says 172.21.15.78:57848) 2023-06-02T15:31:00.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f8501d63640 1 -- 172.21.15.78:0/2951774083 learned_addr learned my addr 172.21.15.78:0/2951774083 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f8502d65640 1 --2- 172.21.15.78:0/2951774083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc070ff0 0x7f84fc14a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f8502564640 1 --2- 172.21.15.78:0/2951774083 >> v2:172.21.15.132:3300/0 conn(0x7f84fc0bcc70 0x7f84fc0a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f8501d63640 1 -- 172.21.15.78:0/2951774083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc070ff0 msgr2=0x7f84fc14a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f8501d63640 1 --2- 172.21.15.78:0/2951774083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc070ff0 0x7f84fc14a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f8501d63640 1 -- 172.21.15.78:0/2951774083 >> v2:172.21.15.132:3300/0 conn(0x7f84fc0bcc70 msgr2=0x7f84fc0a3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f8501d63640 1 --2- 172.21.15.78:0/2951774083 >> v2:172.21.15.132:3300/0 conn(0x7f84fc0bcc70 0x7f84fc0a3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.670+0000 7f8501d63640 1 -- 172.21.15.78:0/2951774083 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84fc071450 con 0x7f84fc0bd040 2023-06-02T15:31:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.674+0000 7f8501d63640 1 --2- 172.21.15.78:0/2951774083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0bd040 0x7f84fc070ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0c14a0 tx=0x7f84f40237c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10175486973c9ce server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.674+0000 7f8501562640 1 -- 172.21.15.78:0/2951774083 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f40b2620 con 0x7f84fc0bd040 2023-06-02T15:31:00.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.674+0000 7f8501562640 1 -- 172.21.15.78:0/2951774083 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f40b2780 con 0x7f84fc0bd040 2023-06-02T15:31:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.674+0000 7f85047c8640 1 -- 172.21.15.78:0/2951774083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0bd040 msgr2=0x7f84fc070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.674+0000 7f85047c8640 1 --2- 172.21.15.78:0/2951774083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0bd040 0x7f84fc070ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f84fc0c14a0 tx=0x7f84f40237c0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.674+0000 7f85047c8640 1 -- 172.21.15.78:0/2951774083 shutdown_connections 2023-06-02T15:31:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.674+0000 7f85047c8640 1 --2- 172.21.15.78:0/2951774083 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc070ff0 0x7f84fc14a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.674+0000 7f85047c8640 1 --2- 172.21.15.78:0/2951774083 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0bd040 0x7f84fc070ab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.674+0000 7f85047c8640 1 --2- 172.21.15.78:0/2951774083 >> v2:172.21.15.132:3300/0 conn(0x7f84fc0bcc70 0x7f84fc0a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.674+0000 7f85047c8640 1 -- 172.21.15.78:0/2951774083 >> 172.21.15.78:0/2951774083 conn(0x7f84fc0698f0 msgr2=0x7f84fc069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:00.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f85047c8640 1 -- 172.21.15.78:0/2951774083 shutdown_connections 2023-06-02T15:31:00.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f85047c8640 1 -- 172.21.15.78:0/2951774083 wait complete. 2023-06-02T15:31:00.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f85047c8640 1 Processor -- start 2023-06-02T15:31:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f85047c8640 1 -- start start 2023-06-02T15:31:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f85047c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84fc070ff0 0x7f84fc1d3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f85047c8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc0bcc70 0x7f84fc1462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f85047c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0bd040 0x7f84fc146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f85047c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1d4960 con 0x7f84fc0bd040 2023-06-02T15:31:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f85047c8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1f0ac0 con 0x7f84fc070ff0 2023-06-02T15:31:00.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f85047c8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84fc1f05c0 con 0x7f84fc0bcc70 2023-06-02T15:31:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f8501d63640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc0bcc70 0x7f84fc1462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f8501d63640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc0bcc70 0x7f84fc1462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:50006/0 (socket says 172.21.15.78:50006) 2023-06-02T15:31:00.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.678+0000 7f8501d63640 1 -- 172.21.15.78:0/3266221939 learned_addr learned my addr 172.21.15.78:0/3266221939 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.682+0000 7f8502d65640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0bd040 0x7f84fc146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.682+0000 7f8502d65640 1 -- 172.21.15.78:0/3266221939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc0bcc70 msgr2=0x7f84fc1462f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.682+0000 7f8502d65640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc0bcc70 0x7f84fc1462f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.682+0000 7f8502d65640 1 -- 172.21.15.78:0/3266221939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84fc070ff0 msgr2=0x7f84fc1d3270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-06-02T15:31:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.682+0000 7f8502d65640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84fc070ff0 0x7f84fc1d3270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.682+0000 7f8502d65640 1 -- 172.21.15.78:0/3266221939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f400d050 con 0x7f84fc0bd040 2023-06-02T15:31:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.682+0000 7f8501d63640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc0bcc70 0x7f84fc1462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:31:00.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.682+0000 7f8502d65640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0bd040 0x7f84fc146d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f84f800e7f0 tx=0x7f84f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.682+0000 7f84f2ffd640 1 -- 172.21.15.78:0/3266221939 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f800eea0 con 0x7f84fc0bd040 2023-06-02T15:31:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.686+0000 7f84f2ffd640 1 -- 172.21.15.78:0/3266221939 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84f800c940 con 0x7f84fc0bd040 2023-06-02T15:31:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.686+0000 7f85047c8640 1 -- 172.21.15.78:0/3266221939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84fc0bc1c0 con 0x7f84fc0bd040 2023-06-02T15:31:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.686+0000 7f85047c8640 1 -- 172.21.15.78:0/3266221939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84fc0bc710 con 0x7f84fc0bd040 2023-06-02T15:31:00.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.686+0000 7f84f2ffd640 1 -- 172.21.15.78:0/3266221939 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84f800ccd0 con 0x7f84fc0bd040 2023-06-02T15:31:00.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.686+0000 7f85047c8640 1 -- 172.21.15.78:0/3266221939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84fc0bb5d0 con 0x7f84fc0bd040 2023-06-02T15:31:00.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.686+0000 7f84f2ffd640 1 -- 172.21.15.78:0/3266221939 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f84f8013470 con 0x7f84fc0bd040 2023-06-02T15:31:00.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.690+0000 7f84f2ffd640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f84e8065df0 0x7f84e80682a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.690+0000 7f84f2ffd640 1 -- 172.21.15.78:0/3266221939 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f84f8083910 con 0x7f84fc0bd040 2023-06-02T15:31:00.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.690+0000 7f8502564640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f84e8065df0 0x7f84e80682a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.690+0000 7f8502564640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f84e8065df0 0x7f84e80682a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009970 tx=0x7f84ec009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.698+0000 7f84f2ffd640 1 -- 172.21.15.78:0/3266221939 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f84f8054a20 con 0x7f84fc0bd040 2023-06-02T15:31:00.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.718+0000 7fd918d09640 1 Processor -- start 2023-06-02T15:31:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.718+0000 7fd918d09640 1 -- start start 2023-06-02T15:31:00.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.718+0000 7fd918d09640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd9140a3ea0 0x7fd914070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.718+0000 7fd918d09640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 0x7fd91414a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.718+0000 7fd918d09640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9140bc4c0 con 0x7fd9140bcc70 2023-06-02T15:31:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.718+0000 7fd918d09640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9140a42b0 con 0x7fd9140a3ea0 2023-06-02T15:31:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.718+0000 7fd918d09640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140bb140 con 0x7fd914070ff0 2023-06-02T15:31:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.718+0000 7fd911d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd9140a3ea0 0x7fd914070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.718+0000 7fd911d9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd9140a3ea0 0x7fd914070ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57854/0 (socket says 172.21.15.78:57854) 2023-06-02T15:31:00.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.718+0000 7fd911d9b640 1 -- 172.21.15.78:0/3789619049 learned_addr learned my addr 172.21.15.78:0/3789619049 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05f5c8d640 1 Processor -- start 2023-06-02T15:31:00.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7fd912d9d640 1 --2- 172.21.15.78:0/3789619049 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 0x7fd91414a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7fd911d9b640 1 -- 172.21.15.78:0/3789619049 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 msgr2=0x7fd91414a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7fd911d9b640 1 --2- 172.21.15.78:0/3789619049 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 0x7fd91414a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7fd911d9b640 1 -- 172.21.15.78:0/3789619049 >> v1:172.21.15.132:6789/0 conn(0x7fd9140bcc70 legacy=0x7fd9140bd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7fd911d9b640 1 -- 172.21.15.78:0/3789619049 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9140bbb80 con 0x7fd9140a3ea0 2023-06-02T15:31:00.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05f5c8d640 1 -- start start 2023-06-02T15:31:00.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05f5c8d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 0x7f05f00a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05f5c8d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f05f00bd040 0x7f05f0070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05f5c8d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05f00bc4c0 con 0x7f05f0070ff0 2023-06-02T15:31:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05f5c8d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05f00bb140 con 0x7f05f00bd040 2023-06-02T15:31:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05f5c8d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f0071470 con 0x7f05f00bcc70 2023-06-02T15:31:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05ef7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 0x7f05f00a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05ef7fe640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 0x7f05f00a3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:50028/0 (socket says 172.21.15.78:50028) 2023-06-02T15:31:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05ef7fe640 1 -- 172.21.15.78:0/4050864344 learned_addr learned my addr 172.21.15.78:0/4050864344 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05ef7fe640 1 -- 172.21.15.78:0/4050864344 >> v2:172.21.15.78:3300/0 conn(0x7f05f00bd040 msgr2=0x7f05f0070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05ef7fe640 1 --2- 172.21.15.78:0/4050864344 >> v2:172.21.15.78:3300/0 conn(0x7f05f00bd040 0x7f05f0070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05ef7fe640 1 -- 172.21.15.78:0/4050864344 >> v1:172.21.15.78:6789/0 conn(0x7f05f0070ff0 legacy=0x7f05f014a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.722+0000 7f05ef7fe640 1 -- 172.21.15.78:0/4050864344 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f00bbb80 con 0x7f05f00bcc70 2023-06-02T15:31:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd911d9b640 1 --2- 172.21.15.78:0/3789619049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140a3ea0 0x7fd914070ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009a50 tx=0x7fd90c01f4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f054241486d5ef7 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd91159a640 1 -- 172.21.15.78:0/3789619049 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0b1410 con 0x7fd9140a3ea0 2023-06-02T15:31:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd91159a640 1 -- 172.21.15.78:0/3789619049 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c0b1570 con 0x7fd9140a3ea0 2023-06-02T15:31:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd91159a640 1 -- 172.21.15.78:0/3789619049 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0b1900 con 0x7fd9140a3ea0 2023-06-02T15:31:00.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd918d09640 1 -- 172.21.15.78:0/3789619049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140a3ea0 msgr2=0x7fd914070ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd918d09640 1 --2- 172.21.15.78:0/3789619049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140a3ea0 0x7fd914070ab0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd90c009a50 tx=0x7fd90c01f4f0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05ef7fe640 1 --2- 172.21.15.78:0/4050864344 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 0x7f05f00a3ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05e8008870 tx=0x7f05e8021220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8b094689eff19ee server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd918d09640 1 -- 172.21.15.78:0/3789619049 shutdown_connections 2023-06-02T15:31:00.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd918d09640 1 --2- 172.21.15.78:0/3789619049 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 0x7fd91414a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd918d09640 1 --2- 172.21.15.78:0/3789619049 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140a3ea0 0x7fd914070ab0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd918d09640 1 -- 172.21.15.78:0/3789619049 >> 172.21.15.78:0/3789619049 conn(0x7fd9140698f0 msgr2=0x7fd914069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:00.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05ee7fc640 1 -- 172.21.15.78:0/4050864344 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e80b3410 con 0x7f05f00bcc70 2023-06-02T15:31:00.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05ee7fc640 1 -- 172.21.15.78:0/4050864344 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e80ad030 con 0x7f05f00bcc70 2023-06-02T15:31:00.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd918d09640 1 -- 172.21.15.78:0/3789619049 shutdown_connections 2023-06-02T15:31:00.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7fd918d09640 1 -- 172.21.15.78:0/3789619049 wait complete. 2023-06-02T15:31:00.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05f5c8d640 1 -- 172.21.15.78:0/4050864344 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 msgr2=0x7f05f00a3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05f5c8d640 1 --2- 172.21.15.78:0/4050864344 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 0x7f05f00a3ea0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f05e8008870 tx=0x7f05e8021220 comp rx=0 tx=0).stop 2023-06-02T15:31:00.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05f5c8d640 1 -- 172.21.15.78:0/4050864344 shutdown_connections 2023-06-02T15:31:00.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05f5c8d640 1 --2- 172.21.15.78:0/4050864344 >> v2:172.21.15.78:3300/0 conn(0x7f05f00bd040 0x7f05f0070ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05f5c8d640 1 --2- 172.21.15.78:0/4050864344 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 0x7f05f00a3ea0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05f5c8d640 1 -- 172.21.15.78:0/4050864344 >> 172.21.15.78:0/4050864344 conn(0x7f05f00698f0 msgr2=0x7f05f0069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:00.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05f5c8d640 1 -- 172.21.15.78:0/4050864344 shutdown_connections 2023-06-02T15:31:00.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.726+0000 7f05f5c8d640 1 -- 172.21.15.78:0/4050864344 wait complete. 2023-06-02T15:31:00.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd918d09640 1 Processor -- start 2023-06-02T15:31:00.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05f5c8d640 1 Processor -- start 2023-06-02T15:31:00.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05f5c8d640 1 -- start start 2023-06-02T15:31:00.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd918d09640 1 -- start start 2023-06-02T15:31:00.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd918d09640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 0x7fd9141475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd918d09640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140a3ea0 0x7fd9140b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd918d09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140bcc70 0x7fd9141f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd918d09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140b86f0 con 0x7fd9140bcc70 2023-06-02T15:31:00.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd918d09640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140bef10 con 0x7fd9140a3ea0 2023-06-02T15:31:00.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd918d09640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9140b8130 con 0x7fd914070ff0 2023-06-02T15:31:00.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd912d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140bcc70 0x7fd9141f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd912d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140bcc70 0x7fd9141f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57862/0 (socket says 172.21.15.78:57862) 2023-06-02T15:31:00.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd912d9d640 1 -- 172.21.15.78:0/915676844 learned_addr learned my addr 172.21.15.78:0/915676844 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd91259c640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 0x7fd9141475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd911d9b640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140a3ea0 0x7fd9140b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05f5c8d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05f0070ff0 0x7f05f00b9970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd91259c640 1 -- 172.21.15.78:0/915676844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140a3ea0 msgr2=0x7fd9140b74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd91259c640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140a3ea0 0x7fd9140b74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd91259c640 1 -- 172.21.15.78:0/915676844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140bcc70 msgr2=0x7fd9141f1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd91259c640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140bcc70 0x7fd9141f1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd91259c640 1 -- 172.21.15.78:0/915676844 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c0096b0 con 0x7fd914070ff0 2023-06-02T15:31:00.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05f5c8d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 0x7f05f0145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05f5c8d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05f00bd040 0x7f05f01d2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05f5c8d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f014a870 con 0x7f05f0070ff0 2023-06-02T15:31:00.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05f5c8d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f01d4190 con 0x7f05f00bd040 2023-06-02T15:31:00.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05f5c8d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f014a260 con 0x7f05f00bcc70 2023-06-02T15:31:00.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05ef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05f0070ff0 0x7f05f00b9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd91259c640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 0x7fd9141475d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd908001ec0 tx=0x7fd90800c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05eeffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 0x7f05f0145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05ef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05f0070ff0 0x7f05f00b9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57876/0 (socket says 172.21.15.78:57876) 2023-06-02T15:31:00.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05ef7fe640 1 -- 172.21.15.78:0/1657104342 learned_addr learned my addr 172.21.15.78:0/1657104342 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05effff640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05f00bd040 0x7f05f01d2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd902ffd640 1 -- 172.21.15.78:0/915676844 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9080052d0 con 0x7fd914070ff0 2023-06-02T15:31:00.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05ef7fe640 1 -- 172.21.15.78:0/1657104342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 msgr2=0x7f05f0145470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05ef7fe640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 0x7f05f0145470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05ef7fe640 1 -- 172.21.15.78:0/1657104342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05f00bd040 msgr2=0x7f05f01d2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05ef7fe640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05f00bd040 0x7f05f01d2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7f05ef7fe640 1 -- 172.21.15.78:0/1657104342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e8008550 con 0x7f05f0070ff0 2023-06-02T15:31:00.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7f05ef7fe640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05f0070ff0 0x7f05f00b9970 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f05e8021ac0 tx=0x7f05e801dfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd918d09640 1 -- 172.21.15.78:0/915676844 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9140bc710 con 0x7fd914070ff0 2023-06-02T15:31:00.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.730+0000 7fd918d09640 1 -- 172.21.15.78:0/915676844 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd914071450 con 0x7fd914070ff0 2023-06-02T15:31:00.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7fd902ffd640 1 -- 172.21.15.78:0/915676844 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd908005430 con 0x7fd914070ff0 2023-06-02T15:31:00.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7fd902ffd640 1 -- 172.21.15.78:0/915676844 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd908003840 con 0x7fd914070ff0 2023-06-02T15:31:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7f05e7fff640 1 -- 172.21.15.78:0/1657104342 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e800b4c0 con 0x7f05f0070ff0 2023-06-02T15:31:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7f05e7fff640 1 -- 172.21.15.78:0/1657104342 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e800b660 con 0x7f05f0070ff0 2023-06-02T15:31:00.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7f05e7fff640 1 -- 172.21.15.78:0/1657104342 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e800ba10 con 0x7f05f0070ff0 2023-06-02T15:31:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7f05f5c8d640 1 -- 172.21.15.78:0/1657104342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f00bc1c0 con 0x7f05f0070ff0 2023-06-02T15:31:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7f05f5c8d640 1 -- 172.21.15.78:0/1657104342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f00bc710 con 0x7f05f0070ff0 2023-06-02T15:31:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7f05f5c8d640 1 -- 172.21.15.78:0/1657104342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f00bb5d0 con 0x7f05f0070ff0 2023-06-02T15:31:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.738+0000 7f05e7fff640 1 -- 172.21.15.78:0/1657104342 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f05e80c7460 con 0x7f05f0070ff0 2023-06-02T15:31:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.738+0000 7f05e7fff640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f05dc065dd0 0x7f05dc068280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.738+0000 7f05eeffd640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f05dc065dd0 0x7f05dc068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.738+0000 7f05e7fff640 1 -- 172.21.15.78:0/1657104342 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f05e8121d20 con 0x7f05f0070ff0 2023-06-02T15:31:00.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.738+0000 7f05eeffd640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f05dc065dd0 0x7f05dc068280 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f05f01e37c0 tx=0x7f05d8006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7fd918d09640 1 -- 172.21.15.78:0/915676844 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f8005260 con 0x7fd914070ff0 2023-06-02T15:31:00.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.734+0000 7fd902ffd640 1 -- 172.21.15.78:0/915676844 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fd9080039a0 con 0x7fd914070ff0 2023-06-02T15:31:00.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.742+0000 7fd902ffd640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd8f4065c00 0x7fd8f40680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.742+0000 7fd902ffd640 1 -- 172.21.15.78:0/915676844 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd908082ac0 con 0x7fd914070ff0 2023-06-02T15:31:00.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.746+0000 7fd911d9b640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd8f4065c00 0x7fd8f40680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.746+0000 7f05e7fff640 1 -- 172.21.15.78:0/1657104342 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f05e80ef320 con 0x7f05f0070ff0 2023-06-02T15:31:00.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.746+0000 7fd911d9b640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd8f4065c00 0x7fd8f40680b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0b2000 tx=0x7fd90c0ab000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.754+0000 7fd902ffd640 1 -- 172.21.15.78:0/915676844 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fd908050040 con 0x7fd914070ff0 2023-06-02T15:31:00.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.774+0000 7f1a2801e640 1 Processor -- start 2023-06-02T15:31:00.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.774+0000 7f1a2801e640 1 -- start start 2023-06-02T15:31:00.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a2801e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a200bcbe0 0x7f1a200a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a2801e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a20070ab0 0x7f1a20070f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a2801e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a200bc4c0 con 0x7f1a2006a400 2023-06-02T15:31:00.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a2801e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a200bb140 con 0x7f1a20070ab0 2023-06-02T15:31:00.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a2801e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20071470 con 0x7f1a200bcbe0 2023-06-02T15:31:00.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a265bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a20070ab0 0x7f1a20070f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a25dba640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a200bcbe0 0x7f1a200a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a265bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1a20070ab0 0x7f1a20070f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49260/0 (socket says 172.21.15.78:49260) 2023-06-02T15:31:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a265bb640 1 -- 172.21.15.78:0/918985342 learned_addr learned my addr 172.21.15.78:0/918985342 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a265bb640 1 -- 172.21.15.78:0/918985342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a200bcbe0 msgr2=0x7f1a200a3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a265bb640 1 --2- 172.21.15.78:0/918985342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a200bcbe0 0x7f1a200a3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a265bb640 1 -- 172.21.15.78:0/918985342 >> v1:172.21.15.132:6789/0 conn(0x7f1a2006a400 legacy=0x7f1a200bcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a265bb640 1 -- 172.21.15.78:0/918985342 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200bbb80 con 0x7f1a20070ab0 2023-06-02T15:31:00.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7f1a25dba640 1 --2- 172.21.15.78:0/918985342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a200bcbe0 0x7f1a200a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:31:00.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7fa978562640 1 Processor -- start 2023-06-02T15:31:00.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.778+0000 7fa978562640 1 -- start start 2023-06-02T15:31:00.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa978562640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa968041ee0 0x7fa968041770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa978562640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680433e0 0x7fa96803d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa978562640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa968044cf0 con 0x7fa968045e90 2023-06-02T15:31:00.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa978562640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa968041cb0 con 0x7fa968041ee0 2023-06-02T15:31:00.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa978562640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa968044f40 con 0x7fa9680433e0 2023-06-02T15:31:00.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa976aff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680433e0 0x7fa96803d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa975afd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa968041ee0 0x7fa968041770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa976aff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680433e0 0x7fa96803d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:50064/0 (socket says 172.21.15.78:50064) 2023-06-02T15:31:00.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa976aff640 1 -- 172.21.15.78:0/2229638487 learned_addr learned my addr 172.21.15.78:0/2229638487 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f145cc00640 1 Processor -- start 2023-06-02T15:31:00.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f5342452640 1 Processor -- start 2023-06-02T15:31:00.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f145cc00640 1 -- start start 2023-06-02T15:31:00.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f5342452640 1 -- start start 2023-06-02T15:31:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a265bb640 1 --2- 172.21.15.78:0/918985342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a20070ab0 0x7f1a20070f30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009870 tx=0x7f1a1001c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beb25bfe64a4a3dd server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a24db8640 1 -- 172.21.15.78:0/918985342 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100ab620 con 0x7f1a20070ab0 2023-06-02T15:31:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a24db8640 1 -- 172.21.15.78:0/918985342 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100ab780 con 0x7f1a20070ab0 2023-06-02T15:31:00.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a24db8640 1 -- 172.21.15.78:0/918985342 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100abb10 con 0x7f1a20070ab0 2023-06-02T15:31:00.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f5342452640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f533c0bcc70 0x7f533c0a3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f5342452640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f533c0bd040 0x7f533c070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f145cc00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f145806d160 0x7f14580bc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa975afd640 1 -- 172.21.15.78:0/2229638487 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680433e0 msgr2=0x7fa96803d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa975afd640 1 --2- 172.21.15.78:0/2229638487 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680433e0 0x7fa96803d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa975afd640 1 -- 172.21.15.78:0/2229638487 >> v1:172.21.15.132:6789/0 conn(0x7fa968045e90 legacy=0x7fa9680463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7fa975afd640 1 -- 172.21.15.78:0/2229638487 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680d1e20 con 0x7fa968041ee0 2023-06-02T15:31:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f145cc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14580bc880 0x7f14580a3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f5342452640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f533c0bc4c0 con 0x7f533c070ff0 2023-06-02T15:31:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f5342452640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533c0bb140 con 0x7f533c0bcc70 2023-06-02T15:31:00.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f5342452640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f533c0bbb80 con 0x7f533c0bd040 2023-06-02T15:31:00.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f145cc00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f145814ba60 con 0x7f1458148070 2023-06-02T15:31:00.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f145cc00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14580a36c0 con 0x7f145806d160 2023-06-02T15:31:00.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a2801e640 1 -- 172.21.15.78:0/918985342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a20070ab0 msgr2=0x7f1a20070f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a2801e640 1 --2- 172.21.15.78:0/918985342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a20070ab0 0x7f1a20070f30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f1a10009870 tx=0x7f1a1001c510 comp rx=0 tx=0).stop 2023-06-02T15:31:00.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1455d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f145806d160 0x7f14580bc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f145cc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14580bad20 con 0x7f14580bc880 2023-06-02T15:31:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f533b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f533c0bd040 0x7f533c070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f53409ef640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f533c070ff0 0x7f533c14a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:39998/0 (socket says 172.21.15.78:39998) 2023-06-02T15:31:00.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f53409ef640 1 -- 172.21.15.78:0/2983249233 learned_addr learned my addr 172.21.15.78:0/2983249233 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a2801e640 1 -- 172.21.15.78:0/918985342 shutdown_connections 2023-06-02T15:31:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a2801e640 1 --2- 172.21.15.78:0/918985342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a20070ab0 0x7f1a20070f30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a2801e640 1 --2- 172.21.15.78:0/918985342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a200bcbe0 0x7f1a200a3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a2801e640 1 -- 172.21.15.78:0/918985342 >> 172.21.15.78:0/918985342 conn(0x7f1a200698f0 msgr2=0x7f1a20069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:00.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a2801e640 1 -- 172.21.15.78:0/918985342 shutdown_connections 2023-06-02T15:31:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1a2801e640 1 -- 172.21.15.78:0/918985342 wait complete. 2023-06-02T15:31:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1455d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f145806d160 0x7f14580bc340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49276/0 (socket says 172.21.15.78:49276) 2023-06-02T15:31:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1455d9b640 1 -- 172.21.15.78:0/50915663 learned_addr learned my addr 172.21.15.78:0/50915663 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1456d9d640 1 --2- 172.21.15.78:0/50915663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14580bc880 0x7f14580a3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f533bfff640 1 --2- 172.21.15.78:0/2983249233 >> v2:172.21.15.78:3300/0 conn(0x7f533c0bcc70 0x7f533c0a3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1455d9b640 1 -- 172.21.15.78:0/50915663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14580bc880 msgr2=0x7f14580a3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1455d9b640 1 --2- 172.21.15.78:0/50915663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14580bc880 0x7f14580a3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f533bfff640 1 -- 172.21.15.78:0/2983249233 >> v2:172.21.15.132:3300/0 conn(0x7f533c0bd040 msgr2=0x7f533c070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1455d9b640 1 -- 172.21.15.78:0/50915663 >> v1:172.21.15.132:6789/0 conn(0x7f1458148070 legacy=0x7f145814ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f533bfff640 1 --2- 172.21.15.78:0/2983249233 >> v2:172.21.15.132:3300/0 conn(0x7f533c0bd040 0x7f533c070ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f533bfff640 1 -- 172.21.15.78:0/2983249233 >> v1:172.21.15.132:6789/0 conn(0x7f533c070ff0 legacy=0x7f533c14a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f1455d9b640 1 -- 172.21.15.78:0/50915663 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145814b4a0 con 0x7f145806d160 2023-06-02T15:31:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.782+0000 7f533bfff640 1 -- 172.21.15.78:0/2983249233 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c0bc710 con 0x7f533c0bcc70 2023-06-02T15:31:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7fa975afd640 1 --2- 172.21.15.78:0/2229638487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa968041ee0 0x7fa968041770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00dbe0 tx=0x7fa96c022fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=252967b0ee083595 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a2801e640 1 Processor -- start 2023-06-02T15:31:00.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a2801e640 1 -- start start 2023-06-02T15:31:00.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a2801e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a2006a400 0x7f1a2014d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a2801e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a20070ab0 0x7f1a20150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a2801e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a200bcbe0 0x7f1a201471d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a2801e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20151240 con 0x7f1a20070ab0 2023-06-02T15:31:00.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a2801e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20151870 con 0x7f1a200bcbe0 2023-06-02T15:31:00.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a2801e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a20147e50 con 0x7f1a2006a400 2023-06-02T15:31:00.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a255b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a20070ab0 0x7f1a20150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a265bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a200bcbe0 0x7f1a201471d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a255b9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a20070ab0 0x7f1a20150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57898/0 (socket says 172.21.15.78:57898) 2023-06-02T15:31:00.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a255b9640 1 -- 172.21.15.78:0/2362968545 learned_addr learned my addr 172.21.15.78:0/2362968545 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a25dba640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a2006a400 0x7f1a2014d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a265bb640 1 -- 172.21.15.78:0/2362968545 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a2006a400 msgr2=0x7f1a2014d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a265bb640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a2006a400 0x7f1a2014d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a265bb640 1 -- 172.21.15.78:0/2362968545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a20070ab0 msgr2=0x7f1a20150430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a265bb640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a20070ab0 0x7f1a20150430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a265bb640 1 -- 172.21.15.78:0/2362968545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a18009a70 con 0x7f1a200bcbe0 2023-06-02T15:31:00.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a25dba640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a2006a400 0x7f1a2014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:00.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a255b9640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a20070ab0 0x7f1a20150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:31:00.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1a265bb640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a200bcbe0 0x7f1a201471d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a100ac000 tx=0x7f1a1001ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1455d9b640 1 --2- 172.21.15.78:0/50915663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f145806d160 0x7f14580bc340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f14580bdf40 tx=0x7f144801c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86b4c7fff29c25b8 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1dae271640 1 Processor -- start 2023-06-02T15:31:00.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.786+0000 7f1dae271640 1 -- start start 2023-06-02T15:31:00.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1dae271640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da8071c20 0x7f1da8152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1dae271640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da8152ac0 con 0x7f1da8069b50 2023-06-02T15:31:00.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1dae271640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da80c2260 con 0x7f1da8069f20 2023-06-02T15:31:00.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1da8069b50 0x7f1da80bd6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56052/0 (socket says 172.21.15.78:56052) 2023-06-02T15:31:00.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da7fff640 1 -- 172.21.15.78:0/379215472 learned_addr learned my addr 172.21.15.78:0/379215472 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:00.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1dae271640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80bcb60 con 0x7f1da8071c20 2023-06-02T15:31:00.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da77fe640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da8071c20 0x7f1da8152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145559a640 1 -- 172.21.15.78:0/50915663 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480ab600 con 0x7f145806d160 2023-06-02T15:31:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa9752fc640 1 -- 172.21.15.78:0/2229638487 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c00d2d0 con 0x7fa968041ee0 2023-06-02T15:31:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1a167fc640 1 -- 172.21.15.78:0/2362968545 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100be3f0 con 0x7f1a200bcbe0 2023-06-02T15:31:00.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1a2801e640 1 -- 172.21.15.78:0/2362968545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a100094d0 con 0x7f1a200bcbe0 2023-06-02T15:31:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1108359339 0 0) 0x7f1d98001120 con 0x7f1da8069b50 2023-06-02T15:31:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d90003530 con 0x7f1da8069b50 2023-06-02T15:31:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1a2801e640 1 -- 172.21.15.78:0/2362968545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a200bb5b0 con 0x7f1a200bcbe0 2023-06-02T15:31:00.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa9752fc640 1 -- 172.21.15.78:0/2229638487 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c0aca90 con 0x7fa968041ee0 2023-06-02T15:31:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa9752fc640 1 -- 172.21.15.78:0/2229638487 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0ace20 con 0x7fa968041ee0 2023-06-02T15:31:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145559a640 1 -- 172.21.15.78:0/50915663 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14480a7050 con 0x7f145806d160 2023-06-02T15:31:00.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145559a640 1 -- 172.21.15.78:0/50915663 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480ab600 con 0x7f145806d160 2023-06-02T15:31:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3198239866 0 0) 0x7f1d90003530 con 0x7f1da8069b50 2023-06-02T15:31:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da8071c20 msgr2=0x7f1da8152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da8071c20 0x7f1da8152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 >> v1:172.21.15.132:6789/0 conn(0x7f1da8069f20 legacy=0x7f1da814b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80719b0 con 0x7f1da8069b50 2023-06-02T15:31:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f1d98001810 con 0x7f1da8069b50 2023-06-02T15:31:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 >> v1:172.21.15.78:6789/0 conn(0x7f1da8069b50 legacy=0x7f1da80bd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d90003a20 0x7f1d90003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da8071c20 0x7f1d900047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d90004d10 0x7f1d90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80bcb60 con 0x7f1d90004d10 2023-06-02T15:31:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9000ba70 con 0x7f1d90003a20 2023-06-02T15:31:00.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9000bc30 con 0x7f1da8071c20 2023-06-02T15:31:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1dac80e640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d90004d10 0x7f1d90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 -- 172.21.15.78:0/50915663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f145806d160 msgr2=0x7f14580bc340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 --2- 172.21.15.78:0/50915663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f145806d160 0x7f14580bc340 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f14580bdf40 tx=0x7f144801c370 comp rx=0 tx=0).stop 2023-06-02T15:31:00.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da77fe640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da8071c20 0x7f1d900047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da7fff640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d90003a20 0x7f1d90003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 -- 172.21.15.78:0/50915663 shutdown_connections 2023-06-02T15:31:00.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 --2- 172.21.15.78:0/50915663 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f14580bc880 0x7f14580a3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 --2- 172.21.15.78:0/50915663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f145806d160 0x7f14580bc340 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 -- 172.21.15.78:0/50915663 >> 172.21.15.78:0/50915663 conn(0x7f14580698f0 msgr2=0x7f1458069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:00.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 -- 172.21.15.78:0/50915663 shutdown_connections 2023-06-02T15:31:00.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 -- 172.21.15.78:0/50915663 wait complete. 2023-06-02T15:31:00.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1dac80e640 1 -- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da8071c20 msgr2=0x7f1d900047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1dac80e640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da8071c20 0x7f1d900047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1dac80e640 1 -- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d90003a20 msgr2=0x7f1d90003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:00.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1dac80e640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d90003a20 0x7f1d90003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1dac80e640 1 -- 172.21.15.78:0/379215472 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da80719b0 con 0x7f1d90004d10 2023-06-02T15:31:00.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1da7fff640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d90003a20 0x7f1d90003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:00.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa978562640 1 -- 172.21.15.78:0/2229638487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa968041ee0 msgr2=0x7fa968041770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa978562640 1 --2- 172.21.15.78:0/2229638487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa968041ee0 0x7fa968041770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa96c00dbe0 tx=0x7fa96c022fa0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1a167fc640 1 -- 172.21.15.78:0/2362968545 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a100be550 con 0x7f1a200bcbe0 2023-06-02T15:31:00.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1a167fc640 1 -- 172.21.15.78:0/2362968545 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a100be8c0 con 0x7f1a200bcbe0 2023-06-02T15:31:00.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa978562640 1 -- 172.21.15.78:0/2229638487 shutdown_connections 2023-06-02T15:31:00.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa978562640 1 --2- 172.21.15.78:0/2229638487 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa9680433e0 0x7fa96803d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa978562640 1 --2- 172.21.15.78:0/2229638487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa968041ee0 0x7fa968041770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa978562640 1 -- 172.21.15.78:0/2229638487 >> 172.21.15.78:0/2229638487 conn(0x7fa968043870 msgr2=0x7fa968043c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:00.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 Processor -- start 2023-06-02T15:31:00.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa978562640 1 -- 172.21.15.78:0/2229638487 shutdown_connections 2023-06-02T15:31:00.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7fa978562640 1 -- 172.21.15.78:0/2229638487 wait complete. 2023-06-02T15:31:00.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 -- start start 2023-06-02T15:31:00.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f145806d160 0x7f1458070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14580bc880 0x7f14581487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1458148070 0x7f14581539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14581e7470 con 0x7f14580bc880 2023-06-02T15:31:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1458153ee0 con 0x7f145806d160 2023-06-02T15:31:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f145cc00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f145814d820 con 0x7f1458148070 2023-06-02T15:31:00.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1455d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14580bc880 0x7f14581487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f533bfff640 1 --2- 172.21.15.78:0/2983249233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f533c0bcc70 0x7f533c0a3ea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f533c0a4e30 tx=0x7f532c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecbdd4db92e4a62 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1455d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14580bc880 0x7f14581487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57902/0 (socket says 172.21.15.78:57902) 2023-06-02T15:31:00.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1455d9b640 1 -- 172.21.15.78:0/3403228498 learned_addr learned my addr 172.21.15.78:0/3403228498 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f145659c640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f145806d160 0x7f1458070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.790+0000 7f1a167fc640 1 -- 172.21.15.78:0/2362968545 <== mon.1 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f1a100b43f0 con 0x7f1a200bcbe0 2023-06-02T15:31:00.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1a167fc640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1a04065c00 0x7f1a040680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1a167fc640 1 -- 172.21.15.78:0/2362968545 <== mon.1 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a1011dd90 con 0x7f1a200bcbe0 2023-06-02T15:31:00.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1456d9d640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1458148070 0x7f14581539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1455d9b640 1 -- 172.21.15.78:0/3403228498 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1458148070 msgr2=0x7f14581539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1455d9b640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1458148070 0x7f14581539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1455d9b640 1 -- 172.21.15.78:0/3403228498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f145806d160 msgr2=0x7f1458070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1455d9b640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f145806d160 0x7f1458070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1455d9b640 1 -- 172.21.15.78:0/3403228498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14480094d0 con 0x7f14580bc880 2023-06-02T15:31:00.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1a25dba640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1a04065c00 0x7f1a040680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa978562640 1 Processor -- start 2023-06-02T15:31:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f533affd640 1 -- 172.21.15.78:0/2983249233 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0a8950 con 0x7f533c0bcc70 2023-06-02T15:31:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f533affd640 1 -- 172.21.15.78:0/2983249233 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c0a8ab0 con 0x7f533c0bcc70 2023-06-02T15:31:00.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f533affd640 1 -- 172.21.15.78:0/2983249233 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0a8950 con 0x7f533c0bcc70 2023-06-02T15:31:00.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1a25dba640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1a04065c00 0x7f1a040680b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a18007640 tx=0x7f1a1800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1dac80e640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d90004d10 0x7f1d90005180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1da0001e50 tx=0x7f1da001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9444dbf61878dabd server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da0003b80 con 0x7f1d90004d10 2023-06-02T15:31:00.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1455d9b640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14580bc880 0x7f14581487c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f144801aa20 tx=0x7f1448019110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f5342452640 1 -- 172.21.15.78:0/2983249233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f533c0bcc70 msgr2=0x7f533c0a3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f5342452640 1 --2- 172.21.15.78:0/2983249233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f533c0bcc70 0x7f533c0a3ea0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f533c0a4e30 tx=0x7f532c01ec50 comp rx=0 tx=0).stop 2023-06-02T15:31:00.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da0003d00 con 0x7f1d90004d10 2023-06-02T15:31:00.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1da6ffd640 1 -- 172.21.15.78:0/379215472 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da00052c0 con 0x7f1d90004d10 2023-06-02T15:31:00.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f5342452640 1 -- 172.21.15.78:0/2983249233 shutdown_connections 2023-06-02T15:31:00.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f5342452640 1 --2- 172.21.15.78:0/2983249233 >> v2:172.21.15.132:3300/0 conn(0x7f533c0bd040 0x7f533c070ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f5342452640 1 --2- 172.21.15.78:0/2983249233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f533c0bcc70 0x7f533c0a3ea0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f5342452640 1 -- 172.21.15.78:0/2983249233 >> 172.21.15.78:0/2983249233 conn(0x7f533c0698f0 msgr2=0x7f533c069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:00.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa978562640 1 -- start start 2023-06-02T15:31:00.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa978562640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa968041ee0 0x7fa96802c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa978562640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9680433e0 0x7fa96802af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa978562640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa968045e90 0x7fa9680d2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa978562640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680d2400 con 0x7fa968041ee0 2023-06-02T15:31:00.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa978562640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa96802c580 con 0x7fa9680433e0 2023-06-02T15:31:00.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa978562640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9680d4e00 con 0x7fa968045e90 2023-06-02T15:31:00.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa9762fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa968041ee0 0x7fa96802c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa9762fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa968041ee0 0x7fa96802c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57910/0 (socket says 172.21.15.78:57910) 2023-06-02T15:31:00.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa9762fe640 1 -- 172.21.15.78:0/2321999855 learned_addr learned my addr 172.21.15.78:0/2321999855 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa976aff640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa968045e90 0x7fa9680d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa975afd640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9680433e0 0x7fa96802af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa9762fe640 1 -- 172.21.15.78:0/2321999855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa968045e90 msgr2=0x7fa9680d2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa9762fe640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa968045e90 0x7fa9680d2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa9762fe640 1 -- 172.21.15.78:0/2321999855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9680433e0 msgr2=0x7fa96802af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa9762fe640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9680433e0 0x7fa96802af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa9762fe640 1 -- 172.21.15.78:0/2321999855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c00d8c0 con 0x7fa968041ee0 2023-06-02T15:31:00.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1dae271640 1 -- 172.21.15.78:0/379215472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d90004d10 msgr2=0x7f1d90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1dae271640 1 --2- 172.21.15.78:0/379215472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d90004d10 0x7f1d90005180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1da0001e50 tx=0x7f1da001c740 comp rx=0 tx=0).stop 2023-06-02T15:31:00.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1dac80e640 1 -- 172.21.15.78:0/379215472 reap_dead start 2023-06-02T15:31:00.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1dae271640 1 -- 172.21.15.78:0/379215472 shutdown_connections 2023-06-02T15:31:00.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1dae271640 1 -- 172.21.15.78:0/379215472 >> 172.21.15.78:0/379215472 conn(0x7f1da80c13d0 msgr2=0x7f1da80c17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:00.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1dae271640 1 -- 172.21.15.78:0/379215472 shutdown_connections 2023-06-02T15:31:00.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1dae271640 1 -- 172.21.15.78:0/379215472 wait complete. 2023-06-02T15:31:00.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f5342452640 1 -- 172.21.15.78:0/2983249233 shutdown_connections 2023-06-02T15:31:00.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f1a2801e640 1 -- 172.21.15.78:0/2362968545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a08005260 con 0x7f1a200bcbe0 2023-06-02T15:31:00.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa9762fe640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa968041ee0 0x7fa96802c040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c3f0 tx=0x7fa96000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa966ffd640 1 -- 172.21.15.78:0/2321999855 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9600052d0 con 0x7fa968041ee0 2023-06-02T15:31:00.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa978562640 1 -- 172.21.15.78:0/2321999855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa968009a20 con 0x7fa968041ee0 2023-06-02T15:31:00.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7fa978562640 1 -- 172.21.15.78:0/2321999855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa96803da10 con 0x7fa968041ee0 2023-06-02T15:31:00.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f5342452640 1 -- 172.21.15.78:0/2983249233 wait complete. 2023-06-02T15:31:00.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.794+0000 7f5342452640 1 Processor -- start 2023-06-02T15:31:00.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dae271640 1 Processor -- start 2023-06-02T15:31:00.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dae271640 1 -- start start 2023-06-02T15:31:00.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dae271640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da814a7a0 0x7f1da813f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dae271640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da8140ad0 0x7f1da8140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dae271640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da813d4a0 0x7f1da813d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dae271640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80bbef0 con 0x7f1da8140ad0 2023-06-02T15:31:00.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dae271640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80bfc70 con 0x7f1da813d4a0 2023-06-02T15:31:00.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dae271640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da80bfee0 con 0x7f1da814a7a0 2023-06-02T15:31:00.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dac80e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da813d4a0 0x7f1da813d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da7fff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da814a7a0 0x7f1da813f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dac80e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da813d4a0 0x7f1da813d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49324/0 (socket says 172.21.15.78:49324) 2023-06-02T15:31:00.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dac80e640 1 -- 172.21.15.78:0/314168874 learned_addr learned my addr 172.21.15.78:0/314168874 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da77fe640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da8140ad0 0x7f1da8140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da7fff640 1 -- 172.21.15.78:0/314168874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da813d4a0 msgr2=0x7f1da813d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da7fff640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da813d4a0 0x7f1da813d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da7fff640 1 -- 172.21.15.78:0/314168874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da8140ad0 msgr2=0x7f1da8140ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da7fff640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da8140ad0 0x7f1da8140ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da7fff640 1 -- 172.21.15.78:0/314168874 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da8071660 con 0x7f1da814a7a0 2023-06-02T15:31:00.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da7fff640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da814a7a0 0x7f1da813f170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e830 tx=0x7f1d9800ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5342452640 1 -- start start 2023-06-02T15:31:00.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5342452640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f533c070ff0 0x7f533c0b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5342452640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f533c0bcc70 0x7f533c0b8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5342452640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f533c0bd040 0x7f533c1465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5342452640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1d7ad0 con 0x7f533c0bd040 2023-06-02T15:31:00.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5342452640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f533c1d7ce0 con 0x7f533c0bcc70 2023-06-02T15:31:00.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5342452640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f533c0b9ce0 con 0x7f533c070ff0 2023-06-02T15:31:00.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f53409ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f533c0bd040 0x7f533c1465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f533b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f533c0bcc70 0x7f533c0b8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f53409ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f533c0bd040 0x7f533c1465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57918/0 (socket says 172.21.15.78:57918) 2023-06-02T15:31:00.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f53409ef640 1 -- 172.21.15.78:0/4008556257 learned_addr learned my addr 172.21.15.78:0/4008556257 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:00.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f533bfff640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f533c070ff0 0x7f533c0b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f533bfff640 1 -- 172.21.15.78:0/4008556257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f533c0bcc70 msgr2=0x7f533c0b8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f533bfff640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f533c0bcc70 0x7f533c0b8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f533bfff640 1 -- 172.21.15.78:0/4008556257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f533c0bd040 msgr2=0x7f533c1465f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f533bfff640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f533c0bd040 0x7f533c1465f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f533bfff640 1 -- 172.21.15.78:0/4008556257 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c009420 con 0x7f533c070ff0 2023-06-02T15:31:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f533bfff640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f533c070ff0 0x7f533c0b7860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f532c0af000 tx=0x7f532c01b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5338ff9640 1 -- 172.21.15.78:0/4008556257 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0a8950 con 0x7f533c070ff0 2023-06-02T15:31:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5338ff9640 1 -- 172.21.15.78:0/4008556257 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c0b9410 con 0x7f533c070ff0 2023-06-02T15:31:00.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5338ff9640 1 -- 172.21.15.78:0/4008556257 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c0b97c0 con 0x7f533c070ff0 2023-06-02T15:31:00.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da4ff9640 1 -- 172.21.15.78:0/314168874 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800c8d0 con 0x7f1da814a7a0 2023-06-02T15:31:00.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da4ff9640 1 -- 172.21.15.78:0/314168874 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9800ca30 con 0x7f1da814a7a0 2023-06-02T15:31:00.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1da4ff9640 1 -- 172.21.15.78:0/314168874 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9800cde0 con 0x7f1da814a7a0 2023-06-02T15:31:00.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5342452640 1 -- 172.21.15.78:0/4008556257 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f533c0bc1c0 con 0x7f533c070ff0 2023-06-02T15:31:00.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f5342452640 1 -- 172.21.15.78:0/4008556257 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f533c071410 con 0x7f533c070ff0 2023-06-02T15:31:00.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7f1dae271640 1 -- 172.21.15.78:0/314168874 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da80c1f80 con 0x7f1da814a7a0 2023-06-02T15:31:00.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f1dae271640 1 -- 172.21.15.78:0/314168874 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da814c0c0 con 0x7f1da814a7a0 2023-06-02T15:31:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7fa966ffd640 1 -- 172.21.15.78:0/2321999855 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa960005430 con 0x7fa968041ee0 2023-06-02T15:31:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7fa978562640 1 -- 172.21.15.78:0/2321999855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa968009bb0 con 0x7fa968041ee0 2023-06-02T15:31:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7fa966ffd640 1 -- 172.21.15.78:0/2321999855 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa960003840 con 0x7fa968041ee0 2023-06-02T15:31:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7fa966ffd640 1 -- 172.21.15.78:0/2321999855 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fa9600039a0 con 0x7fa968041ee0 2023-06-02T15:31:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7fa966ffd640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa954065c50 0x7fa954068100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.798+0000 7fa975afd640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa954065c50 0x7fa954068100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7fa966ffd640 1 -- 172.21.15.78:0/2321999855 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa960082f50 con 0x7fa968041ee0 2023-06-02T15:31:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f5342452640 1 -- 172.21.15.78:0/4008556257 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f533c0bb5d0 con 0x7f533c070ff0 2023-06-02T15:31:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f1dae271640 1 -- 172.21.15.78:0/314168874 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da8073bc0 con 0x7f1da814a7a0 2023-06-02T15:31:00.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f5338ff9640 1 -- 172.21.15.78:0/4008556257 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f532c0b7040 con 0x7f533c070ff0 2023-06-02T15:31:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f1da4ff9640 1 -- 172.21.15.78:0/314168874 <== mon.2 v2:172.21.15.132:3301/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f1d98027430 con 0x7f1da814a7a0 2023-06-02T15:31:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f1da4ff9640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1d94065c30 0x7f1d940680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f1da77fe640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1d94065c30 0x7f1d940680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f5338ff9640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5328065c30 0x7f53280680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f5338ff9640 1 -- 172.21.15.78:0/4008556257 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f532c121d20 con 0x7f533c070ff0 2023-06-02T15:31:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f1da77fe640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1d94065c30 0x7f1d940680e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1da81e1510 tx=0x7f1d9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f533b7fe640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5328065c30 0x7f53280680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7f1446ffd640 1 -- 172.21.15.78:0/3403228498 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480ab600 con 0x7f14580bc880 2023-06-02T15:31:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.806+0000 7f145cc00640 1 -- 172.21.15.78:0/3403228498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1458157370 con 0x7f14580bc880 2023-06-02T15:31:00.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.806+0000 7f145cc00640 1 -- 172.21.15.78:0/3403228498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1458148440 con 0x7f14580bc880 2023-06-02T15:31:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.806+0000 7f533b7fe640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5328065c30 0x7f53280680e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f533c06a5c0 tx=0x7f533000c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.806+0000 7f1446ffd640 1 -- 172.21.15.78:0/3403228498 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14480b5650 con 0x7f14580bc880 2023-06-02T15:31:00.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.802+0000 7fa975afd640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa954065c50 0x7fa954068100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0b5000 tx=0x7fa96c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.806+0000 7f145cc00640 1 -- 172.21.15.78:0/3403228498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1458157500 con 0x7f14580bc880 2023-06-02T15:31:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.806+0000 7f1446ffd640 1 -- 172.21.15.78:0/3403228498 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480b5a00 con 0x7f14580bc880 2023-06-02T15:31:00.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.806+0000 7fa966ffd640 1 -- 172.21.15.78:0/2321999855 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fa960050550 con 0x7fa968041ee0 2023-06-02T15:31:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.810+0000 7f1a167fc640 1 -- 172.21.15.78:0/2362968545 <== mon.1 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f1a100eb1f0 con 0x7f1a200bcbe0 2023-06-02T15:31:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.810+0000 7f1446ffd640 1 -- 172.21.15.78:0/3403228498 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f14480b5b60 con 0x7f14580bc880 2023-06-02T15:31:00.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.810+0000 7f1446ffd640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1438065cd0 0x7f1438068180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:00.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.810+0000 7f145659c640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1438065cd0 0x7f1438068180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:00.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.810+0000 7f1446ffd640 1 -- 172.21.15.78:0/3403228498 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f144811de50 con 0x7f14580bc880 2023-06-02T15:31:00.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.810+0000 7f145659c640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1438065cd0 0x7f1438068180 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f144c007fd0 tx=0x7f144c007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:00.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.814+0000 7f5338ff9640 1 -- 172.21.15.78:0/4008556257 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f532c0ef1f0 con 0x7f533c070ff0 2023-06-02T15:31:00.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.818+0000 7f1446ffd640 1 -- 172.21.15.78:0/3403228498 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f14480eb450 con 0x7f14580bc880 2023-06-02T15:31:00.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.818+0000 7f1da4ff9640 1 -- 172.21.15.78:0/314168874 <== mon.2 v2:172.21.15.132:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1d98058fd0 con 0x7f1da814a7a0 2023-06-02T15:31:00.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.826+0000 7f1da4ff9640 1 -- 172.21.15.78:0/314168874 <== mon.2 v2:172.21.15.132:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f1d98051350 con 0x7f1da814a7a0 2023-06-02T15:31:01.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.994+0000 7f85047c8640 1 -- 172.21.15.78:0/3266221939 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84fc1f0700 con 0x7f84fc0bd040 2023-06-02T15:31:01.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.994+0000 7f84f2ffd640 1 -- 172.21.15.78:0/3266221939 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84f80545b0 con 0x7f84fc0bd040 2023-06-02T15:31:01.006 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-06-02T15:31:01.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 -- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f84e8065df0 msgr2=0x7f84e80682a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f84e8065df0 0x7f84e80682a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f84ec009970 tx=0x7f84ec009190 comp rx=0 tx=0).stop 2023-06-02T15:31:01.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 -- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0bd040 msgr2=0x7f84fc146d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0bd040 0x7f84fc146d10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f84f800e7f0 tx=0x7f84f800ecb0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 -- 172.21.15.78:0/3266221939 shutdown_connections 2023-06-02T15:31:01.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f84e8065df0 0x7f84e80682a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f84fc0bd040 0x7f84fc146d10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f84fc0bcc70 0x7f84fc1462f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 --2- 172.21.15.78:0/3266221939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84fc070ff0 0x7f84fc1d3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 -- 172.21.15.78:0/3266221939 >> 172.21.15.78:0/3266221939 conn(0x7f84fc0698f0 msgr2=0x7f84fc0bffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 -- 172.21.15.78:0/3266221939 shutdown_connections 2023-06-02T15:31:01.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:00.998+0000 7f85047c8640 1 -- 172.21.15.78:0/3266221939 wait complete. 2023-06-02T15:31:01.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2023-06-02T15:31:01.029 DEBUG:teuthology.parallel:result is None 2023-06-02T15:31:01.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.066+0000 7f05f5c8d640 1 -- 172.21.15.78:0/1657104342 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f05d4005110 con 0x7f05f0070ff0 2023-06-02T15:31:01.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.066+0000 7f05e7fff640 1 -- 172.21.15.78:0/1657104342 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f05e80b8020 con 0x7f05f0070ff0 2023-06-02T15:31:01.074 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-06-02T15:31:01.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.066+0000 7fd918d09640 1 -- 172.21.15.78:0/915676844 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fd8f8005510 con 0x7fd914070ff0 2023-06-02T15:31:01.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 -- 172.21.15.78:0/1657104342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f05dc065dd0 msgr2=0x7f05dc068280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f05dc065dd0 0x7f05dc068280 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f05f01e37c0 tx=0x7f05d8006f90 comp rx=0 tx=0).stop 2023-06-02T15:31:01.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 -- 172.21.15.78:0/1657104342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05f0070ff0 msgr2=0x7f05f00b9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05f0070ff0 0x7f05f00b9970 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f05e8021ac0 tx=0x7f05e801dfc0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 -- 172.21.15.78:0/1657104342 shutdown_connections 2023-06-02T15:31:01.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05f00bd040 0x7f05f01d2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f05f00bcc70 0x7f05f0145470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f05dc065dd0 0x7f05dc068280 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 --2- 172.21.15.78:0/1657104342 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f05f0070ff0 0x7f05f00b9970 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 -- 172.21.15.78:0/1657104342 >> 172.21.15.78:0/1657104342 conn(0x7f05f00698f0 msgr2=0x7f05f00bebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 -- 172.21.15.78:0/1657104342 shutdown_connections 2023-06-02T15:31:01.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f05f5c8d640 1 -- 172.21.15.78:0/1657104342 wait complete. 2023-06-02T15:31:01.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7fd902ffd640 1 -- 172.21.15.78:0/915676844 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd908017070 con 0x7fd914070ff0 2023-06-02T15:31:01.080 INFO:teuthology.orchestra.run.smithi078.stdout:55834574855 2023-06-02T15:31:01.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f145cc00640 1 -- 172.21.15.78:0/3403228498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1458073bc0 con 0x7f14580bc880 2023-06-02T15:31:01.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.070+0000 7f1446ffd640 1 -- 172.21.15.78:0/3403228498 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14480b9020 con 0x7f14580bc880 2023-06-02T15:31:01.081 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-06-02T15:31:01.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 -- 172.21.15.78:0/915676844 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd8f4065c00 msgr2=0x7fd8f40680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd8f4065c00 0x7fd8f40680b0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd90c0b2000 tx=0x7fd90c0ab000 comp rx=0 tx=0).stop 2023-06-02T15:31:01.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 -- 172.21.15.78:0/915676844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 msgr2=0x7fd9141475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 0x7fd9141475d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd908001ec0 tx=0x7fd90800c890 comp rx=0 tx=0).stop 2023-06-02T15:31:01.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 -- 172.21.15.78:0/915676844 shutdown_connections 2023-06-02T15:31:01.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd8f4065c00 0x7fd8f40680b0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd9140bcc70 0x7fd9141f1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd9140a3ea0 0x7fd9140b74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 --2- 172.21.15.78:0/915676844 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd914070ff0 0x7fd9141475d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 -- 172.21.15.78:0/915676844 >> 172.21.15.78:0/915676844 conn(0x7fd9140698f0 msgr2=0x7fd9140bf080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 -- 172.21.15.78:0/915676844 shutdown_connections 2023-06-02T15:31:01.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7fd918d09640 1 -- 172.21.15.78:0/915676844 wait complete. 2023-06-02T15:31:01.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 -- 172.21.15.78:0/3403228498 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1438065cd0 msgr2=0x7f1438068180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1438065cd0 0x7f1438068180 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f144c007fd0 tx=0x7f144c007e40 comp rx=0 tx=0).stop 2023-06-02T15:31:01.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 -- 172.21.15.78:0/3403228498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14580bc880 msgr2=0x7f14581487c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14580bc880 0x7f14581487c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f144801aa20 tx=0x7f1448019110 comp rx=0 tx=0).stop 2023-06-02T15:31:01.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 -- 172.21.15.78:0/3403228498 shutdown_connections 2023-06-02T15:31:01.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1458148070 0x7f14581539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1438065cd0 0x7f1438068180 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f14580bc880 0x7f14581487c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 --2- 172.21.15.78:0/3403228498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f145806d160 0x7f1458070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 -- 172.21.15.78:0/3403228498 >> 172.21.15.78:0/3403228498 conn(0x7f14580698f0 msgr2=0x7f14580bae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 -- 172.21.15.78:0/3403228498 shutdown_connections 2023-06-02T15:31:01.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.074+0000 7f145cc00640 1 -- 172.21.15.78:0/3403228498 wait complete. 2023-06-02T15:31:01.102 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-06-02T15:31:01.102 DEBUG:teuthology.parallel:result is None 2023-06-02T15:31:01.105 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-06-02T15:31:01.105 DEBUG:teuthology.parallel:result is None 2023-06-02T15:31:01.109 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-06-02T15:31:01.109 DEBUG:teuthology.parallel:result is None 2023-06-02T15:31:01.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.110+0000 7fa978562640 1 -- 172.21.15.78:0/2321999855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa968005350 con 0x7fa968041ee0 2023-06-02T15:31:01.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.110+0000 7fa966ffd640 1 -- 172.21.15.78:0/2321999855 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa960017090 con 0x7fa968041ee0 2023-06-02T15:31:01.120 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-06-02T15:31:01.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 -- 172.21.15.78:0/2321999855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa954065c50 msgr2=0x7fa954068100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa954065c50 0x7fa954068100 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa96c0b5000 tx=0x7fa96c008040 comp rx=0 tx=0).stop 2023-06-02T15:31:01.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 -- 172.21.15.78:0/2321999855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa968041ee0 msgr2=0x7fa96802c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa968041ee0 0x7fa96802c040 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fa96000c3f0 tx=0x7fa96000c8b0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 -- 172.21.15.78:0/2321999855 shutdown_connections 2023-06-02T15:31:01.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa968045e90 0x7fa9680d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9680433e0 0x7fa96802af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa954065c50 0x7fa954068100 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 --2- 172.21.15.78:0/2321999855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa968041ee0 0x7fa96802c040 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 -- 172.21.15.78:0/2321999855 >> 172.21.15.78:0/2321999855 conn(0x7fa968043870 msgr2=0x7fa968027680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 -- 172.21.15.78:0/2321999855 shutdown_connections 2023-06-02T15:31:01.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.114+0000 7fa978562640 1 -- 172.21.15.78:0/2321999855 wait complete. 2023-06-02T15:31:01.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.122+0000 7f1a2801e640 1 -- 172.21.15.78:0/2362968545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1a08005510 con 0x7f1a200bcbe0 2023-06-02T15:31:01.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.122+0000 7f5342452640 1 -- 172.21.15.78:0/4008556257 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f533c073bc0 con 0x7f533c070ff0 2023-06-02T15:31:01.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.122+0000 7f1a167fc640 1 -- 172.21.15.78:0/2362968545 <== mon.1 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a100ee810 con 0x7f1a200bcbe0 2023-06-02T15:31:01.131 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-06-02T15:31:01.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.122+0000 7f5338ff9640 1 -- 172.21.15.78:0/4008556257 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f532c0b5020 con 0x7f533c070ff0 2023-06-02T15:31:01.131 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-06-02T15:31:01.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 -- 172.21.15.78:0/2362968545 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1a04065c00 msgr2=0x7f1a040680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1a04065c00 0x7f1a040680b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1a18007640 tx=0x7f1a1800b040 comp rx=0 tx=0).stop 2023-06-02T15:31:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 -- 172.21.15.78:0/2362968545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a200bcbe0 msgr2=0x7f1a201471d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a200bcbe0 0x7f1a201471d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1a100ac000 tx=0x7f1a1001ad50 comp rx=0 tx=0).stop 2023-06-02T15:31:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 -- 172.21.15.78:0/2362968545 shutdown_connections 2023-06-02T15:31:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1a200bcbe0 0x7f1a201471d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1a04065c00 0x7f1a040680b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1a20070ab0 0x7f1a20150430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 --2- 172.21.15.78:0/2362968545 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1a2006a400 0x7f1a2014d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 -- 172.21.15.78:0/2362968545 >> 172.21.15.78:0/2362968545 conn(0x7f1a200698f0 msgr2=0x7f1a200a2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 -- 172.21.15.78:0/2362968545 shutdown_connections 2023-06-02T15:31:01.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f1a2801e640 1 -- 172.21.15.78:0/2362968545 wait complete. 2023-06-02T15:31:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 -- 172.21.15.78:0/4008556257 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5328065c30 msgr2=0x7f53280680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5328065c30 0x7f53280680e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f533c06a5c0 tx=0x7f533000c040 comp rx=0 tx=0).stop 2023-06-02T15:31:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 -- 172.21.15.78:0/4008556257 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f533c070ff0 msgr2=0x7f533c0b7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f533c070ff0 0x7f533c0b7860 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f532c0af000 tx=0x7f532c01b9f0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 -- 172.21.15.78:0/4008556257 shutdown_connections 2023-06-02T15:31:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5328065c30 0x7f53280680e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f533c0bd040 0x7f533c1465f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f533c0bcc70 0x7f533c0b8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 --2- 172.21.15.78:0/4008556257 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f533c070ff0 0x7f533c0b7860 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 -- 172.21.15.78:0/4008556257 >> 172.21.15.78:0/4008556257 conn(0x7f533c0698f0 msgr2=0x7f533c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 -- 172.21.15.78:0/4008556257 shutdown_connections 2023-06-02T15:31:01.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.126+0000 7f5342452640 1 -- 172.21.15.78:0/4008556257 wait complete. 2023-06-02T15:31:01.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.130+0000 7f1dae271640 1 -- 172.21.15.78:0/314168874 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1da8152ac0 con 0x7f1da814a7a0 2023-06-02T15:31:01.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.130+0000 7f1da4ff9640 1 -- 172.21.15.78:0/314168874 <== mon.2 v2:172.21.15.132:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1da8152ac0 con 0x7f1da814a7a0 2023-06-02T15:31:01.139 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-06-02T15:31:01.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.130+0000 7f1dae271640 1 -- 172.21.15.78:0/314168874 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1d94065c30 msgr2=0x7f1d940680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.130+0000 7f1dae271640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1d94065c30 0x7f1d940680e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1da81e1510 tx=0x7f1d9c008040 comp rx=0 tx=0).stop 2023-06-02T15:31:01.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.130+0000 7f1dae271640 1 -- 172.21.15.78:0/314168874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da814a7a0 msgr2=0x7f1da813f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.130+0000 7f1dae271640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da814a7a0 0x7f1da813f170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800e830 tx=0x7f1d9800ecf0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.130+0000 7f1dae271640 1 -- 172.21.15.78:0/314168874 shutdown_connections 2023-06-02T15:31:01.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.130+0000 7f1dae271640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da813d4a0 0x7f1da813d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.134+0000 7f1dae271640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1d94065c30 0x7f1d940680e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.134+0000 7f1dae271640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1da8140ad0 0x7f1da8140ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.134+0000 7f1dae271640 1 --2- 172.21.15.78:0/314168874 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1da814a7a0 0x7f1da813f170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.134+0000 7f1dae271640 1 -- 172.21.15.78:0/314168874 >> 172.21.15.78:0/314168874 conn(0x7f1da80c13d0 msgr2=0x7f1da8070c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.134+0000 7f1dae271640 1 -- 172.21.15.78:0/314168874 shutdown_connections 2023-06-02T15:31:01.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.134+0000 7f1dae271640 1 -- 172.21.15.78:0/314168874 wait complete. 2023-06-02T15:31:01.145 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-06-02T15:31:01.146 DEBUG:teuthology.parallel:result is None 2023-06-02T15:31:01.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-06-02T15:31:01.155 DEBUG:teuthology.parallel:result is None 2023-06-02T15:31:01.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2023-06-02T15:31:01.157 DEBUG:teuthology.parallel:result is None 2023-06-02T15:31:01.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.5 2023-06-02T15:31:01.160 DEBUG:teuthology.parallel:result is None 2023-06-02T15:31:01.160 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-02T15:31:01.160 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:31:01.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.294+0000 7fe887fcf640 1 Processor -- start 2023-06-02T15:31:01.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.294+0000 7fe887fcf640 1 -- start start 2023-06-02T15:31:01.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe887fcf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8800ba880 0x7fe8800a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe887fcf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8800bb0e0 con 0x7fe880149e00 2023-06-02T15:31:01.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe887fcf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8800a3810 con 0x7fe88014fe20 2023-06-02T15:31:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe887fcf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe88014a1d0 con 0x7fe8800ba880 2023-06-02T15:31:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe885d6b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe880149e00 0x7fe8800a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56054/0 (socket says 172.21.15.78:56054) 2023-06-02T15:31:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe885d6b640 1 -- 172.21.15.78:0/2392473579 learned_addr learned my addr 172.21.15.78:0/2392473579 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735821750 0 0) 0x7fe8800bb0e0 con 0x7fe880149e00 2023-06-02T15:31:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe88556a640 1 --2- 172.21.15.78:0/2392473579 >> v2:172.21.15.132:3300/0 conn(0x7fe8800ba880 0x7fe8800a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe86c003530 con 0x7fe880149e00 2023-06-02T15:31:01.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1003540969 0 0) 0x7fe86c003530 con 0x7fe880149e00 2023-06-02T15:31:01.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 >> v2:172.21.15.132:3300/0 conn(0x7fe8800ba880 msgr2=0x7fe8800a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:01.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 --2- 172.21.15.78:0/2392473579 >> v2:172.21.15.132:3300/0 conn(0x7fe8800ba880 0x7fe8800a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 >> v1:172.21.15.132:6789/0 conn(0x7fe88014fe20 legacy=0x7fe8801502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800a3af0 con 0x7fe880149e00 2023-06-02T15:31:01.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fe870001680 con 0x7fe880149e00 2023-06-02T15:31:01.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 >> v1:172.21.15.78:6789/0 conn(0x7fe880149e00 legacy=0x7fe8800a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe86c003980 0x7fe86c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe86c0047d0 0x7fe86c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe86c005180 0x7fe86c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88014a1d0 con 0x7fe86c005180 2023-06-02T15:31:01.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c00c000 con 0x7fe86c003980 2023-06-02T15:31:01.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe86c00c1c0 con 0x7fe86c0047d0 2023-06-02T15:31:01.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe88656c640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe86c005180 0x7fe86c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe885d6b640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe86c003980 0x7fe86c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe88556a640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe86c0047d0 0x7fe86c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe88656c640 1 -- 172.21.15.78:0/2392473579 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe86c0047d0 msgr2=0x7fe86c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:01.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe88656c640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe86c0047d0 0x7fe86c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe88656c640 1 -- 172.21.15.78:0/2392473579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe86c003980 msgr2=0x7fe86c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:01.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe88656c640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe86c003980 0x7fe86c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe88656c640 1 -- 172.21.15.78:0/2392473579 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe86c003530 con 0x7fe86c005180 2023-06-02T15:31:01.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe88656c640 1 -- 172.21.15.78:0/2392473579 reap_dead start 2023-06-02T15:31:01.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe88656c640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe86c005180 0x7fe86c00b990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe878001e70 tx=0x7fe87801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4e0ce1952a2ca6 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:01.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878003b80 con 0x7fe86c005180 2023-06-02T15:31:01.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe878003d00 con 0x7fe86c005180 2023-06-02T15:31:01.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe884d69640 1 -- 172.21.15.78:0/2392473579 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878005260 con 0x7fe86c005180 2023-06-02T15:31:01.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe887fcf640 1 -- 172.21.15.78:0/2392473579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe86c005180 msgr2=0x7fe86c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.298+0000 7fe887fcf640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe86c005180 0x7fe86c00b990 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe878001e70 tx=0x7fe87801c760 comp rx=0 tx=0).stop 2023-06-02T15:31:01.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- 172.21.15.78:0/2392473579 shutdown_connections 2023-06-02T15:31:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 --2- 172.21.15.78:0/2392473579 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe86c005180 0x7fe86c00b990 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- 172.21.15.78:0/2392473579 >> 172.21.15.78:0/2392473579 conn(0x7fe8800bcf50 msgr2=0x7fe8800bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- 172.21.15.78:0/2392473579 shutdown_connections 2023-06-02T15:31:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- 172.21.15.78:0/2392473579 wait complete. 2023-06-02T15:31:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 Processor -- start 2023-06-02T15:31:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- start start 2023-06-02T15:31:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe86c005180 0x7fe8801e1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88014f660 0x7fe8801e1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8800c0540 0x7fe8800c09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800a61d0 con 0x7fe88014f660 2023-06-02T15:31:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800b5a30 con 0x7fe86c005180 2023-06-02T15:31:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800c00b0 con 0x7fe8800c0540 2023-06-02T15:31:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe88556a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88014f660 0x7fe8801e1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe88556a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88014f660 0x7fe8801e1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57934/0 (socket says 172.21.15.78:57934) 2023-06-02T15:31:01.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe88556a640 1 -- 172.21.15.78:0/411760111 learned_addr learned my addr 172.21.15.78:0/411760111 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe885d6b640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe86c005180 0x7fe8801e1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe88556a640 1 -- 172.21.15.78:0/411760111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8800c0540 msgr2=0x7fe8800c09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe88656c640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8800c0540 0x7fe8800c09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe88556a640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8800c0540 0x7fe8800c09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe88556a640 1 -- 172.21.15.78:0/411760111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe86c005180 msgr2=0x7fe8801e1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe88556a640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe86c005180 0x7fe8801e1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe88556a640 1 -- 172.21.15.78:0/411760111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800a5bd0 con 0x7fe88014f660 2023-06-02T15:31:01.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe885d6b640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe86c005180 0x7fe8801e1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:01.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe88556a640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88014f660 0x7fe8801e1680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0108c0 tx=0x7fe87c010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:01.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe8767fc640 1 -- 172.21.15.78:0/411760111 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c009630 con 0x7fe88014f660 2023-06-02T15:31:01.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe8767fc640 1 -- 172.21.15.78:0/411760111 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87c00eb60 con 0x7fe88014f660 2023-06-02T15:31:01.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- 172.21.15.78:0/411760111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8800a3dd0 con 0x7fe88014f660 2023-06-02T15:31:01.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe8767fc640 1 -- 172.21.15.78:0/411760111 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87c01c400 con 0x7fe88014f660 2023-06-02T15:31:01.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- 172.21.15.78:0/411760111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8800a5d60 con 0x7fe88014f660 2023-06-02T15:31:01.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.302+0000 7fe887fcf640 1 -- 172.21.15.78:0/411760111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe880073bc0 con 0x7fe88014f660 2023-06-02T15:31:01.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.306+0000 7fe8767fc640 1 -- 172.21.15.78:0/411760111 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fe87c01c560 con 0x7fe88014f660 2023-06-02T15:31:01.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.306+0000 7fe8767fc640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe864065c00 0x7fe8640680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.306+0000 7fe8767fc640 1 -- 172.21.15.78:0/411760111 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe87c083f40 con 0x7fe88014f660 2023-06-02T15:31:01.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.306+0000 7fe885d6b640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe864065c00 0x7fe8640680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.306+0000 7fe885d6b640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe864065c00 0x7fe8640680b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe870005800 tx=0x7fe870000f00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:01.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.310+0000 7fe8767fc640 1 -- 172.21.15.78:0/411760111 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fe87c051590 con 0x7fe88014f660 2023-06-02T15:31:01.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.446+0000 7fe887fcf640 1 -- 172.21.15.78:0/411760111 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8800a2eb0 con 0x7fe864065c00 2023-06-02T15:31:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.454+0000 7fe8767fc640 1 -- 172.21.15.78:0/411760111 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367484 (secure 0 0 0) 0x7fe8800a2eb0 con 0x7fe864065c00 2023-06-02T15:31:01.467 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:01.468 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:31:01.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 -- 172.21.15.78:0/411760111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe864065c00 msgr2=0x7fe8640680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe864065c00 0x7fe8640680b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe870005800 tx=0x7fe870000f00 comp rx=0 tx=0).stop 2023-06-02T15:31:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 -- 172.21.15.78:0/411760111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88014f660 msgr2=0x7fe8801e1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88014f660 0x7fe8801e1680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0108c0 tx=0x7fe87c010d80 comp rx=0 tx=0).stop 2023-06-02T15:31:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 -- 172.21.15.78:0/411760111 shutdown_connections 2023-06-02T15:31:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe8800c0540 0x7fe8800c09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe864065c00 0x7fe8640680b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe88014f660 0x7fe8801e1680 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 --2- 172.21.15.78:0/411760111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe86c005180 0x7fe8801e1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 -- 172.21.15.78:0/411760111 >> 172.21.15.78:0/411760111 conn(0x7fe8800bcf50 msgr2=0x7fe8801488d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 -- 172.21.15.78:0/411760111 shutdown_connections 2023-06-02T15:31:01.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.458+0000 7fe887fcf640 1 -- 172.21.15.78:0/411760111 wait complete. 2023-06-02T15:31:01.482 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-06-02T15:31:01.230710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594894,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69464,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":754905256,"statfs":{"total":773094113280,"available":773022982144,"internally_reserved":0,"allocated":2318336,"data_stored":2065912,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1749,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009534"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.713456+0000","last_change":"2023-06-02T15:30:42.711237+0000","last_active":"2023-06-02T15:30:42.713456+0000","last_peered":"2023-06-02T15:30:42.713456+0000","last_clean":"2023-06-02T15:30:42.713456+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:30:42.713456+0000","last_undegraded":"2023-06-02T15:30:42.713456+0000","last_fullsized":"2023-06-02T15:30:42.713456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669011+0000","last_change":"2023-06-02T15:30:38.275721+0000","last_active":"2023-06-02T15:30:42.669011+0000","last_peered":"2023-06-02T15:30:42.669011+0000","last_clean":"2023-06-02T15:30:42.669011+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:30:42.669011+0000","last_undegraded":"2023-06-02T15:30:42.669011+0000","last_fullsized":"2023-06-02T15:30:42.669011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659411+0000","last_change":"2023-06-02T15:30:38.638911+0000","last_active":"2023-06-02T15:30:42.659411+0000","last_peered":"2023-06-02T15:30:42.659411+0000","last_clean":"2023-06-02T15:30:42.659411+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:30:42.659411+0000","last_undegraded":"2023-06-02T15:30:42.659411+0000","last_fullsized":"2023-06-02T15:30:42.659411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.709825+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:30:42.709825+0000","last_peered":"2023-06-02T15:30:42.709825+0000","last_clean":"2023-06-02T15:30:42.709825+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:30:42.709825+0000","last_undegraded":"2023-06-02T15:30:42.709825+0000","last_fullsized":"2023-06-02T15:30:42.709825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:23:12.455644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674342+0000","last_change":"2023-06-02T15:30:38.282116+0000","last_active":"2023-06-02T15:30:42.674342+0000","last_peered":"2023-06-02T15:30:42.674342+0000","last_clean":"2023-06-02T15:30:42.674342+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:30:42.674342+0000","last_undegraded":"2023-06-02T15:30:42.674342+0000","last_fullsized":"2023-06-02T15:30:42.674342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666523+0000","last_change":"2023-06-02T15:30:38.638342+0000","last_active":"2023-06-02T15:30:42.666523+0000","last_peered":"2023-06-02T15:30:42.666523+0000","last_clean":"2023-06-02T15:30:42.666523+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:30:42.666523+0000","last_undegraded":"2023-06-02T15:30:42.666523+0000","last_fullsized":"2023-06-02T15:30:42.666523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.724432+0000","last_change":"2023-06-02T15:30:42.715416+0000","last_active":"2023-06-02T15:30:42.724432+0000","last_peered":"2023-06-02T15:30:42.724432+0000","last_clean":"2023-06-02T15:30:42.724432+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:30:42.724432+0000","last_undegraded":"2023-06-02T15:30:42.724432+0000","last_fullsized":"2023-06-02T15:30:42.724432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680371+0000","last_change":"2023-06-02T15:30:38.278973+0000","last_active":"2023-06-02T15:30:42.680371+0000","last_peered":"2023-06-02T15:30:42.680371+0000","last_clean":"2023-06-02T15:30:42.680371+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:30:42.680371+0000","last_undegraded":"2023-06-02T15:30:42.680371+0000","last_fullsized":"2023-06-02T15:30:42.680371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661168+0000","last_change":"2023-06-02T15:30:38.644549+0000","last_active":"2023-06-02T15:30:42.661168+0000","last_peered":"2023-06-02T15:30:42.661168+0000","last_clean":"2023-06-02T15:30:42.661168+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:30:42.661168+0000","last_undegraded":"2023-06-02T15:30:42.661168+0000","last_fullsized":"2023-06-02T15:30:42.661168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:26.088195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725079+0000","last_change":"2023-06-02T15:30:42.707090+0000","last_active":"2023-06-02T15:30:42.725079+0000","last_peered":"2023-06-02T15:30:42.725079+0000","last_clean":"2023-06-02T15:30:42.725079+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:30:42.725079+0000","last_undegraded":"2023-06-02T15:30:42.725079+0000","last_fullsized":"2023-06-02T15:30:42.725079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.667871+0000","last_change":"2023-06-02T15:30:38.269876+0000","last_active":"2023-06-02T15:30:42.667871+0000","last_peered":"2023-06-02T15:30:42.667871+0000","last_clean":"2023-06-02T15:30:42.667871+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:30:42.667871+0000","last_undegraded":"2023-06-02T15:30:42.667871+0000","last_fullsized":"2023-06-02T15:30:42.667871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661361+0000","last_change":"2023-06-02T15:30:38.639635+0000","last_active":"2023-06-02T15:30:42.661361+0000","last_peered":"2023-06-02T15:30:42.661361+0000","last_clean":"2023-06-02T15:30:42.661361+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:30:42.661361+0000","last_undegraded":"2023-06-02T15:30:42.661361+0000","last_fullsized":"2023-06-02T15:30:42.661361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:56:57.260064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.702939+0000","last_change":"2023-06-02T15:30:42.699623+0000","last_active":"2023-06-02T15:30:42.702939+0000","last_peered":"2023-06-02T15:30:42.702939+0000","last_clean":"2023-06-02T15:30:42.702939+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:30:42.702939+0000","last_undegraded":"2023-06-02T15:30:42.702939+0000","last_fullsized":"2023-06-02T15:30:42.702939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:18.327051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668971+0000","last_change":"2023-06-02T15:30:38.263534+0000","last_active":"2023-06-02T15:30:42.668971+0000","last_peered":"2023-06-02T15:30:42.668971+0000","last_clean":"2023-06-02T15:30:42.668971+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:30:42.668971+0000","last_undegraded":"2023-06-02T15:30:42.668971+0000","last_fullsized":"2023-06-02T15:30:42.668971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.653780+0000","last_change":"2023-06-02T15:30:38.644102+0000","last_active":"2023-06-02T15:30:42.653780+0000","last_peered":"2023-06-02T15:30:42.653780+0000","last_clean":"2023-06-02T15:30:42.653780+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:30:42.653780+0000","last_undegraded":"2023-06-02T15:30:42.653780+0000","last_fullsized":"2023-06-02T15:30:42.653780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:11.864794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.709755+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:30:42.709755+0000","last_peered":"2023-06-02T15:30:42.709755+0000","last_clean":"2023-06-02T15:30:42.709755+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:30:42.709755+0000","last_undegraded":"2023-06-02T15:30:42.709755+0000","last_fullsized":"2023-06-02T15:30:42.709755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:16:13.363523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661437+0000","last_change":"2023-06-02T15:30:38.272143+0000","last_active":"2023-06-02T15:30:42.661437+0000","last_peered":"2023-06-02T15:30:42.661437+0000","last_clean":"2023-06-02T15:30:42.661437+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:30:42.661437+0000","last_undegraded":"2023-06-02T15:30:42.661437+0000","last_fullsized":"2023-06-02T15:30:42.661437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673969+0000","last_change":"2023-06-02T15:30:38.650795+0000","last_active":"2023-06-02T15:30:42.673969+0000","last_peered":"2023-06-02T15:30:42.673969+0000","last_clean":"2023-06-02T15:30:42.673969+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:30:42.673969+0000","last_undegraded":"2023-06-02T15:30:42.673969+0000","last_fullsized":"2023-06-02T15:30:42.673969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725571+0000","last_change":"2023-06-02T15:30:42.706975+0000","last_active":"2023-06-02T15:30:42.725571+0000","last_peered":"2023-06-02T15:30:42.725571+0000","last_clean":"2023-06-02T15:30:42.725571+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:30:42.725571+0000","last_undegraded":"2023-06-02T15:30:42.725571+0000","last_fullsized":"2023-06-02T15:30:42.725571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:32.007544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675638+0000","last_change":"2023-06-02T15:30:38.290129+0000","last_active":"2023-06-02T15:30:42.675638+0000","last_peered":"2023-06-02T15:30:42.675638+0000","last_clean":"2023-06-02T15:30:42.675638+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:30:42.675638+0000","last_undegraded":"2023-06-02T15:30:42.675638+0000","last_fullsized":"2023-06-02T15:30:42.675638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.670451+0000","last_change":"2023-06-02T15:30:38.656679+0000","last_active":"2023-06-02T15:30:42.670451+0000","last_peered":"2023-06-02T15:30:42.670451+0000","last_clean":"2023-06-02T15:30:42.670451+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:30:42.670451+0000","last_undegraded":"2023-06-02T15:30:42.670451+0000","last_fullsized":"2023-06-02T15:30:42.670451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.707868+0000","last_change":"2023-06-02T15:30:42.705633+0000","last_active":"2023-06-02T15:30:42.707868+0000","last_peered":"2023-06-02T15:30:42.707868+0000","last_clean":"2023-06-02T15:30:42.707868+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:30:42.707868+0000","last_undegraded":"2023-06-02T15:30:42.707868+0000","last_fullsized":"2023-06-02T15:30:42.707868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674076+0000","last_change":"2023-06-02T15:30:38.273154+0000","last_active":"2023-06-02T15:30:42.674076+0000","last_peered":"2023-06-02T15:30:42.674076+0000","last_clean":"2023-06-02T15:30:42.674076+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:30:42.674076+0000","last_undegraded":"2023-06-02T15:30:42.674076+0000","last_fullsized":"2023-06-02T15:30:42.674076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665225+0000","last_change":"2023-06-02T15:30:38.647445+0000","last_active":"2023-06-02T15:30:42.665225+0000","last_peered":"2023-06-02T15:30:42.665225+0000","last_clean":"2023-06-02T15:30:42.665225+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:30:42.665225+0000","last_undegraded":"2023-06-02T15:30:42.665225+0000","last_fullsized":"2023-06-02T15:30:42.665225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:34.366098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675284+0000","last_change":"2023-06-02T15:30:38.650927+0000","last_active":"2023-06-02T15:30:42.675284+0000","last_peered":"2023-06-02T15:30:42.675284+0000","last_clean":"2023-06-02T15:30:42.675284+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:30:42.675284+0000","last_undegraded":"2023-06-02T15:30:42.675284+0000","last_fullsized":"2023-06-02T15:30:42.675284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669099+0000","last_change":"2023-06-02T15:30:38.274472+0000","last_active":"2023-06-02T15:30:42.669099+0000","last_peered":"2023-06-02T15:30:42.669099+0000","last_clean":"2023-06-02T15:30:42.669099+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:30:42.669099+0000","last_undegraded":"2023-06-02T15:30:42.669099+0000","last_fullsized":"2023-06-02T15:30:42.669099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725651+0000","last_change":"2023-06-02T15:30:42.710065+0000","last_active":"2023-06-02T15:30:42.725651+0000","last_peered":"2023-06-02T15:30:42.725651+0000","last_clean":"2023-06-02T15:30:42.725651+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:30:42.725651+0000","last_undegraded":"2023-06-02T15:30:42.725651+0000","last_fullsized":"2023-06-02T15:30:42.725651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666632+0000","last_change":"2023-06-02T15:30:38.656769+0000","last_active":"2023-06-02T15:30:42.666632+0000","last_peered":"2023-06-02T15:30:42.666632+0000","last_clean":"2023-06-02T15:30:42.666632+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:30:42.666632+0000","last_undegraded":"2023-06-02T15:30:42.666632+0000","last_fullsized":"2023-06-02T15:30:42.666632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.677097+0000","last_change":"2023-06-02T15:30:38.275134+0000","last_active":"2023-06-02T15:30:42.677097+0000","last_peered":"2023-06-02T15:30:42.677097+0000","last_clean":"2023-06-02T15:30:42.677097+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:30:42.677097+0000","last_undegraded":"2023-06-02T15:30:42.677097+0000","last_fullsized":"2023-06-02T15:30:42.677097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725199+0000","last_change":"2023-06-02T15:30:42.706722+0000","last_active":"2023-06-02T15:30:42.725199+0000","last_peered":"2023-06-02T15:30:42.725199+0000","last_clean":"2023-06-02T15:30:42.725199+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:30:42.725199+0000","last_undegraded":"2023-06-02T15:30:42.725199+0000","last_fullsized":"2023-06-02T15:30:42.725199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.693560+0000","last_change":"2023-06-02T15:30:38.289736+0000","last_active":"2023-06-02T15:30:42.693560+0000","last_peered":"2023-06-02T15:30:42.693560+0000","last_clean":"2023-06-02T15:30:42.693560+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:30:42.693560+0000","last_undegraded":"2023-06-02T15:30:42.693560+0000","last_fullsized":"2023-06-02T15:30:42.693560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:43:04.205096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675744+0000","last_change":"2023-06-02T15:30:38.642841+0000","last_active":"2023-06-02T15:30:42.675744+0000","last_peered":"2023-06-02T15:30:42.675744+0000","last_clean":"2023-06-02T15:30:42.675744+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:30:42.675744+0000","last_undegraded":"2023-06-02T15:30:42.675744+0000","last_fullsized":"2023-06-02T15:30:42.675744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.722145+0000","last_change":"2023-06-02T15:30:42.720577+0000","last_active":"2023-06-02T15:30:42.722145+0000","last_peered":"2023-06-02T15:30:42.722145+0000","last_clean":"2023-06-02T15:30:42.722145+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:30:42.722145+0000","last_undegraded":"2023-06-02T15:30:42.722145+0000","last_fullsized":"2023-06-02T15:30:42.722145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:48:54.291389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-02T15:30:47.961093+0000","last_change":"2023-06-02T15:30:38.276703+0000","last_active":"2023-06-02T15:30:47.961093+0000","last_peered":"2023-06-02T15:30:47.961093+0000","last_clean":"2023-06-02T15:30:47.961093+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:30:47.961093+0000","last_undegraded":"2023-06-02T15:30:47.961093+0000","last_fullsized":"2023-06-02T15:30:47.961093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3744,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661581+0000","last_change":"2023-06-02T15:30:38.634436+0000","last_active":"2023-06-02T15:30:42.661581+0000","last_peered":"2023-06-02T15:30:42.661581+0000","last_clean":"2023-06-02T15:30:42.661581+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:30:42.661581+0000","last_undegraded":"2023-06-02T15:30:42.661581+0000","last_fullsized":"2023-06-02T15:30:42.661581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.710264+0000","last_change":"2023-06-02T15:30:42.707445+0000","last_active":"2023-06-02T15:30:42.710264+0000","last_peered":"2023-06-02T15:30:42.710264+0000","last_clean":"2023-06-02T15:30:42.710264+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:30:42.710264+0000","last_undegraded":"2023-06-02T15:30:42.710264+0000","last_fullsized":"2023-06-02T15:30:42.710264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675836+0000","last_change":"2023-06-02T15:30:38.649326+0000","last_active":"2023-06-02T15:30:42.675836+0000","last_peered":"2023-06-02T15:30:42.675836+0000","last_clean":"2023-06-02T15:30:42.675836+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:30:42.675836+0000","last_undegraded":"2023-06-02T15:30:42.675836+0000","last_fullsized":"2023-06-02T15:30:42.675836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665271+0000","last_change":"2023-06-02T15:30:33.407154+0000","last_active":"2023-06-02T15:30:42.665271+0000","last_peered":"2023-06-02T15:30:42.665271+0000","last_clean":"2023-06-02T15:30:42.665271+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:30:42.665271+0000","last_undegraded":"2023-06-02T15:30:42.665271+0000","last_fullsized":"2023-06-02T15:30:42.665271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680583+0000","last_change":"2023-06-02T15:30:38.279321+0000","last_active":"2023-06-02T15:30:42.680583+0000","last_peered":"2023-06-02T15:30:42.680583+0000","last_clean":"2023-06-02T15:30:42.680583+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:30:42.680583+0000","last_undegraded":"2023-06-02T15:30:42.680583+0000","last_fullsized":"2023-06-02T15:30:42.680583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.717152+0000","last_change":"2023-06-02T15:30:42.715780+0000","last_active":"2023-06-02T15:30:42.717152+0000","last_peered":"2023-06-02T15:30:42.717152+0000","last_clean":"2023-06-02T15:30:42.717152+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:30:42.717152+0000","last_undegraded":"2023-06-02T15:30:42.717152+0000","last_fullsized":"2023-06-02T15:30:42.717152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668772+0000","last_change":"2023-06-02T15:30:38.632171+0000","last_active":"2023-06-02T15:30:42.668772+0000","last_peered":"2023-06-02T15:30:42.668772+0000","last_clean":"2023-06-02T15:30:42.668772+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:30:42.668772+0000","last_undegraded":"2023-06-02T15:30:42.668772+0000","last_fullsized":"2023-06-02T15:30:42.668772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666211+0000","last_change":"2023-06-02T15:30:33.655215+0000","last_active":"2023-06-02T15:30:42.666211+0000","last_peered":"2023-06-02T15:30:42.666211+0000","last_clean":"2023-06-02T15:30:42.666211+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:30:42.666211+0000","last_undegraded":"2023-06-02T15:30:42.666211+0000","last_fullsized":"2023-06-02T15:30:42.666211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678450+0000","last_change":"2023-06-02T15:30:38.277096+0000","last_active":"2023-06-02T15:30:42.678450+0000","last_peered":"2023-06-02T15:30:42.678450+0000","last_clean":"2023-06-02T15:30:42.678450+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:30:42.678450+0000","last_undegraded":"2023-06-02T15:30:42.678450+0000","last_fullsized":"2023-06-02T15:30:42.678450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.720822+0000","last_change":"2023-06-02T15:30:42.698823+0000","last_active":"2023-06-02T15:30:42.720822+0000","last_peered":"2023-06-02T15:30:42.720822+0000","last_clean":"2023-06-02T15:30:42.720822+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:30:42.720822+0000","last_undegraded":"2023-06-02T15:30:42.720822+0000","last_fullsized":"2023-06-02T15:30:42.720822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673925+0000","last_change":"2023-06-02T15:30:38.656372+0000","last_active":"2023-06-02T15:30:42.673925+0000","last_peered":"2023-06-02T15:30:42.673925+0000","last_clean":"2023-06-02T15:30:42.673925+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:30:42.673925+0000","last_undegraded":"2023-06-02T15:30:42.673925+0000","last_fullsized":"2023-06-02T15:30:42.673925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663851+0000","last_change":"2023-06-02T15:30:33.959737+0000","last_active":"2023-06-02T15:30:42.663851+0000","last_peered":"2023-06-02T15:30:42.663851+0000","last_clean":"2023-06-02T15:30:42.663851+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:30:42.663851+0000","last_undegraded":"2023-06-02T15:30:42.663851+0000","last_fullsized":"2023-06-02T15:30:42.663851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674797+0000","last_change":"2023-06-02T15:30:38.281667+0000","last_active":"2023-06-02T15:30:42.674797+0000","last_peered":"2023-06-02T15:30:42.674797+0000","last_clean":"2023-06-02T15:30:42.674797+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:30:42.674797+0000","last_undegraded":"2023-06-02T15:30:42.674797+0000","last_fullsized":"2023-06-02T15:30:42.674797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.718942+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:30:42.718942+0000","last_peered":"2023-06-02T15:30:42.718942+0000","last_clean":"2023-06-02T15:30:42.718942+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:30:42.718942+0000","last_undegraded":"2023-06-02T15:30:42.718942+0000","last_fullsized":"2023-06-02T15:30:42.718942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:02:01.714482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.660273+0000","last_change":"2023-06-02T15:30:38.646642+0000","last_active":"2023-06-02T15:30:42.660273+0000","last_peered":"2023-06-02T15:30:42.660273+0000","last_clean":"2023-06-02T15:30:42.660273+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:30:42.660273+0000","last_undegraded":"2023-06-02T15:30:42.660273+0000","last_fullsized":"2023-06-02T15:30:42.660273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669807+0000","last_change":"2023-06-02T15:30:33.413542+0000","last_active":"2023-06-02T15:30:42.669807+0000","last_peered":"2023-06-02T15:30:42.669807+0000","last_clean":"2023-06-02T15:30:42.669807+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:30:42.669807+0000","last_undegraded":"2023-06-02T15:30:42.669807+0000","last_fullsized":"2023-06-02T15:30:42.669807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-02T15:30:43.440541+0000","last_change":"2023-06-02T15:30:38.270941+0000","last_active":"2023-06-02T15:30:43.440541+0000","last_peered":"2023-06-02T15:30:43.440541+0000","last_clean":"2023-06-02T15:30:43.440541+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:30:43.440541+0000","last_undegraded":"2023-06-02T15:30:43.440541+0000","last_fullsized":"2023-06-02T15:30:43.440541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.711091+0000","last_change":"2023-06-02T15:30:42.702383+0000","last_active":"2023-06-02T15:30:42.711091+0000","last_peered":"2023-06-02T15:30:42.711091+0000","last_clean":"2023-06-02T15:30:42.711091+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:30:42.711091+0000","last_undegraded":"2023-06-02T15:30:42.711091+0000","last_fullsized":"2023-06-02T15:30:42.711091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:49:31.222291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.670681+0000","last_change":"2023-06-02T15:30:38.642398+0000","last_active":"2023-06-02T15:30:42.670681+0000","last_peered":"2023-06-02T15:30:42.670681+0000","last_clean":"2023-06-02T15:30:42.670681+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:30:42.670681+0000","last_undegraded":"2023-06-02T15:30:42.670681+0000","last_fullsized":"2023-06-02T15:30:42.670681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665469+0000","last_change":"2023-06-02T15:30:38.263733+0000","last_active":"2023-06-02T15:30:42.665469+0000","last_peered":"2023-06-02T15:30:42.665469+0000","last_clean":"2023-06-02T15:30:42.665469+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:30:42.665469+0000","last_undegraded":"2023-06-02T15:30:42.665469+0000","last_fullsized":"2023-06-02T15:30:42.665469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687342+0000","last_change":"2023-06-02T15:30:34.413807+0000","last_active":"2023-06-02T15:30:42.687342+0000","last_peered":"2023-06-02T15:30:42.687342+0000","last_clean":"2023-06-02T15:30:42.687342+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:30:42.687342+0000","last_undegraded":"2023-06-02T15:30:42.687342+0000","last_fullsized":"2023-06-02T15:30:42.687342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_clean_scrub_stamp":"2023-06-02T15:30:33.390390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:47:50.762629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678965+0000","last_change":"2023-06-02T15:30:33.411973+0000","last_active":"2023-06-02T15:30:42.678965+0000","last_peered":"2023-06-02T15:30:42.678965+0000","last_clean":"2023-06-02T15:30:42.678965+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:30:42.678965+0000","last_undegraded":"2023-06-02T15:30:42.678965+0000","last_fullsized":"2023-06-02T15:30:42.678965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721145+0000","last_change":"2023-06-02T15:30:42.712421+0000","last_active":"2023-06-02T15:30:42.721145+0000","last_peered":"2023-06-02T15:30:42.721145+0000","last_clean":"2023-06-02T15:30:42.721145+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:30:42.721145+0000","last_undegraded":"2023-06-02T15:30:42.721145+0000","last_fullsized":"2023-06-02T15:30:42.721145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:38:29.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679112+0000","last_change":"2023-06-02T15:30:38.653404+0000","last_active":"2023-06-02T15:30:42.679112+0000","last_peered":"2023-06-02T15:30:42.679112+0000","last_clean":"2023-06-02T15:30:42.679112+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:30:42.679112+0000","last_undegraded":"2023-06-02T15:30:42.679112+0000","last_fullsized":"2023-06-02T15:30:42.679112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675372+0000","last_change":"2023-06-02T15:30:38.269833+0000","last_active":"2023-06-02T15:30:42.675372+0000","last_peered":"2023-06-02T15:30:42.675372+0000","last_clean":"2023-06-02T15:30:42.675372+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:30:42.675372+0000","last_undegraded":"2023-06-02T15:30:42.675372+0000","last_fullsized":"2023-06-02T15:30:42.675372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:06:46.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687434+0000","last_change":"2023-06-02T15:30:33.654728+0000","last_active":"2023-06-02T15:30:42.687434+0000","last_peered":"2023-06-02T15:30:42.687434+0000","last_clean":"2023-06-02T15:30:42.687434+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:30:42.687434+0000","last_undegraded":"2023-06-02T15:30:42.687434+0000","last_fullsized":"2023-06-02T15:30:42.687434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:05:26.791938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.710087+0000","last_change":"2023-06-02T15:30:42.705191+0000","last_active":"2023-06-02T15:30:42.710087+0000","last_peered":"2023-06-02T15:30:42.710087+0000","last_clean":"2023-06-02T15:30:42.710087+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:30:42.710087+0000","last_undegraded":"2023-06-02T15:30:42.710087+0000","last_fullsized":"2023-06-02T15:30:42.710087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:22.765485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678163+0000","last_change":"2023-06-02T15:30:38.642359+0000","last_active":"2023-06-02T15:30:42.678163+0000","last_peered":"2023-06-02T15:30:42.678163+0000","last_clean":"2023-06-02T15:30:42.678163+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:30:42.678163+0000","last_undegraded":"2023-06-02T15:30:42.678163+0000","last_fullsized":"2023-06-02T15:30:42.678163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661971+0000","last_change":"2023-06-02T15:30:38.257531+0000","last_active":"2023-06-02T15:30:42.661971+0000","last_peered":"2023-06-02T15:30:42.661971+0000","last_clean":"2023-06-02T15:30:42.661971+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:30:42.661971+0000","last_undegraded":"2023-06-02T15:30:42.661971+0000","last_fullsized":"2023-06-02T15:30:42.661971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668731+0000","last_change":"2023-06-02T15:30:33.655250+0000","last_active":"2023-06-02T15:30:42.668731+0000","last_peered":"2023-06-02T15:30:42.668731+0000","last_clean":"2023-06-02T15:30:42.668731+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:30:42.668731+0000","last_undegraded":"2023-06-02T15:30:42.668731+0000","last_fullsized":"2023-06-02T15:30:42.668731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.695770+0000","last_change":"2023-06-02T15:30:42.693557+0000","last_active":"2023-06-02T15:30:42.695770+0000","last_peered":"2023-06-02T15:30:42.695770+0000","last_clean":"2023-06-02T15:30:42.695770+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:30:42.695770+0000","last_undegraded":"2023-06-02T15:30:42.695770+0000","last_fullsized":"2023-06-02T15:30:42.695770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665084+0000","last_change":"2023-06-02T15:30:38.645488+0000","last_active":"2023-06-02T15:30:42.665084+0000","last_peered":"2023-06-02T15:30:42.665084+0000","last_clean":"2023-06-02T15:30:42.665084+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:30:42.665084+0000","last_undegraded":"2023-06-02T15:30:42.665084+0000","last_fullsized":"2023-06-02T15:30:42.665084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669942+0000","last_change":"2023-06-02T15:30:38.283390+0000","last_active":"2023-06-02T15:30:42.669942+0000","last_peered":"2023-06-02T15:30:42.669942+0000","last_clean":"2023-06-02T15:30:42.669942+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:30:42.669942+0000","last_undegraded":"2023-06-02T15:30:42.669942+0000","last_fullsized":"2023-06-02T15:30:42.669942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687529+0000","last_change":"2023-06-02T15:30:33.653937+0000","last_active":"2023-06-02T15:30:42.687529+0000","last_peered":"2023-06-02T15:30:42.687529+0000","last_clean":"2023-06-02T15:30:42.687529+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:30:42.687529+0000","last_undegraded":"2023-06-02T15:30:42.687529+0000","last_fullsized":"2023-06-02T15:30:42.687529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.727044+0000","last_change":"2023-06-02T15:30:42.723169+0000","last_active":"2023-06-02T15:30:42.727044+0000","last_peered":"2023-06-02T15:30:42.727044+0000","last_clean":"2023-06-02T15:30:42.727044+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:30:42.727044+0000","last_undegraded":"2023-06-02T15:30:42.727044+0000","last_fullsized":"2023-06-02T15:30:42.727044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679007+0000","last_change":"2023-06-02T15:30:38.640964+0000","last_active":"2023-06-02T15:30:42.679007+0000","last_peered":"2023-06-02T15:30:42.679007+0000","last_clean":"2023-06-02T15:30:42.679007+0000","last_became_active":"2023-06-02T15:30:38.640643+0000","last_became_peered":"2023-06-02T15:30:38.640643+0000","last_unstale":"2023-06-02T15:30:42.679007+0000","last_undegraded":"2023-06-02T15:30:42.679007+0000","last_fullsized":"2023-06-02T15:30:42.679007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675412+0000","last_change":"2023-06-02T15:30:38.281851+0000","last_active":"2023-06-02T15:30:42.675412+0000","last_peered":"2023-06-02T15:30:42.675412+0000","last_clean":"2023-06-02T15:30:42.675412+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:30:42.675412+0000","last_undegraded":"2023-06-02T15:30:42.675412+0000","last_fullsized":"2023-06-02T15:30:42.675412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.715894+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:30:42.715894+0000","last_peered":"2023-06-02T15:30:42.715894+0000","last_clean":"2023-06-02T15:30:42.715894+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:30:42.715894+0000","last_undegraded":"2023-06-02T15:30:42.715894+0000","last_fullsized":"2023-06-02T15:30:42.715894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:44.594461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666012+0000","last_change":"2023-06-02T15:30:38.638725+0000","last_active":"2023-06-02T15:30:42.666012+0000","last_peered":"2023-06-02T15:30:42.666012+0000","last_clean":"2023-06-02T15:30:42.666012+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:30:42.666012+0000","last_undegraded":"2023-06-02T15:30:42.666012+0000","last_fullsized":"2023-06-02T15:30:42.666012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.660551+0000","last_change":"2023-06-02T15:30:38.269278+0000","last_active":"2023-06-02T15:30:42.660551+0000","last_peered":"2023-06-02T15:30:42.660551+0000","last_clean":"2023-06-02T15:30:42.660551+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:30:42.660551+0000","last_undegraded":"2023-06-02T15:30:42.660551+0000","last_fullsized":"2023-06-02T15:30:42.660551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721194+0000","last_change":"2023-06-02T15:30:42.713071+0000","last_active":"2023-06-02T15:30:42.721194+0000","last_peered":"2023-06-02T15:30:42.721194+0000","last_clean":"2023-06-02T15:30:42.721194+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:30:42.721194+0000","last_undegraded":"2023-06-02T15:30:42.721194+0000","last_fullsized":"2023-06-02T15:30:42.721194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663661+0000","last_change":"2023-06-02T15:30:38.636565+0000","last_active":"2023-06-02T15:30:42.663661+0000","last_peered":"2023-06-02T15:30:42.663661+0000","last_clean":"2023-06-02T15:30:42.663661+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:30:42.663661+0000","last_undegraded":"2023-06-02T15:30:42.663661+0000","last_fullsized":"2023-06-02T15:30:42.663661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:56:18.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.664010+0000","last_change":"2023-06-02T15:30:38.277404+0000","last_active":"2023-06-02T15:30:42.664010+0000","last_peered":"2023-06-02T15:30:42.664010+0000","last_clean":"2023-06-02T15:30:42.664010+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:30:42.664010+0000","last_undegraded":"2023-06-02T15:30:42.664010+0000","last_fullsized":"2023-06-02T15:30:42.664010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.702894+0000","last_change":"2023-06-02T15:30:42.697724+0000","last_active":"2023-06-02T15:30:42.702894+0000","last_peered":"2023-06-02T15:30:42.702894+0000","last_clean":"2023-06-02T15:30:42.702894+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:30:42.702894+0000","last_undegraded":"2023-06-02T15:30:42.702894+0000","last_fullsized":"2023-06-02T15:30:42.702894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663344+0000","last_change":"2023-06-02T15:30:38.640532+0000","last_active":"2023-06-02T15:30:42.663344+0000","last_peered":"2023-06-02T15:30:42.663344+0000","last_clean":"2023-06-02T15:30:42.663344+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:30:42.663344+0000","last_undegraded":"2023-06-02T15:30:42.663344+0000","last_fullsized":"2023-06-02T15:30:42.663344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674886+0000","last_change":"2023-06-02T15:30:38.281909+0000","last_active":"2023-06-02T15:30:42.674886+0000","last_peered":"2023-06-02T15:30:42.674886+0000","last_clean":"2023-06-02T15:30:42.674886+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:30:42.674886+0000","last_undegraded":"2023-06-02T15:30:42.674886+0000","last_fullsized":"2023-06-02T15:30:42.674886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.717898+0000","last_change":"2023-06-02T15:30:42.716337+0000","last_active":"2023-06-02T15:30:42.717898+0000","last_peered":"2023-06-02T15:30:42.717898+0000","last_clean":"2023-06-02T15:30:42.717898+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:30:42.717898+0000","last_undegraded":"2023-06-02T15:30:42.717898+0000","last_fullsized":"2023-06-02T15:30:42.717898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665919+0000","last_change":"2023-06-02T15:30:38.651270+0000","last_active":"2023-06-02T15:30:42.665919+0000","last_peered":"2023-06-02T15:30:42.665919+0000","last_clean":"2023-06-02T15:30:42.665919+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:30:42.665919+0000","last_undegraded":"2023-06-02T15:30:42.665919+0000","last_fullsized":"2023-06-02T15:30:42.665919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.667614+0000","last_change":"2023-06-02T15:30:38.277304+0000","last_active":"2023-06-02T15:30:42.667614+0000","last_peered":"2023-06-02T15:30:42.667614+0000","last_clean":"2023-06-02T15:30:42.667614+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:30:42.667614+0000","last_undegraded":"2023-06-02T15:30:42.667614+0000","last_fullsized":"2023-06-02T15:30:42.667614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.694829+0000","last_change":"2023-06-02T15:30:42.692861+0000","last_active":"2023-06-02T15:30:42.694829+0000","last_peered":"2023-06-02T15:30:42.694829+0000","last_clean":"2023-06-02T15:30:42.694829+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:30:42.694829+0000","last_undegraded":"2023-06-02T15:30:42.694829+0000","last_fullsized":"2023-06-02T15:30:42.694829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:29.857375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663612+0000","last_change":"2023-06-02T15:30:38.645534+0000","last_active":"2023-06-02T15:30:42.663612+0000","last_peered":"2023-06-02T15:30:42.663612+0000","last_clean":"2023-06-02T15:30:42.663612+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:30:42.663612+0000","last_undegraded":"2023-06-02T15:30:42.663612+0000","last_fullsized":"2023-06-02T15:30:42.663612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.692193+0000","last_change":"2023-06-02T15:30:38.282239+0000","last_active":"2023-06-02T15:30:42.692193+0000","last_peered":"2023-06-02T15:30:42.692193+0000","last_clean":"2023-06-02T15:30:42.692193+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:30:42.692193+0000","last_undegraded":"2023-06-02T15:30:42.692193+0000","last_fullsized":"2023-06-02T15:30:42.692193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:40.807809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.722484+0000","last_change":"2023-06-02T15:30:42.720849+0000","last_active":"2023-06-02T15:30:42.722484+0000","last_peered":"2023-06-02T15:30:42.722484+0000","last_clean":"2023-06-02T15:30:42.722484+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:30:42.722484+0000","last_undegraded":"2023-06-02T15:30:42.722484+0000","last_fullsized":"2023-06-02T15:30:42.722484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659621+0000","last_change":"2023-06-02T15:30:38.641746+0000","last_active":"2023-06-02T15:30:42.659621+0000","last_peered":"2023-06-02T15:30:42.659621+0000","last_clean":"2023-06-02T15:30:42.659621+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:30:42.659621+0000","last_undegraded":"2023-06-02T15:30:42.659621+0000","last_fullsized":"2023-06-02T15:30:42.659621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681113+0000","last_change":"2023-06-02T15:30:38.282724+0000","last_active":"2023-06-02T15:30:42.681113+0000","last_peered":"2023-06-02T15:30:42.681113+0000","last_clean":"2023-06-02T15:30:42.681113+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:30:42.681113+0000","last_undegraded":"2023-06-02T15:30:42.681113+0000","last_fullsized":"2023-06-02T15:30:42.681113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:21.387209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.701266+0000","last_change":"2023-06-02T15:30:42.697662+0000","last_active":"2023-06-02T15:30:42.701266+0000","last_peered":"2023-06-02T15:30:42.701266+0000","last_clean":"2023-06-02T15:30:42.701266+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:30:42.701266+0000","last_undegraded":"2023-06-02T15:30:42.701266+0000","last_fullsized":"2023-06-02T15:30:42.701266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:19.014996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673369+0000","last_change":"2023-06-02T15:30:38.656950+0000","last_active":"2023-06-02T15:30:42.673369+0000","last_peered":"2023-06-02T15:30:42.673369+0000","last_clean":"2023-06-02T15:30:42.673369+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:30:42.673369+0000","last_undegraded":"2023-06-02T15:30:42.673369+0000","last_fullsized":"2023-06-02T15:30:42.673369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.685248+0000","last_change":"2023-06-02T15:30:38.283602+0000","last_active":"2023-06-02T15:30:42.685248+0000","last_peered":"2023-06-02T15:30:42.685248+0000","last_clean":"2023-06-02T15:30:42.685248+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:30:42.685248+0000","last_undegraded":"2023-06-02T15:30:42.685248+0000","last_fullsized":"2023-06-02T15:30:42.685248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:33.362323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.727005+0000","last_change":"2023-06-02T15:30:42.722884+0000","last_active":"2023-06-02T15:30:42.727005+0000","last_peered":"2023-06-02T15:30:42.727005+0000","last_clean":"2023-06-02T15:30:42.727005+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:30:42.727005+0000","last_undegraded":"2023-06-02T15:30:42.727005+0000","last_fullsized":"2023-06-02T15:30:42.727005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.724350+0000","last_change":"2023-06-02T15:30:42.714188+0000","last_active":"2023-06-02T15:30:42.724350+0000","last_peered":"2023-06-02T15:30:42.724350+0000","last_clean":"2023-06-02T15:30:42.724350+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:30:42.724350+0000","last_undegraded":"2023-06-02T15:30:42.724350+0000","last_fullsized":"2023-06-02T15:30:42.724350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663139+0000","last_change":"2023-06-02T15:30:38.261610+0000","last_active":"2023-06-02T15:30:42.663139+0000","last_peered":"2023-06-02T15:30:42.663139+0000","last_clean":"2023-06-02T15:30:42.663139+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:30:42.663139+0000","last_undegraded":"2023-06-02T15:30:42.663139+0000","last_fullsized":"2023-06-02T15:30:42.663139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674925+0000","last_change":"2023-06-02T15:30:38.658984+0000","last_active":"2023-06-02T15:30:42.674925+0000","last_peered":"2023-06-02T15:30:42.674925+0000","last_clean":"2023-06-02T15:30:42.674925+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:30:42.674925+0000","last_undegraded":"2023-06-02T15:30:42.674925+0000","last_fullsized":"2023-06-02T15:30:42.674925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.712889+0000","last_change":"2023-06-02T15:30:42.705561+0000","last_active":"2023-06-02T15:30:42.712889+0000","last_peered":"2023-06-02T15:30:42.712889+0000","last_clean":"2023-06-02T15:30:42.712889+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:30:42.712889+0000","last_undegraded":"2023-06-02T15:30:42.712889+0000","last_fullsized":"2023-06-02T15:30:42.712889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:39:14.247511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.682004+0000","last_change":"2023-06-02T15:30:38.283796+0000","last_active":"2023-06-02T15:30:42.682004+0000","last_peered":"2023-06-02T15:30:42.682004+0000","last_clean":"2023-06-02T15:30:42.682004+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:30:42.682004+0000","last_undegraded":"2023-06-02T15:30:42.682004+0000","last_fullsized":"2023-06-02T15:30:42.682004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.672736+0000","last_change":"2023-06-02T15:30:38.644966+0000","last_active":"2023-06-02T15:30:42.672736+0000","last_peered":"2023-06-02T15:30:42.672736+0000","last_clean":"2023-06-02T15:30:42.672736+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:30:42.672736+0000","last_undegraded":"2023-06-02T15:30:42.672736+0000","last_fullsized":"2023-06-02T15:30:42.672736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666181+0000","last_change":"2023-06-02T15:30:38.265398+0000","last_active":"2023-06-02T15:30:42.666181+0000","last_peered":"2023-06-02T15:30:42.666181+0000","last_clean":"2023-06-02T15:30:42.666181+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:30:42.666181+0000","last_undegraded":"2023-06-02T15:30:42.666181+0000","last_fullsized":"2023-06-02T15:30:42.666181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:10:29.479149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680142+0000","last_change":"2023-06-02T15:30:38.657999+0000","last_active":"2023-06-02T15:30:42.680142+0000","last_peered":"2023-06-02T15:30:42.680142+0000","last_clean":"2023-06-02T15:30:42.680142+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:30:42.680142+0000","last_undegraded":"2023-06-02T15:30:42.680142+0000","last_fullsized":"2023-06-02T15:30:42.680142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.712989+0000","last_change":"2023-06-02T15:30:42.705725+0000","last_active":"2023-06-02T15:30:42.712989+0000","last_peered":"2023-06-02T15:30:42.712989+0000","last_clean":"2023-06-02T15:30:42.712989+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:30:42.712989+0000","last_undegraded":"2023-06-02T15:30:42.712989+0000","last_fullsized":"2023-06-02T15:30:42.712989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.684274+0000","last_change":"2023-06-02T15:30:38.282095+0000","last_active":"2023-06-02T15:30:42.684274+0000","last_peered":"2023-06-02T15:30:42.684274+0000","last_clean":"2023-06-02T15:30:42.684274+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:30:42.684274+0000","last_undegraded":"2023-06-02T15:30:42.684274+0000","last_fullsized":"2023-06-02T15:30:42.684274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668685+0000","last_change":"2023-06-02T15:30:38.651033+0000","last_active":"2023-06-02T15:30:42.668685+0000","last_peered":"2023-06-02T15:30:42.668685+0000","last_clean":"2023-06-02T15:30:42.668685+0000","last_became_active":"2023-06-02T15:30:38.650698+0000","last_became_peered":"2023-06-02T15:30:38.650698+0000","last_unstale":"2023-06-02T15:30:42.668685+0000","last_undegraded":"2023-06-02T15:30:42.668685+0000","last_fullsized":"2023-06-02T15:30:42.668685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721086+0000","last_change":"2023-06-02T15:30:42.702456+0000","last_active":"2023-06-02T15:30:42.721086+0000","last_peered":"2023-06-02T15:30:42.721086+0000","last_clean":"2023-06-02T15:30:42.721086+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:30:42.721086+0000","last_undegraded":"2023-06-02T15:30:42.721086+0000","last_fullsized":"2023-06-02T15:30:42.721086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663108+0000","last_change":"2023-06-02T15:30:38.637380+0000","last_active":"2023-06-02T15:30:42.663108+0000","last_peered":"2023-06-02T15:30:42.663108+0000","last_clean":"2023-06-02T15:30:42.663108+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:30:42.663108+0000","last_undegraded":"2023-06-02T15:30:42.663108+0000","last_fullsized":"2023-06-02T15:30:42.663108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666409+0000","last_change":"2023-06-02T15:30:38.655074+0000","last_active":"2023-06-02T15:30:42.666409+0000","last_peered":"2023-06-02T15:30:42.666409+0000","last_clean":"2023-06-02T15:30:42.666409+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:30:42.666409+0000","last_undegraded":"2023-06-02T15:30:42.666409+0000","last_fullsized":"2023-06-02T15:30:42.666409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661310+0000","last_change":"2023-06-02T15:30:38.637979+0000","last_active":"2023-06-02T15:30:42.661310+0000","last_peered":"2023-06-02T15:30:42.661310+0000","last_clean":"2023-06-02T15:30:42.661310+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:30:42.661310+0000","last_undegraded":"2023-06-02T15:30:42.661310+0000","last_fullsized":"2023-06-02T15:30:42.661310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674658+0000","last_change":"2023-06-02T15:30:38.659430+0000","last_active":"2023-06-02T15:30:42.674658+0000","last_peered":"2023-06-02T15:30:42.674658+0000","last_clean":"2023-06-02T15:30:42.674658+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:30:42.674658+0000","last_undegraded":"2023-06-02T15:30:42.674658+0000","last_fullsized":"2023-06-02T15:30:42.674658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679154+0000","last_change":"2023-06-02T15:30:38.656408+0000","last_active":"2023-06-02T15:30:42.679154+0000","last_peered":"2023-06-02T15:30:42.679154+0000","last_clean":"2023-06-02T15:30:42.679154+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:30:42.679154+0000","last_undegraded":"2023-06-02T15:30:42.679154+0000","last_fullsized":"2023-06-02T15:30:42.679154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679939+0000","last_change":"2023-06-02T15:30:38.658103+0000","last_active":"2023-06-02T15:30:42.679939+0000","last_peered":"2023-06-02T15:30:42.679939+0000","last_clean":"2023-06-02T15:30:42.679939+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:30:42.679939+0000","last_undegraded":"2023-06-02T15:30:42.679939+0000","last_fullsized":"2023-06-02T15:30:42.679939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678672+0000","last_change":"2023-06-02T15:30:38.641657+0000","last_active":"2023-06-02T15:30:42.678672+0000","last_peered":"2023-06-02T15:30:42.678672+0000","last_clean":"2023-06-02T15:30:42.678672+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:30:42.678672+0000","last_undegraded":"2023-06-02T15:30:42.678672+0000","last_fullsized":"2023-06-02T15:30:42.678672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:22.309633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678899+0000","last_change":"2023-06-02T15:30:38.640289+0000","last_active":"2023-06-02T15:30:42.678899+0000","last_peered":"2023-06-02T15:30:42.678899+0000","last_clean":"2023-06-02T15:30:42.678899+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:30:42.678899+0000","last_undegraded":"2023-06-02T15:30:42.678899+0000","last_fullsized":"2023-06-02T15:30:42.678899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687086+0000","last_change":"2023-06-02T15:30:38.656963+0000","last_active":"2023-06-02T15:30:42.687086+0000","last_peered":"2023-06-02T15:30:42.687086+0000","last_clean":"2023-06-02T15:30:42.687086+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:30:42.687086+0000","last_undegraded":"2023-06-02T15:30:42.687086+0000","last_fullsized":"2023-06-02T15:30:42.687086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666294+0000","last_change":"2023-06-02T15:30:38.648546+0000","last_active":"2023-06-02T15:30:42.666294+0000","last_peered":"2023-06-02T15:30:42.666294+0000","last_clean":"2023-06-02T15:30:42.666294+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:30:42.666294+0000","last_undegraded":"2023-06-02T15:30:42.666294+0000","last_fullsized":"2023-06-02T15:30:42.666294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666007+0000","last_change":"2023-06-02T15:30:38.643407+0000","last_active":"2023-06-02T15:30:42.666007+0000","last_peered":"2023-06-02T15:30:42.666007+0000","last_clean":"2023-06-02T15:30:42.666007+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:30:42.666007+0000","last_undegraded":"2023-06-02T15:30:42.666007+0000","last_fullsized":"2023-06-02T15:30:42.666007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.684038+0000","last_change":"2023-06-02T15:30:38.657038+0000","last_active":"2023-06-02T15:30:42.684038+0000","last_peered":"2023-06-02T15:30:42.684038+0000","last_clean":"2023-06-02T15:30:42.684038+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:30:42.684038+0000","last_undegraded":"2023-06-02T15:30:42.684038+0000","last_fullsized":"2023-06-02T15:30:42.684038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663138+0000","last_change":"2023-06-02T15:30:38.638594+0000","last_active":"2023-06-02T15:30:42.663138+0000","last_peered":"2023-06-02T15:30:42.663138+0000","last_clean":"2023-06-02T15:30:42.663138+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:30:42.663138+0000","last_undegraded":"2023-06-02T15:30:42.663138+0000","last_fullsized":"2023-06-02T15:30:42.663138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:28.604626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.654344+0000","last_change":"2023-06-02T15:30:38.638252+0000","last_active":"2023-06-02T15:30:42.654344+0000","last_peered":"2023-06-02T15:30:42.654344+0000","last_clean":"2023-06-02T15:30:42.654344+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:30:42.654344+0000","last_undegraded":"2023-06-02T15:30:42.654344+0000","last_fullsized":"2023-06-02T15:30:42.654344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:24.550049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665765+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:30:42.665765+0000","last_peered":"2023-06-02T15:30:42.665765+0000","last_clean":"2023-06-02T15:30:42.665765+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:30:42.665765+0000","last_undegraded":"2023-06-02T15:30:42.665765+0000","last_fullsized":"2023-06-02T15:30:42.665765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:14.924133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669090+0000","last_change":"2023-06-02T15:30:38.639262+0000","last_active":"2023-06-02T15:30:42.669090+0000","last_peered":"2023-06-02T15:30:42.669090+0000","last_clean":"2023-06-02T15:30:42.669090+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:30:42.669090+0000","last_undegraded":"2023-06-02T15:30:42.669090+0000","last_fullsized":"2023-06-02T15:30:42.669090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659193+0000","last_change":"2023-06-02T15:30:38.636435+0000","last_active":"2023-06-02T15:30:42.659193+0000","last_peered":"2023-06-02T15:30:42.659193+0000","last_clean":"2023-06-02T15:30:42.659193+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:30:42.659193+0000","last_undegraded":"2023-06-02T15:30:42.659193+0000","last_fullsized":"2023-06-02T15:30:42.659193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:41:54.216725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681786+0000","last_change":"2023-06-02T15:30:38.659341+0000","last_active":"2023-06-02T15:30:42.681786+0000","last_peered":"2023-06-02T15:30:42.681786+0000","last_clean":"2023-06-02T15:30:42.681786+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:30:42.681786+0000","last_undegraded":"2023-06-02T15:30:42.681786+0000","last_fullsized":"2023-06-02T15:30:42.681786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.671862+0000","last_change":"2023-06-02T15:30:38.636138+0000","last_active":"2023-06-02T15:30:42.671862+0000","last_peered":"2023-06-02T15:30:42.671862+0000","last_clean":"2023-06-02T15:30:42.671862+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:30:42.671862+0000","last_undegraded":"2023-06-02T15:30:42.671862+0000","last_fullsized":"2023-06-02T15:30:42.671862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.654567+0000","last_change":"2023-06-02T15:30:38.645755+0000","last_active":"2023-06-02T15:30:42.654567+0000","last_peered":"2023-06-02T15:30:42.654567+0000","last_clean":"2023-06-02T15:30:42.654567+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:30:42.654567+0000","last_undegraded":"2023-06-02T15:30:42.654567+0000","last_fullsized":"2023-06-02T15:30:42.654567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:40.298901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.653573+0000","last_change":"2023-06-02T15:30:38.644641+0000","last_active":"2023-06-02T15:30:42.653573+0000","last_peered":"2023-06-02T15:30:42.653573+0000","last_clean":"2023-06-02T15:30:42.653573+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:30:42.653573+0000","last_undegraded":"2023-06-02T15:30:42.653573+0000","last_fullsized":"2023-06-02T15:30:42.653573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:14.588404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663449+0000","last_change":"2023-06-02T15:30:38.650928+0000","last_active":"2023-06-02T15:30:42.663449+0000","last_peered":"2023-06-02T15:30:42.663449+0000","last_clean":"2023-06-02T15:30:42.663449+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:30:42.663449+0000","last_undegraded":"2023-06-02T15:30:42.663449+0000","last_fullsized":"2023-06-02T15:30:42.663449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.676823+0000","last_change":"2023-06-02T15:30:38.640368+0000","last_active":"2023-06-02T15:30:42.676823+0000","last_peered":"2023-06-02T15:30:42.676823+0000","last_clean":"2023-06-02T15:30:42.676823+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:30:42.676823+0000","last_undegraded":"2023-06-02T15:30:42.676823+0000","last_fullsized":"2023-06-02T15:30:42.676823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668907+0000","last_change":"2023-06-02T15:30:38.639440+0000","last_active":"2023-06-02T15:30:42.668907+0000","last_peered":"2023-06-02T15:30:42.668907+0000","last_clean":"2023-06-02T15:30:42.668907+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:30:42.668907+0000","last_undegraded":"2023-06-02T15:30:42.668907+0000","last_fullsized":"2023-06-02T15:30:42.668907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673165+0000","last_change":"2023-06-02T15:30:38.647961+0000","last_active":"2023-06-02T15:30:42.673165+0000","last_peered":"2023-06-02T15:30:42.673165+0000","last_clean":"2023-06-02T15:30:42.673165+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:30:42.673165+0000","last_undegraded":"2023-06-02T15:30:42.673165+0000","last_fullsized":"2023-06-02T15:30:42.673165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681575+0000","last_change":"2023-06-02T15:30:38.659299+0000","last_active":"2023-06-02T15:30:42.681575+0000","last_peered":"2023-06-02T15:30:42.681575+0000","last_clean":"2023-06-02T15:30:42.681575+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:30:42.681575+0000","last_undegraded":"2023-06-02T15:30:42.681575+0000","last_fullsized":"2023-06-02T15:30:42.681575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661036+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:30:42.661036+0000","last_peered":"2023-06-02T15:30:42.661036+0000","last_clean":"2023-06-02T15:30:42.661036+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:30:42.661036+0000","last_undegraded":"2023-06-02T15:30:42.661036+0000","last_fullsized":"2023-06-02T15:30:42.661036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:15:27.850958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666520+0000","last_change":"2023-06-02T15:30:38.639043+0000","last_active":"2023-06-02T15:30:42.666520+0000","last_peered":"2023-06-02T15:30:42.666520+0000","last_clean":"2023-06-02T15:30:42.666520+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:30:42.666520+0000","last_undegraded":"2023-06-02T15:30:42.666520+0000","last_fullsized":"2023-06-02T15:30:42.666520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663732+0000","last_change":"2023-06-02T15:30:38.637413+0000","last_active":"2023-06-02T15:30:42.663732+0000","last_peered":"2023-06-02T15:30:42.663732+0000","last_clean":"2023-06-02T15:30:42.663732+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:30:42.663732+0000","last_undegraded":"2023-06-02T15:30:42.663732+0000","last_fullsized":"2023-06-02T15:30:42.663732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:22.390984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659962+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:30:42.659962+0000","last_peered":"2023-06-02T15:30:42.659962+0000","last_clean":"2023-06-02T15:30:42.659962+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:30:42.659962+0000","last_undegraded":"2023-06-02T15:30:42.659962+0000","last_fullsized":"2023-06-02T15:30:42.659962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:17:55.191725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.676939+0000","last_change":"2023-06-02T15:30:38.650591+0000","last_active":"2023-06-02T15:30:42.676939+0000","last_peered":"2023-06-02T15:30:42.676939+0000","last_clean":"2023-06-02T15:30:42.676939+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:30:42.676939+0000","last_undegraded":"2023-06-02T15:30:42.676939+0000","last_fullsized":"2023-06-02T15:30:42.676939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.655693+0000","last_change":"2023-06-02T15:30:38.639026+0000","last_active":"2023-06-02T15:30:42.655693+0000","last_peered":"2023-06-02T15:30:42.655693+0000","last_clean":"2023-06-02T15:30:42.655693+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:30:42.655693+0000","last_undegraded":"2023-06-02T15:30:42.655693+0000","last_fullsized":"2023-06-02T15:30:42.655693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:49.394624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4526,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9128,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362712,"statfs":{"total":96636764160,"available":96627417088,"internally_reserved":0,"allocated":360448,"data_stored":704090,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8524,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363316,"statfs":{"total":96636764160,"available":96628035584,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8528,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363312,"statfs":{"total":96636764160,"available":96628031488,"internally_reserved":0,"allocated":270336,"data_stored":109412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8608,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363232,"statfs":{"total":96636764160,"available":96627949568,"internally_reserved":0,"allocated":286720,"data_stored":113562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8528,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363312,"statfs":{"total":96636764160,"available":96628031488,"internally_reserved":0,"allocated":270336,"data_stored":109852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8460,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363380,"statfs":{"total":96636764160,"available":96628101120,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9100,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362740,"statfs":{"total":96636764160,"available":96627445760,"internally_reserved":0,"allocated":331776,"data_stored":700130,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8588,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363252,"statfs":{"total":96636764160,"available":96627970048,"internally_reserved":0,"allocated":266240,"data_stored":109342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:31:01.490 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:31:01.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.626+0000 7fc83b8b6640 1 Processor -- start 2023-06-02T15:31:01.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc83b8b6640 1 -- start start 2023-06-02T15:31:01.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc83b8b6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8340bb0e0 0x7fc83414e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc83b8b6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc834070070 con 0x7fc8340bac60 2023-06-02T15:31:01.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc83b8b6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8340702e0 con 0x7fc8340713b0 2023-06-02T15:31:01.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc83b8b6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8340709a0 con 0x7fc8340bb0e0 2023-06-02T15:31:01.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc839e53640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc8340bac60 0x7fc83414ec60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56070/0 (socket says 172.21.15.78:56070) 2023-06-02T15:31:01.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc839e53640 1 -- 172.21.15.78:0/3843141089 learned_addr learned my addr 172.21.15.78:0/3843141089 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc838e51640 1 --2- 172.21.15.78:0/3843141089 >> v2:172.21.15.132:3300/0 conn(0x7fc8340bb0e0 0x7fc83414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 191307897 0 0) 0x7fc834070070 con 0x7fc8340bac60 2023-06-02T15:31:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc820003530 con 0x7fc8340bac60 2023-06-02T15:31:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230046689 0 0) 0x7fc820003530 con 0x7fc8340bac60 2023-06-02T15:31:01.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 >> v2:172.21.15.132:3300/0 conn(0x7fc8340bb0e0 msgr2=0x7fc83414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:01.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 --2- 172.21.15.78:0/3843141089 >> v2:172.21.15.132:3300/0 conn(0x7fc8340bb0e0 0x7fc83414e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 >> v1:172.21.15.132:6789/0 conn(0x7fc8340713b0 legacy=0x7fc83414b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340705c0 con 0x7fc8340bac60 2023-06-02T15:31:01.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fc82c001a20 con 0x7fc8340bac60 2023-06-02T15:31:01.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 >> v1:172.21.15.78:6789/0 conn(0x7fc8340bac60 legacy=0x7fc83414ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc820003980 0x7fc820003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8200047d0 0x7fc820004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc820005180 0x7fc82000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340709a0 con 0x7fc820003980 2023-06-02T15:31:01.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc82000c000 con 0x7fc8200047d0 2023-06-02T15:31:01.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc82000c1c0 con 0x7fc820005180 2023-06-02T15:31:01.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc839652640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc820003980 0x7fc820003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc838e51640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8200047d0 0x7fc820004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc839e53640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc820005180 0x7fc82000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc839652640 1 -- 172.21.15.78:0/3843141089 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc820005180 msgr2=0x7fc82000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc839652640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc820005180 0x7fc82000b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc839652640 1 -- 172.21.15.78:0/3843141089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8200047d0 msgr2=0x7fc820004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc839652640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8200047d0 0x7fc820004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc839e53640 1 -- 172.21.15.78:0/3843141089 reap_dead start 2023-06-02T15:31:01.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.630+0000 7fc839652640 1 -- 172.21.15.78:0/3843141089 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc820003530 con 0x7fc820003980 2023-06-02T15:31:01.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839652640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc820003980 0x7fc820003d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc828001780 tx=0x7fc82801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de246b8cd993b21c server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:01.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8280052d0 con 0x7fc820003980 2023-06-02T15:31:01.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8280a7050 con 0x7fc820003980 2023-06-02T15:31:01.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc827fff640 1 -- 172.21.15.78:0/3843141089 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828003600 con 0x7fc820003980 2023-06-02T15:31:01.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3843141089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc820003980 msgr2=0x7fc820003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc820003980 0x7fc820003d90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc828001780 tx=0x7fc82801c3e0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3843141089 shutdown_connections 2023-06-02T15:31:01.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 --2- 172.21.15.78:0/3843141089 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc820003980 0x7fc820003d90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3843141089 >> 172.21.15.78:0/3843141089 conn(0x7fc8340bd920 msgr2=0x7fc8340bdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3843141089 shutdown_connections 2023-06-02T15:31:01.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3843141089 wait complete. 2023-06-02T15:31:01.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 Processor -- start 2023-06-02T15:31:01.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- start start 2023-06-02T15:31:01.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc820003980 0x7fc8340bfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8341e9b80 0x7fc834144980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc834147e20 0x7fc834142600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340c0bd0 con 0x7fc834147e20 2023-06-02T15:31:01.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834147990 con 0x7fc8341e9b80 2023-06-02T15:31:01.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8341e9fd0 con 0x7fc820003980 2023-06-02T15:31:01.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839e53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc834147e20 0x7fc834142600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839e53640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc834147e20 0x7fc834142600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57956/0 (socket says 172.21.15.78:57956) 2023-06-02T15:31:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839e53640 1 -- 172.21.15.78:0/3281354814 learned_addr learned my addr 172.21.15.78:0/3281354814 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc838e51640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8341e9b80 0x7fc834144980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839652640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc820003980 0x7fc8340bfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839e53640 1 -- 172.21.15.78:0/3281354814 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc820003980 msgr2=0x7fc8340bfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839e53640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc820003980 0x7fc8340bfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839e53640 1 -- 172.21.15.78:0/3281354814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8341e9b80 msgr2=0x7fc834144980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839e53640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8341e9b80 0x7fc834144980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839e53640 1 -- 172.21.15.78:0/3281354814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83414c0a0 con 0x7fc834147e20 2023-06-02T15:31:01.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839652640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc820003980 0x7fc8340bfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:01.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc839e53640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc834147e20 0x7fc834142600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0013e0 tx=0x7fc82c002030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:01.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc825ffb640 1 -- 172.21.15.78:0/3281354814 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c007190 con 0x7fc834147e20 2023-06-02T15:31:01.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc825ffb640 1 -- 172.21.15.78:0/3281354814 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c0072f0 con 0x7fc834147e20 2023-06-02T15:31:01.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3281354814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83414bf10 con 0x7fc834147e20 2023-06-02T15:31:01.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc825ffb640 1 -- 172.21.15.78:0/3281354814 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c0076a0 con 0x7fc834147e20 2023-06-02T15:31:01.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.634+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3281354814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83414e720 con 0x7fc834147e20 2023-06-02T15:31:01.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.638+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3281354814 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc834147b40 con 0x7fc834147e20 2023-06-02T15:31:01.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.638+0000 7fc825ffb640 1 -- 172.21.15.78:0/3281354814 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fc82c007800 con 0x7fc834147e20 2023-06-02T15:31:01.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.638+0000 7fc825ffb640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc818065c00 0x7fc8180680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.638+0000 7fc825ffb640 1 -- 172.21.15.78:0/3281354814 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc82c083180 con 0x7fc834147e20 2023-06-02T15:31:01.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.638+0000 7fc839652640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc818065c00 0x7fc8180680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.638+0000 7fc839652640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc818065c00 0x7fc8180680b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc828001750 tx=0x7fc8280011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:01.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.642+0000 7fc825ffb640 1 -- 172.21.15.78:0/3281354814 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fc834147b40 con 0x7fc834147e20 2023-06-02T15:31:01.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.778+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3281354814 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc834073bf0 con 0x7fc818065c00 2023-06-02T15:31:01.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.806+0000 7fc825ffb640 1 -- 172.21.15.78:0/3281354814 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367484 (secure 0 0 0) 0x7fc834073bf0 con 0x7fc818065c00 2023-06-02T15:31:01.815 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:01.819 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:31:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3281354814 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc818065c00 msgr2=0x7fc8180680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc818065c00 0x7fc8180680b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc828001750 tx=0x7fc8280011a0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3281354814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc834147e20 msgr2=0x7fc834142600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc834147e20 0x7fc834142600 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc82c0013e0 tx=0x7fc82c002030 comp rx=0 tx=0).stop 2023-06-02T15:31:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3281354814 shutdown_connections 2023-06-02T15:31:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc818065c00 0x7fc8180680b0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc834147e20 0x7fc834142600 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8341e9b80 0x7fc834144980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 --2- 172.21.15.78:0/3281354814 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc820003980 0x7fc8340bfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3281354814 >> 172.21.15.78:0/3281354814 conn(0x7fc8340bd920 msgr2=0x7fc8340bdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3281354814 shutdown_connections 2023-06-02T15:31:01.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.810+0000 7fc83b8b6640 1 -- 172.21.15.78:0/3281354814 wait complete. 2023-06-02T15:31:01.835 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2023-06-02T15:31:01.230710+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594894,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69464,"kb_used_data":2264,"kb_used_omap":0,"kb_used_meta":67136,"kb_avail":754905256,"statfs":{"total":773094113280,"available":773022982144,"internally_reserved":0,"allocated":2318336,"data_stored":2065912,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68747264},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1749,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009534"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.713456+0000","last_change":"2023-06-02T15:30:42.711237+0000","last_active":"2023-06-02T15:30:42.713456+0000","last_peered":"2023-06-02T15:30:42.713456+0000","last_clean":"2023-06-02T15:30:42.713456+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:30:42.713456+0000","last_undegraded":"2023-06-02T15:30:42.713456+0000","last_fullsized":"2023-06-02T15:30:42.713456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669011+0000","last_change":"2023-06-02T15:30:38.275721+0000","last_active":"2023-06-02T15:30:42.669011+0000","last_peered":"2023-06-02T15:30:42.669011+0000","last_clean":"2023-06-02T15:30:42.669011+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:30:42.669011+0000","last_undegraded":"2023-06-02T15:30:42.669011+0000","last_fullsized":"2023-06-02T15:30:42.669011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659411+0000","last_change":"2023-06-02T15:30:38.638911+0000","last_active":"2023-06-02T15:30:42.659411+0000","last_peered":"2023-06-02T15:30:42.659411+0000","last_clean":"2023-06-02T15:30:42.659411+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:30:42.659411+0000","last_undegraded":"2023-06-02T15:30:42.659411+0000","last_fullsized":"2023-06-02T15:30:42.659411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.709825+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:30:42.709825+0000","last_peered":"2023-06-02T15:30:42.709825+0000","last_clean":"2023-06-02T15:30:42.709825+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:30:42.709825+0000","last_undegraded":"2023-06-02T15:30:42.709825+0000","last_fullsized":"2023-06-02T15:30:42.709825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:23:12.455644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674342+0000","last_change":"2023-06-02T15:30:38.282116+0000","last_active":"2023-06-02T15:30:42.674342+0000","last_peered":"2023-06-02T15:30:42.674342+0000","last_clean":"2023-06-02T15:30:42.674342+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:30:42.674342+0000","last_undegraded":"2023-06-02T15:30:42.674342+0000","last_fullsized":"2023-06-02T15:30:42.674342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666523+0000","last_change":"2023-06-02T15:30:38.638342+0000","last_active":"2023-06-02T15:30:42.666523+0000","last_peered":"2023-06-02T15:30:42.666523+0000","last_clean":"2023-06-02T15:30:42.666523+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:30:42.666523+0000","last_undegraded":"2023-06-02T15:30:42.666523+0000","last_fullsized":"2023-06-02T15:30:42.666523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.724432+0000","last_change":"2023-06-02T15:30:42.715416+0000","last_active":"2023-06-02T15:30:42.724432+0000","last_peered":"2023-06-02T15:30:42.724432+0000","last_clean":"2023-06-02T15:30:42.724432+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:30:42.724432+0000","last_undegraded":"2023-06-02T15:30:42.724432+0000","last_fullsized":"2023-06-02T15:30:42.724432+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680371+0000","last_change":"2023-06-02T15:30:38.278973+0000","last_active":"2023-06-02T15:30:42.680371+0000","last_peered":"2023-06-02T15:30:42.680371+0000","last_clean":"2023-06-02T15:30:42.680371+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:30:42.680371+0000","last_undegraded":"2023-06-02T15:30:42.680371+0000","last_fullsized":"2023-06-02T15:30:42.680371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661168+0000","last_change":"2023-06-02T15:30:38.644549+0000","last_active":"2023-06-02T15:30:42.661168+0000","last_peered":"2023-06-02T15:30:42.661168+0000","last_clean":"2023-06-02T15:30:42.661168+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:30:42.661168+0000","last_undegraded":"2023-06-02T15:30:42.661168+0000","last_fullsized":"2023-06-02T15:30:42.661168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:26.088195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725079+0000","last_change":"2023-06-02T15:30:42.707090+0000","last_active":"2023-06-02T15:30:42.725079+0000","last_peered":"2023-06-02T15:30:42.725079+0000","last_clean":"2023-06-02T15:30:42.725079+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:30:42.725079+0000","last_undegraded":"2023-06-02T15:30:42.725079+0000","last_fullsized":"2023-06-02T15:30:42.725079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.667871+0000","last_change":"2023-06-02T15:30:38.269876+0000","last_active":"2023-06-02T15:30:42.667871+0000","last_peered":"2023-06-02T15:30:42.667871+0000","last_clean":"2023-06-02T15:30:42.667871+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:30:42.667871+0000","last_undegraded":"2023-06-02T15:30:42.667871+0000","last_fullsized":"2023-06-02T15:30:42.667871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661361+0000","last_change":"2023-06-02T15:30:38.639635+0000","last_active":"2023-06-02T15:30:42.661361+0000","last_peered":"2023-06-02T15:30:42.661361+0000","last_clean":"2023-06-02T15:30:42.661361+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:30:42.661361+0000","last_undegraded":"2023-06-02T15:30:42.661361+0000","last_fullsized":"2023-06-02T15:30:42.661361+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:56:57.260064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.702939+0000","last_change":"2023-06-02T15:30:42.699623+0000","last_active":"2023-06-02T15:30:42.702939+0000","last_peered":"2023-06-02T15:30:42.702939+0000","last_clean":"2023-06-02T15:30:42.702939+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:30:42.702939+0000","last_undegraded":"2023-06-02T15:30:42.702939+0000","last_fullsized":"2023-06-02T15:30:42.702939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:18.327051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668971+0000","last_change":"2023-06-02T15:30:38.263534+0000","last_active":"2023-06-02T15:30:42.668971+0000","last_peered":"2023-06-02T15:30:42.668971+0000","last_clean":"2023-06-02T15:30:42.668971+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:30:42.668971+0000","last_undegraded":"2023-06-02T15:30:42.668971+0000","last_fullsized":"2023-06-02T15:30:42.668971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.653780+0000","last_change":"2023-06-02T15:30:38.644102+0000","last_active":"2023-06-02T15:30:42.653780+0000","last_peered":"2023-06-02T15:30:42.653780+0000","last_clean":"2023-06-02T15:30:42.653780+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:30:42.653780+0000","last_undegraded":"2023-06-02T15:30:42.653780+0000","last_fullsized":"2023-06-02T15:30:42.653780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:11.864794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.709755+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:30:42.709755+0000","last_peered":"2023-06-02T15:30:42.709755+0000","last_clean":"2023-06-02T15:30:42.709755+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:30:42.709755+0000","last_undegraded":"2023-06-02T15:30:42.709755+0000","last_fullsized":"2023-06-02T15:30:42.709755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:16:13.363523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661437+0000","last_change":"2023-06-02T15:30:38.272143+0000","last_active":"2023-06-02T15:30:42.661437+0000","last_peered":"2023-06-02T15:30:42.661437+0000","last_clean":"2023-06-02T15:30:42.661437+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:30:42.661437+0000","last_undegraded":"2023-06-02T15:30:42.661437+0000","last_fullsized":"2023-06-02T15:30:42.661437+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673969+0000","last_change":"2023-06-02T15:30:38.650795+0000","last_active":"2023-06-02T15:30:42.673969+0000","last_peered":"2023-06-02T15:30:42.673969+0000","last_clean":"2023-06-02T15:30:42.673969+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:30:42.673969+0000","last_undegraded":"2023-06-02T15:30:42.673969+0000","last_fullsized":"2023-06-02T15:30:42.673969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725571+0000","last_change":"2023-06-02T15:30:42.706975+0000","last_active":"2023-06-02T15:30:42.725571+0000","last_peered":"2023-06-02T15:30:42.725571+0000","last_clean":"2023-06-02T15:30:42.725571+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:30:42.725571+0000","last_undegraded":"2023-06-02T15:30:42.725571+0000","last_fullsized":"2023-06-02T15:30:42.725571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:32.007544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675638+0000","last_change":"2023-06-02T15:30:38.290129+0000","last_active":"2023-06-02T15:30:42.675638+0000","last_peered":"2023-06-02T15:30:42.675638+0000","last_clean":"2023-06-02T15:30:42.675638+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:30:42.675638+0000","last_undegraded":"2023-06-02T15:30:42.675638+0000","last_fullsized":"2023-06-02T15:30:42.675638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.670451+0000","last_change":"2023-06-02T15:30:38.656679+0000","last_active":"2023-06-02T15:30:42.670451+0000","last_peered":"2023-06-02T15:30:42.670451+0000","last_clean":"2023-06-02T15:30:42.670451+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:30:42.670451+0000","last_undegraded":"2023-06-02T15:30:42.670451+0000","last_fullsized":"2023-06-02T15:30:42.670451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.707868+0000","last_change":"2023-06-02T15:30:42.705633+0000","last_active":"2023-06-02T15:30:42.707868+0000","last_peered":"2023-06-02T15:30:42.707868+0000","last_clean":"2023-06-02T15:30:42.707868+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:30:42.707868+0000","last_undegraded":"2023-06-02T15:30:42.707868+0000","last_fullsized":"2023-06-02T15:30:42.707868+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674076+0000","last_change":"2023-06-02T15:30:38.273154+0000","last_active":"2023-06-02T15:30:42.674076+0000","last_peered":"2023-06-02T15:30:42.674076+0000","last_clean":"2023-06-02T15:30:42.674076+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:30:42.674076+0000","last_undegraded":"2023-06-02T15:30:42.674076+0000","last_fullsized":"2023-06-02T15:30:42.674076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665225+0000","last_change":"2023-06-02T15:30:38.647445+0000","last_active":"2023-06-02T15:30:42.665225+0000","last_peered":"2023-06-02T15:30:42.665225+0000","last_clean":"2023-06-02T15:30:42.665225+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:30:42.665225+0000","last_undegraded":"2023-06-02T15:30:42.665225+0000","last_fullsized":"2023-06-02T15:30:42.665225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:34.366098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675284+0000","last_change":"2023-06-02T15:30:38.650927+0000","last_active":"2023-06-02T15:30:42.675284+0000","last_peered":"2023-06-02T15:30:42.675284+0000","last_clean":"2023-06-02T15:30:42.675284+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:30:42.675284+0000","last_undegraded":"2023-06-02T15:30:42.675284+0000","last_fullsized":"2023-06-02T15:30:42.675284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669099+0000","last_change":"2023-06-02T15:30:38.274472+0000","last_active":"2023-06-02T15:30:42.669099+0000","last_peered":"2023-06-02T15:30:42.669099+0000","last_clean":"2023-06-02T15:30:42.669099+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:30:42.669099+0000","last_undegraded":"2023-06-02T15:30:42.669099+0000","last_fullsized":"2023-06-02T15:30:42.669099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725651+0000","last_change":"2023-06-02T15:30:42.710065+0000","last_active":"2023-06-02T15:30:42.725651+0000","last_peered":"2023-06-02T15:30:42.725651+0000","last_clean":"2023-06-02T15:30:42.725651+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:30:42.725651+0000","last_undegraded":"2023-06-02T15:30:42.725651+0000","last_fullsized":"2023-06-02T15:30:42.725651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666632+0000","last_change":"2023-06-02T15:30:38.656769+0000","last_active":"2023-06-02T15:30:42.666632+0000","last_peered":"2023-06-02T15:30:42.666632+0000","last_clean":"2023-06-02T15:30:42.666632+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:30:42.666632+0000","last_undegraded":"2023-06-02T15:30:42.666632+0000","last_fullsized":"2023-06-02T15:30:42.666632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.677097+0000","last_change":"2023-06-02T15:30:38.275134+0000","last_active":"2023-06-02T15:30:42.677097+0000","last_peered":"2023-06-02T15:30:42.677097+0000","last_clean":"2023-06-02T15:30:42.677097+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:30:42.677097+0000","last_undegraded":"2023-06-02T15:30:42.677097+0000","last_fullsized":"2023-06-02T15:30:42.677097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.725199+0000","last_change":"2023-06-02T15:30:42.706722+0000","last_active":"2023-06-02T15:30:42.725199+0000","last_peered":"2023-06-02T15:30:42.725199+0000","last_clean":"2023-06-02T15:30:42.725199+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:30:42.725199+0000","last_undegraded":"2023-06-02T15:30:42.725199+0000","last_fullsized":"2023-06-02T15:30:42.725199+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.693560+0000","last_change":"2023-06-02T15:30:38.289736+0000","last_active":"2023-06-02T15:30:42.693560+0000","last_peered":"2023-06-02T15:30:42.693560+0000","last_clean":"2023-06-02T15:30:42.693560+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:30:42.693560+0000","last_undegraded":"2023-06-02T15:30:42.693560+0000","last_fullsized":"2023-06-02T15:30:42.693560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:43:04.205096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675744+0000","last_change":"2023-06-02T15:30:38.642841+0000","last_active":"2023-06-02T15:30:42.675744+0000","last_peered":"2023-06-02T15:30:42.675744+0000","last_clean":"2023-06-02T15:30:42.675744+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:30:42.675744+0000","last_undegraded":"2023-06-02T15:30:42.675744+0000","last_fullsized":"2023-06-02T15:30:42.675744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.722145+0000","last_change":"2023-06-02T15:30:42.720577+0000","last_active":"2023-06-02T15:30:42.722145+0000","last_peered":"2023-06-02T15:30:42.722145+0000","last_clean":"2023-06-02T15:30:42.722145+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:30:42.722145+0000","last_undegraded":"2023-06-02T15:30:42.722145+0000","last_fullsized":"2023-06-02T15:30:42.722145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:48:54.291389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"25'9","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-02T15:30:47.961093+0000","last_change":"2023-06-02T15:30:38.276703+0000","last_active":"2023-06-02T15:30:47.961093+0000","last_peered":"2023-06-02T15:30:47.961093+0000","last_clean":"2023-06-02T15:30:47.961093+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:30:47.961093+0000","last_undegraded":"2023-06-02T15:30:47.961093+0000","last_fullsized":"2023-06-02T15:30:47.961093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3744,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661581+0000","last_change":"2023-06-02T15:30:38.634436+0000","last_active":"2023-06-02T15:30:42.661581+0000","last_peered":"2023-06-02T15:30:42.661581+0000","last_clean":"2023-06-02T15:30:42.661581+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:30:42.661581+0000","last_undegraded":"2023-06-02T15:30:42.661581+0000","last_fullsized":"2023-06-02T15:30:42.661581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.710264+0000","last_change":"2023-06-02T15:30:42.707445+0000","last_active":"2023-06-02T15:30:42.710264+0000","last_peered":"2023-06-02T15:30:42.710264+0000","last_clean":"2023-06-02T15:30:42.710264+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:30:42.710264+0000","last_undegraded":"2023-06-02T15:30:42.710264+0000","last_fullsized":"2023-06-02T15:30:42.710264+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675836+0000","last_change":"2023-06-02T15:30:38.649326+0000","last_active":"2023-06-02T15:30:42.675836+0000","last_peered":"2023-06-02T15:30:42.675836+0000","last_clean":"2023-06-02T15:30:42.675836+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:30:42.675836+0000","last_undegraded":"2023-06-02T15:30:42.675836+0000","last_fullsized":"2023-06-02T15:30:42.675836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665271+0000","last_change":"2023-06-02T15:30:33.407154+0000","last_active":"2023-06-02T15:30:42.665271+0000","last_peered":"2023-06-02T15:30:42.665271+0000","last_clean":"2023-06-02T15:30:42.665271+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:30:42.665271+0000","last_undegraded":"2023-06-02T15:30:42.665271+0000","last_fullsized":"2023-06-02T15:30:42.665271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680583+0000","last_change":"2023-06-02T15:30:38.279321+0000","last_active":"2023-06-02T15:30:42.680583+0000","last_peered":"2023-06-02T15:30:42.680583+0000","last_clean":"2023-06-02T15:30:42.680583+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:30:42.680583+0000","last_undegraded":"2023-06-02T15:30:42.680583+0000","last_fullsized":"2023-06-02T15:30:42.680583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.717152+0000","last_change":"2023-06-02T15:30:42.715780+0000","last_active":"2023-06-02T15:30:42.717152+0000","last_peered":"2023-06-02T15:30:42.717152+0000","last_clean":"2023-06-02T15:30:42.717152+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:30:42.717152+0000","last_undegraded":"2023-06-02T15:30:42.717152+0000","last_fullsized":"2023-06-02T15:30:42.717152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668772+0000","last_change":"2023-06-02T15:30:38.632171+0000","last_active":"2023-06-02T15:30:42.668772+0000","last_peered":"2023-06-02T15:30:42.668772+0000","last_clean":"2023-06-02T15:30:42.668772+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:30:42.668772+0000","last_undegraded":"2023-06-02T15:30:42.668772+0000","last_fullsized":"2023-06-02T15:30:42.668772+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666211+0000","last_change":"2023-06-02T15:30:33.655215+0000","last_active":"2023-06-02T15:30:42.666211+0000","last_peered":"2023-06-02T15:30:42.666211+0000","last_clean":"2023-06-02T15:30:42.666211+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:30:42.666211+0000","last_undegraded":"2023-06-02T15:30:42.666211+0000","last_fullsized":"2023-06-02T15:30:42.666211+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678450+0000","last_change":"2023-06-02T15:30:38.277096+0000","last_active":"2023-06-02T15:30:42.678450+0000","last_peered":"2023-06-02T15:30:42.678450+0000","last_clean":"2023-06-02T15:30:42.678450+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:30:42.678450+0000","last_undegraded":"2023-06-02T15:30:42.678450+0000","last_fullsized":"2023-06-02T15:30:42.678450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.720822+0000","last_change":"2023-06-02T15:30:42.698823+0000","last_active":"2023-06-02T15:30:42.720822+0000","last_peered":"2023-06-02T15:30:42.720822+0000","last_clean":"2023-06-02T15:30:42.720822+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:30:42.720822+0000","last_undegraded":"2023-06-02T15:30:42.720822+0000","last_fullsized":"2023-06-02T15:30:42.720822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673925+0000","last_change":"2023-06-02T15:30:38.656372+0000","last_active":"2023-06-02T15:30:42.673925+0000","last_peered":"2023-06-02T15:30:42.673925+0000","last_clean":"2023-06-02T15:30:42.673925+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:30:42.673925+0000","last_undegraded":"2023-06-02T15:30:42.673925+0000","last_fullsized":"2023-06-02T15:30:42.673925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663851+0000","last_change":"2023-06-02T15:30:33.959737+0000","last_active":"2023-06-02T15:30:42.663851+0000","last_peered":"2023-06-02T15:30:42.663851+0000","last_clean":"2023-06-02T15:30:42.663851+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:30:42.663851+0000","last_undegraded":"2023-06-02T15:30:42.663851+0000","last_fullsized":"2023-06-02T15:30:42.663851+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674797+0000","last_change":"2023-06-02T15:30:38.281667+0000","last_active":"2023-06-02T15:30:42.674797+0000","last_peered":"2023-06-02T15:30:42.674797+0000","last_clean":"2023-06-02T15:30:42.674797+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:30:42.674797+0000","last_undegraded":"2023-06-02T15:30:42.674797+0000","last_fullsized":"2023-06-02T15:30:42.674797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.718942+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:30:42.718942+0000","last_peered":"2023-06-02T15:30:42.718942+0000","last_clean":"2023-06-02T15:30:42.718942+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:30:42.718942+0000","last_undegraded":"2023-06-02T15:30:42.718942+0000","last_fullsized":"2023-06-02T15:30:42.718942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:02:01.714482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.660273+0000","last_change":"2023-06-02T15:30:38.646642+0000","last_active":"2023-06-02T15:30:42.660273+0000","last_peered":"2023-06-02T15:30:42.660273+0000","last_clean":"2023-06-02T15:30:42.660273+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:30:42.660273+0000","last_undegraded":"2023-06-02T15:30:42.660273+0000","last_fullsized":"2023-06-02T15:30:42.660273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669807+0000","last_change":"2023-06-02T15:30:33.413542+0000","last_active":"2023-06-02T15:30:42.669807+0000","last_peered":"2023-06-02T15:30:42.669807+0000","last_clean":"2023-06-02T15:30:42.669807+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:30:42.669807+0000","last_undegraded":"2023-06-02T15:30:42.669807+0000","last_fullsized":"2023-06-02T15:30:42.669807+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-06-02T15:30:43.440541+0000","last_change":"2023-06-02T15:30:38.270941+0000","last_active":"2023-06-02T15:30:43.440541+0000","last_peered":"2023-06-02T15:30:43.440541+0000","last_clean":"2023-06-02T15:30:43.440541+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:30:43.440541+0000","last_undegraded":"2023-06-02T15:30:43.440541+0000","last_fullsized":"2023-06-02T15:30:43.440541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.711091+0000","last_change":"2023-06-02T15:30:42.702383+0000","last_active":"2023-06-02T15:30:42.711091+0000","last_peered":"2023-06-02T15:30:42.711091+0000","last_clean":"2023-06-02T15:30:42.711091+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:30:42.711091+0000","last_undegraded":"2023-06-02T15:30:42.711091+0000","last_fullsized":"2023-06-02T15:30:42.711091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:49:31.222291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.670681+0000","last_change":"2023-06-02T15:30:38.642398+0000","last_active":"2023-06-02T15:30:42.670681+0000","last_peered":"2023-06-02T15:30:42.670681+0000","last_clean":"2023-06-02T15:30:42.670681+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:30:42.670681+0000","last_undegraded":"2023-06-02T15:30:42.670681+0000","last_fullsized":"2023-06-02T15:30:42.670681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665469+0000","last_change":"2023-06-02T15:30:38.263733+0000","last_active":"2023-06-02T15:30:42.665469+0000","last_peered":"2023-06-02T15:30:42.665469+0000","last_clean":"2023-06-02T15:30:42.665469+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:30:42.665469+0000","last_undegraded":"2023-06-02T15:30:42.665469+0000","last_fullsized":"2023-06-02T15:30:42.665469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":167,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687342+0000","last_change":"2023-06-02T15:30:34.413807+0000","last_active":"2023-06-02T15:30:42.687342+0000","last_peered":"2023-06-02T15:30:42.687342+0000","last_clean":"2023-06-02T15:30:42.687342+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:30:42.687342+0000","last_undegraded":"2023-06-02T15:30:42.687342+0000","last_fullsized":"2023-06-02T15:30:42.687342+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_clean_scrub_stamp":"2023-06-02T15:30:33.390390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:47:50.762629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678965+0000","last_change":"2023-06-02T15:30:33.411973+0000","last_active":"2023-06-02T15:30:42.678965+0000","last_peered":"2023-06-02T15:30:42.678965+0000","last_clean":"2023-06-02T15:30:42.678965+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:30:42.678965+0000","last_undegraded":"2023-06-02T15:30:42.678965+0000","last_fullsized":"2023-06-02T15:30:42.678965+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721145+0000","last_change":"2023-06-02T15:30:42.712421+0000","last_active":"2023-06-02T15:30:42.721145+0000","last_peered":"2023-06-02T15:30:42.721145+0000","last_clean":"2023-06-02T15:30:42.721145+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:30:42.721145+0000","last_undegraded":"2023-06-02T15:30:42.721145+0000","last_fullsized":"2023-06-02T15:30:42.721145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:38:29.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679112+0000","last_change":"2023-06-02T15:30:38.653404+0000","last_active":"2023-06-02T15:30:42.679112+0000","last_peered":"2023-06-02T15:30:42.679112+0000","last_clean":"2023-06-02T15:30:42.679112+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:30:42.679112+0000","last_undegraded":"2023-06-02T15:30:42.679112+0000","last_fullsized":"2023-06-02T15:30:42.679112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675372+0000","last_change":"2023-06-02T15:30:38.269833+0000","last_active":"2023-06-02T15:30:42.675372+0000","last_peered":"2023-06-02T15:30:42.675372+0000","last_clean":"2023-06-02T15:30:42.675372+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:30:42.675372+0000","last_undegraded":"2023-06-02T15:30:42.675372+0000","last_fullsized":"2023-06-02T15:30:42.675372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:06:46.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687434+0000","last_change":"2023-06-02T15:30:33.654728+0000","last_active":"2023-06-02T15:30:42.687434+0000","last_peered":"2023-06-02T15:30:42.687434+0000","last_clean":"2023-06-02T15:30:42.687434+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:30:42.687434+0000","last_undegraded":"2023-06-02T15:30:42.687434+0000","last_fullsized":"2023-06-02T15:30:42.687434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:05:26.791938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.710087+0000","last_change":"2023-06-02T15:30:42.705191+0000","last_active":"2023-06-02T15:30:42.710087+0000","last_peered":"2023-06-02T15:30:42.710087+0000","last_clean":"2023-06-02T15:30:42.710087+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:30:42.710087+0000","last_undegraded":"2023-06-02T15:30:42.710087+0000","last_fullsized":"2023-06-02T15:30:42.710087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:22.765485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678163+0000","last_change":"2023-06-02T15:30:38.642359+0000","last_active":"2023-06-02T15:30:42.678163+0000","last_peered":"2023-06-02T15:30:42.678163+0000","last_clean":"2023-06-02T15:30:42.678163+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:30:42.678163+0000","last_undegraded":"2023-06-02T15:30:42.678163+0000","last_fullsized":"2023-06-02T15:30:42.678163+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661971+0000","last_change":"2023-06-02T15:30:38.257531+0000","last_active":"2023-06-02T15:30:42.661971+0000","last_peered":"2023-06-02T15:30:42.661971+0000","last_clean":"2023-06-02T15:30:42.661971+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:30:42.661971+0000","last_undegraded":"2023-06-02T15:30:42.661971+0000","last_fullsized":"2023-06-02T15:30:42.661971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668731+0000","last_change":"2023-06-02T15:30:33.655250+0000","last_active":"2023-06-02T15:30:42.668731+0000","last_peered":"2023-06-02T15:30:42.668731+0000","last_clean":"2023-06-02T15:30:42.668731+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:30:42.668731+0000","last_undegraded":"2023-06-02T15:30:42.668731+0000","last_fullsized":"2023-06-02T15:30:42.668731+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.695770+0000","last_change":"2023-06-02T15:30:42.693557+0000","last_active":"2023-06-02T15:30:42.695770+0000","last_peered":"2023-06-02T15:30:42.695770+0000","last_clean":"2023-06-02T15:30:42.695770+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:30:42.695770+0000","last_undegraded":"2023-06-02T15:30:42.695770+0000","last_fullsized":"2023-06-02T15:30:42.695770+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665084+0000","last_change":"2023-06-02T15:30:38.645488+0000","last_active":"2023-06-02T15:30:42.665084+0000","last_peered":"2023-06-02T15:30:42.665084+0000","last_clean":"2023-06-02T15:30:42.665084+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:30:42.665084+0000","last_undegraded":"2023-06-02T15:30:42.665084+0000","last_fullsized":"2023-06-02T15:30:42.665084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669942+0000","last_change":"2023-06-02T15:30:38.283390+0000","last_active":"2023-06-02T15:30:42.669942+0000","last_peered":"2023-06-02T15:30:42.669942+0000","last_clean":"2023-06-02T15:30:42.669942+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:30:42.669942+0000","last_undegraded":"2023-06-02T15:30:42.669942+0000","last_fullsized":"2023-06-02T15:30:42.669942+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687529+0000","last_change":"2023-06-02T15:30:33.653937+0000","last_active":"2023-06-02T15:30:42.687529+0000","last_peered":"2023-06-02T15:30:42.687529+0000","last_clean":"2023-06-02T15:30:42.687529+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:30:42.687529+0000","last_undegraded":"2023-06-02T15:30:42.687529+0000","last_fullsized":"2023-06-02T15:30:42.687529+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.727044+0000","last_change":"2023-06-02T15:30:42.723169+0000","last_active":"2023-06-02T15:30:42.727044+0000","last_peered":"2023-06-02T15:30:42.727044+0000","last_clean":"2023-06-02T15:30:42.727044+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:30:42.727044+0000","last_undegraded":"2023-06-02T15:30:42.727044+0000","last_fullsized":"2023-06-02T15:30:42.727044+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679007+0000","last_change":"2023-06-02T15:30:38.640964+0000","last_active":"2023-06-02T15:30:42.679007+0000","last_peered":"2023-06-02T15:30:42.679007+0000","last_clean":"2023-06-02T15:30:42.679007+0000","last_became_active":"2023-06-02T15:30:38.640643+0000","last_became_peered":"2023-06-02T15:30:38.640643+0000","last_unstale":"2023-06-02T15:30:42.679007+0000","last_undegraded":"2023-06-02T15:30:42.679007+0000","last_fullsized":"2023-06-02T15:30:42.679007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.675412+0000","last_change":"2023-06-02T15:30:38.281851+0000","last_active":"2023-06-02T15:30:42.675412+0000","last_peered":"2023-06-02T15:30:42.675412+0000","last_clean":"2023-06-02T15:30:42.675412+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:30:42.675412+0000","last_undegraded":"2023-06-02T15:30:42.675412+0000","last_fullsized":"2023-06-02T15:30:42.675412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.715894+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:30:42.715894+0000","last_peered":"2023-06-02T15:30:42.715894+0000","last_clean":"2023-06-02T15:30:42.715894+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:30:42.715894+0000","last_undegraded":"2023-06-02T15:30:42.715894+0000","last_fullsized":"2023-06-02T15:30:42.715894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:44.594461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666012+0000","last_change":"2023-06-02T15:30:38.638725+0000","last_active":"2023-06-02T15:30:42.666012+0000","last_peered":"2023-06-02T15:30:42.666012+0000","last_clean":"2023-06-02T15:30:42.666012+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:30:42.666012+0000","last_undegraded":"2023-06-02T15:30:42.666012+0000","last_fullsized":"2023-06-02T15:30:42.666012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.660551+0000","last_change":"2023-06-02T15:30:38.269278+0000","last_active":"2023-06-02T15:30:42.660551+0000","last_peered":"2023-06-02T15:30:42.660551+0000","last_clean":"2023-06-02T15:30:42.660551+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:30:42.660551+0000","last_undegraded":"2023-06-02T15:30:42.660551+0000","last_fullsized":"2023-06-02T15:30:42.660551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721194+0000","last_change":"2023-06-02T15:30:42.713071+0000","last_active":"2023-06-02T15:30:42.721194+0000","last_peered":"2023-06-02T15:30:42.721194+0000","last_clean":"2023-06-02T15:30:42.721194+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:30:42.721194+0000","last_undegraded":"2023-06-02T15:30:42.721194+0000","last_fullsized":"2023-06-02T15:30:42.721194+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663661+0000","last_change":"2023-06-02T15:30:38.636565+0000","last_active":"2023-06-02T15:30:42.663661+0000","last_peered":"2023-06-02T15:30:42.663661+0000","last_clean":"2023-06-02T15:30:42.663661+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:30:42.663661+0000","last_undegraded":"2023-06-02T15:30:42.663661+0000","last_fullsized":"2023-06-02T15:30:42.663661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:56:18.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.664010+0000","last_change":"2023-06-02T15:30:38.277404+0000","last_active":"2023-06-02T15:30:42.664010+0000","last_peered":"2023-06-02T15:30:42.664010+0000","last_clean":"2023-06-02T15:30:42.664010+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:30:42.664010+0000","last_undegraded":"2023-06-02T15:30:42.664010+0000","last_fullsized":"2023-06-02T15:30:42.664010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.702894+0000","last_change":"2023-06-02T15:30:42.697724+0000","last_active":"2023-06-02T15:30:42.702894+0000","last_peered":"2023-06-02T15:30:42.702894+0000","last_clean":"2023-06-02T15:30:42.702894+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:30:42.702894+0000","last_undegraded":"2023-06-02T15:30:42.702894+0000","last_fullsized":"2023-06-02T15:30:42.702894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663344+0000","last_change":"2023-06-02T15:30:38.640532+0000","last_active":"2023-06-02T15:30:42.663344+0000","last_peered":"2023-06-02T15:30:42.663344+0000","last_clean":"2023-06-02T15:30:42.663344+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:30:42.663344+0000","last_undegraded":"2023-06-02T15:30:42.663344+0000","last_fullsized":"2023-06-02T15:30:42.663344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674886+0000","last_change":"2023-06-02T15:30:38.281909+0000","last_active":"2023-06-02T15:30:42.674886+0000","last_peered":"2023-06-02T15:30:42.674886+0000","last_clean":"2023-06-02T15:30:42.674886+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:30:42.674886+0000","last_undegraded":"2023-06-02T15:30:42.674886+0000","last_fullsized":"2023-06-02T15:30:42.674886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.717898+0000","last_change":"2023-06-02T15:30:42.716337+0000","last_active":"2023-06-02T15:30:42.717898+0000","last_peered":"2023-06-02T15:30:42.717898+0000","last_clean":"2023-06-02T15:30:42.717898+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:30:42.717898+0000","last_undegraded":"2023-06-02T15:30:42.717898+0000","last_fullsized":"2023-06-02T15:30:42.717898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665919+0000","last_change":"2023-06-02T15:30:38.651270+0000","last_active":"2023-06-02T15:30:42.665919+0000","last_peered":"2023-06-02T15:30:42.665919+0000","last_clean":"2023-06-02T15:30:42.665919+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:30:42.665919+0000","last_undegraded":"2023-06-02T15:30:42.665919+0000","last_fullsized":"2023-06-02T15:30:42.665919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.667614+0000","last_change":"2023-06-02T15:30:38.277304+0000","last_active":"2023-06-02T15:30:42.667614+0000","last_peered":"2023-06-02T15:30:42.667614+0000","last_clean":"2023-06-02T15:30:42.667614+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:30:42.667614+0000","last_undegraded":"2023-06-02T15:30:42.667614+0000","last_fullsized":"2023-06-02T15:30:42.667614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.694829+0000","last_change":"2023-06-02T15:30:42.692861+0000","last_active":"2023-06-02T15:30:42.694829+0000","last_peered":"2023-06-02T15:30:42.694829+0000","last_clean":"2023-06-02T15:30:42.694829+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:30:42.694829+0000","last_undegraded":"2023-06-02T15:30:42.694829+0000","last_fullsized":"2023-06-02T15:30:42.694829+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:29.857375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663612+0000","last_change":"2023-06-02T15:30:38.645534+0000","last_active":"2023-06-02T15:30:42.663612+0000","last_peered":"2023-06-02T15:30:42.663612+0000","last_clean":"2023-06-02T15:30:42.663612+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:30:42.663612+0000","last_undegraded":"2023-06-02T15:30:42.663612+0000","last_fullsized":"2023-06-02T15:30:42.663612+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.692193+0000","last_change":"2023-06-02T15:30:38.282239+0000","last_active":"2023-06-02T15:30:42.692193+0000","last_peered":"2023-06-02T15:30:42.692193+0000","last_clean":"2023-06-02T15:30:42.692193+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:30:42.692193+0000","last_undegraded":"2023-06-02T15:30:42.692193+0000","last_fullsized":"2023-06-02T15:30:42.692193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:40.807809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.722484+0000","last_change":"2023-06-02T15:30:42.720849+0000","last_active":"2023-06-02T15:30:42.722484+0000","last_peered":"2023-06-02T15:30:42.722484+0000","last_clean":"2023-06-02T15:30:42.722484+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:30:42.722484+0000","last_undegraded":"2023-06-02T15:30:42.722484+0000","last_fullsized":"2023-06-02T15:30:42.722484+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659621+0000","last_change":"2023-06-02T15:30:38.641746+0000","last_active":"2023-06-02T15:30:42.659621+0000","last_peered":"2023-06-02T15:30:42.659621+0000","last_clean":"2023-06-02T15:30:42.659621+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:30:42.659621+0000","last_undegraded":"2023-06-02T15:30:42.659621+0000","last_fullsized":"2023-06-02T15:30:42.659621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681113+0000","last_change":"2023-06-02T15:30:38.282724+0000","last_active":"2023-06-02T15:30:42.681113+0000","last_peered":"2023-06-02T15:30:42.681113+0000","last_clean":"2023-06-02T15:30:42.681113+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:30:42.681113+0000","last_undegraded":"2023-06-02T15:30:42.681113+0000","last_fullsized":"2023-06-02T15:30:42.681113+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:21.387209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.701266+0000","last_change":"2023-06-02T15:30:42.697662+0000","last_active":"2023-06-02T15:30:42.701266+0000","last_peered":"2023-06-02T15:30:42.701266+0000","last_clean":"2023-06-02T15:30:42.701266+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:30:42.701266+0000","last_undegraded":"2023-06-02T15:30:42.701266+0000","last_fullsized":"2023-06-02T15:30:42.701266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:19.014996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673369+0000","last_change":"2023-06-02T15:30:38.656950+0000","last_active":"2023-06-02T15:30:42.673369+0000","last_peered":"2023-06-02T15:30:42.673369+0000","last_clean":"2023-06-02T15:30:42.673369+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:30:42.673369+0000","last_undegraded":"2023-06-02T15:30:42.673369+0000","last_fullsized":"2023-06-02T15:30:42.673369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.685248+0000","last_change":"2023-06-02T15:30:38.283602+0000","last_active":"2023-06-02T15:30:42.685248+0000","last_peered":"2023-06-02T15:30:42.685248+0000","last_clean":"2023-06-02T15:30:42.685248+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:30:42.685248+0000","last_undegraded":"2023-06-02T15:30:42.685248+0000","last_fullsized":"2023-06-02T15:30:42.685248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:33.362323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.727005+0000","last_change":"2023-06-02T15:30:42.722884+0000","last_active":"2023-06-02T15:30:42.727005+0000","last_peered":"2023-06-02T15:30:42.727005+0000","last_clean":"2023-06-02T15:30:42.727005+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:30:42.727005+0000","last_undegraded":"2023-06-02T15:30:42.727005+0000","last_fullsized":"2023-06-02T15:30:42.727005+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.724350+0000","last_change":"2023-06-02T15:30:42.714188+0000","last_active":"2023-06-02T15:30:42.724350+0000","last_peered":"2023-06-02T15:30:42.724350+0000","last_clean":"2023-06-02T15:30:42.724350+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:30:42.724350+0000","last_undegraded":"2023-06-02T15:30:42.724350+0000","last_fullsized":"2023-06-02T15:30:42.724350+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663139+0000","last_change":"2023-06-02T15:30:38.261610+0000","last_active":"2023-06-02T15:30:42.663139+0000","last_peered":"2023-06-02T15:30:42.663139+0000","last_clean":"2023-06-02T15:30:42.663139+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:30:42.663139+0000","last_undegraded":"2023-06-02T15:30:42.663139+0000","last_fullsized":"2023-06-02T15:30:42.663139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674925+0000","last_change":"2023-06-02T15:30:38.658984+0000","last_active":"2023-06-02T15:30:42.674925+0000","last_peered":"2023-06-02T15:30:42.674925+0000","last_clean":"2023-06-02T15:30:42.674925+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:30:42.674925+0000","last_undegraded":"2023-06-02T15:30:42.674925+0000","last_fullsized":"2023-06-02T15:30:42.674925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.712889+0000","last_change":"2023-06-02T15:30:42.705561+0000","last_active":"2023-06-02T15:30:42.712889+0000","last_peered":"2023-06-02T15:30:42.712889+0000","last_clean":"2023-06-02T15:30:42.712889+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:30:42.712889+0000","last_undegraded":"2023-06-02T15:30:42.712889+0000","last_fullsized":"2023-06-02T15:30:42.712889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:39:14.247511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.682004+0000","last_change":"2023-06-02T15:30:38.283796+0000","last_active":"2023-06-02T15:30:42.682004+0000","last_peered":"2023-06-02T15:30:42.682004+0000","last_clean":"2023-06-02T15:30:42.682004+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:30:42.682004+0000","last_undegraded":"2023-06-02T15:30:42.682004+0000","last_fullsized":"2023-06-02T15:30:42.682004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.672736+0000","last_change":"2023-06-02T15:30:38.644966+0000","last_active":"2023-06-02T15:30:42.672736+0000","last_peered":"2023-06-02T15:30:42.672736+0000","last_clean":"2023-06-02T15:30:42.672736+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:30:42.672736+0000","last_undegraded":"2023-06-02T15:30:42.672736+0000","last_fullsized":"2023-06-02T15:30:42.672736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666181+0000","last_change":"2023-06-02T15:30:38.265398+0000","last_active":"2023-06-02T15:30:42.666181+0000","last_peered":"2023-06-02T15:30:42.666181+0000","last_clean":"2023-06-02T15:30:42.666181+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:30:42.666181+0000","last_undegraded":"2023-06-02T15:30:42.666181+0000","last_fullsized":"2023-06-02T15:30:42.666181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:10:29.479149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.680142+0000","last_change":"2023-06-02T15:30:38.657999+0000","last_active":"2023-06-02T15:30:42.680142+0000","last_peered":"2023-06-02T15:30:42.680142+0000","last_clean":"2023-06-02T15:30:42.680142+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:30:42.680142+0000","last_undegraded":"2023-06-02T15:30:42.680142+0000","last_fullsized":"2023-06-02T15:30:42.680142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.712989+0000","last_change":"2023-06-02T15:30:42.705725+0000","last_active":"2023-06-02T15:30:42.712989+0000","last_peered":"2023-06-02T15:30:42.712989+0000","last_clean":"2023-06-02T15:30:42.712989+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:30:42.712989+0000","last_undegraded":"2023-06-02T15:30:42.712989+0000","last_fullsized":"2023-06-02T15:30:42.712989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.684274+0000","last_change":"2023-06-02T15:30:38.282095+0000","last_active":"2023-06-02T15:30:42.684274+0000","last_peered":"2023-06-02T15:30:42.684274+0000","last_clean":"2023-06-02T15:30:42.684274+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:30:42.684274+0000","last_undegraded":"2023-06-02T15:30:42.684274+0000","last_fullsized":"2023-06-02T15:30:42.684274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668685+0000","last_change":"2023-06-02T15:30:38.651033+0000","last_active":"2023-06-02T15:30:42.668685+0000","last_peered":"2023-06-02T15:30:42.668685+0000","last_clean":"2023-06-02T15:30:42.668685+0000","last_became_active":"2023-06-02T15:30:38.650698+0000","last_became_peered":"2023-06-02T15:30:38.650698+0000","last_unstale":"2023-06-02T15:30:42.668685+0000","last_undegraded":"2023-06-02T15:30:42.668685+0000","last_fullsized":"2023-06-02T15:30:42.668685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.721086+0000","last_change":"2023-06-02T15:30:42.702456+0000","last_active":"2023-06-02T15:30:42.721086+0000","last_peered":"2023-06-02T15:30:42.721086+0000","last_clean":"2023-06-02T15:30:42.721086+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:30:42.721086+0000","last_undegraded":"2023-06-02T15:30:42.721086+0000","last_fullsized":"2023-06-02T15:30:42.721086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663108+0000","last_change":"2023-06-02T15:30:38.637380+0000","last_active":"2023-06-02T15:30:42.663108+0000","last_peered":"2023-06-02T15:30:42.663108+0000","last_clean":"2023-06-02T15:30:42.663108+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:30:42.663108+0000","last_undegraded":"2023-06-02T15:30:42.663108+0000","last_fullsized":"2023-06-02T15:30:42.663108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666409+0000","last_change":"2023-06-02T15:30:38.655074+0000","last_active":"2023-06-02T15:30:42.666409+0000","last_peered":"2023-06-02T15:30:42.666409+0000","last_clean":"2023-06-02T15:30:42.666409+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:30:42.666409+0000","last_undegraded":"2023-06-02T15:30:42.666409+0000","last_fullsized":"2023-06-02T15:30:42.666409+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661310+0000","last_change":"2023-06-02T15:30:38.637979+0000","last_active":"2023-06-02T15:30:42.661310+0000","last_peered":"2023-06-02T15:30:42.661310+0000","last_clean":"2023-06-02T15:30:42.661310+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:30:42.661310+0000","last_undegraded":"2023-06-02T15:30:42.661310+0000","last_fullsized":"2023-06-02T15:30:42.661310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.674658+0000","last_change":"2023-06-02T15:30:38.659430+0000","last_active":"2023-06-02T15:30:42.674658+0000","last_peered":"2023-06-02T15:30:42.674658+0000","last_clean":"2023-06-02T15:30:42.674658+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:30:42.674658+0000","last_undegraded":"2023-06-02T15:30:42.674658+0000","last_fullsized":"2023-06-02T15:30:42.674658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679154+0000","last_change":"2023-06-02T15:30:38.656408+0000","last_active":"2023-06-02T15:30:42.679154+0000","last_peered":"2023-06-02T15:30:42.679154+0000","last_clean":"2023-06-02T15:30:42.679154+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:30:42.679154+0000","last_undegraded":"2023-06-02T15:30:42.679154+0000","last_fullsized":"2023-06-02T15:30:42.679154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.679939+0000","last_change":"2023-06-02T15:30:38.658103+0000","last_active":"2023-06-02T15:30:42.679939+0000","last_peered":"2023-06-02T15:30:42.679939+0000","last_clean":"2023-06-02T15:30:42.679939+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:30:42.679939+0000","last_undegraded":"2023-06-02T15:30:42.679939+0000","last_fullsized":"2023-06-02T15:30:42.679939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678672+0000","last_change":"2023-06-02T15:30:38.641657+0000","last_active":"2023-06-02T15:30:42.678672+0000","last_peered":"2023-06-02T15:30:42.678672+0000","last_clean":"2023-06-02T15:30:42.678672+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:30:42.678672+0000","last_undegraded":"2023-06-02T15:30:42.678672+0000","last_fullsized":"2023-06-02T15:30:42.678672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:22.309633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.678899+0000","last_change":"2023-06-02T15:30:38.640289+0000","last_active":"2023-06-02T15:30:42.678899+0000","last_peered":"2023-06-02T15:30:42.678899+0000","last_clean":"2023-06-02T15:30:42.678899+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:30:42.678899+0000","last_undegraded":"2023-06-02T15:30:42.678899+0000","last_fullsized":"2023-06-02T15:30:42.678899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.687086+0000","last_change":"2023-06-02T15:30:38.656963+0000","last_active":"2023-06-02T15:30:42.687086+0000","last_peered":"2023-06-02T15:30:42.687086+0000","last_clean":"2023-06-02T15:30:42.687086+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:30:42.687086+0000","last_undegraded":"2023-06-02T15:30:42.687086+0000","last_fullsized":"2023-06-02T15:30:42.687086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666294+0000","last_change":"2023-06-02T15:30:38.648546+0000","last_active":"2023-06-02T15:30:42.666294+0000","last_peered":"2023-06-02T15:30:42.666294+0000","last_clean":"2023-06-02T15:30:42.666294+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:30:42.666294+0000","last_undegraded":"2023-06-02T15:30:42.666294+0000","last_fullsized":"2023-06-02T15:30:42.666294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666007+0000","last_change":"2023-06-02T15:30:38.643407+0000","last_active":"2023-06-02T15:30:42.666007+0000","last_peered":"2023-06-02T15:30:42.666007+0000","last_clean":"2023-06-02T15:30:42.666007+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:30:42.666007+0000","last_undegraded":"2023-06-02T15:30:42.666007+0000","last_fullsized":"2023-06-02T15:30:42.666007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.684038+0000","last_change":"2023-06-02T15:30:38.657038+0000","last_active":"2023-06-02T15:30:42.684038+0000","last_peered":"2023-06-02T15:30:42.684038+0000","last_clean":"2023-06-02T15:30:42.684038+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:30:42.684038+0000","last_undegraded":"2023-06-02T15:30:42.684038+0000","last_fullsized":"2023-06-02T15:30:42.684038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663138+0000","last_change":"2023-06-02T15:30:38.638594+0000","last_active":"2023-06-02T15:30:42.663138+0000","last_peered":"2023-06-02T15:30:42.663138+0000","last_clean":"2023-06-02T15:30:42.663138+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:30:42.663138+0000","last_undegraded":"2023-06-02T15:30:42.663138+0000","last_fullsized":"2023-06-02T15:30:42.663138+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:28.604626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.654344+0000","last_change":"2023-06-02T15:30:38.638252+0000","last_active":"2023-06-02T15:30:42.654344+0000","last_peered":"2023-06-02T15:30:42.654344+0000","last_clean":"2023-06-02T15:30:42.654344+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:30:42.654344+0000","last_undegraded":"2023-06-02T15:30:42.654344+0000","last_fullsized":"2023-06-02T15:30:42.654344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:24.550049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.665765+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:30:42.665765+0000","last_peered":"2023-06-02T15:30:42.665765+0000","last_clean":"2023-06-02T15:30:42.665765+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:30:42.665765+0000","last_undegraded":"2023-06-02T15:30:42.665765+0000","last_fullsized":"2023-06-02T15:30:42.665765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:14.924133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.669090+0000","last_change":"2023-06-02T15:30:38.639262+0000","last_active":"2023-06-02T15:30:42.669090+0000","last_peered":"2023-06-02T15:30:42.669090+0000","last_clean":"2023-06-02T15:30:42.669090+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:30:42.669090+0000","last_undegraded":"2023-06-02T15:30:42.669090+0000","last_fullsized":"2023-06-02T15:30:42.669090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659193+0000","last_change":"2023-06-02T15:30:38.636435+0000","last_active":"2023-06-02T15:30:42.659193+0000","last_peered":"2023-06-02T15:30:42.659193+0000","last_clean":"2023-06-02T15:30:42.659193+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:30:42.659193+0000","last_undegraded":"2023-06-02T15:30:42.659193+0000","last_fullsized":"2023-06-02T15:30:42.659193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:41:54.216725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681786+0000","last_change":"2023-06-02T15:30:38.659341+0000","last_active":"2023-06-02T15:30:42.681786+0000","last_peered":"2023-06-02T15:30:42.681786+0000","last_clean":"2023-06-02T15:30:42.681786+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:30:42.681786+0000","last_undegraded":"2023-06-02T15:30:42.681786+0000","last_fullsized":"2023-06-02T15:30:42.681786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.671862+0000","last_change":"2023-06-02T15:30:38.636138+0000","last_active":"2023-06-02T15:30:42.671862+0000","last_peered":"2023-06-02T15:30:42.671862+0000","last_clean":"2023-06-02T15:30:42.671862+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:30:42.671862+0000","last_undegraded":"2023-06-02T15:30:42.671862+0000","last_fullsized":"2023-06-02T15:30:42.671862+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.654567+0000","last_change":"2023-06-02T15:30:38.645755+0000","last_active":"2023-06-02T15:30:42.654567+0000","last_peered":"2023-06-02T15:30:42.654567+0000","last_clean":"2023-06-02T15:30:42.654567+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:30:42.654567+0000","last_undegraded":"2023-06-02T15:30:42.654567+0000","last_fullsized":"2023-06-02T15:30:42.654567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:40.298901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.653573+0000","last_change":"2023-06-02T15:30:38.644641+0000","last_active":"2023-06-02T15:30:42.653573+0000","last_peered":"2023-06-02T15:30:42.653573+0000","last_clean":"2023-06-02T15:30:42.653573+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:30:42.653573+0000","last_undegraded":"2023-06-02T15:30:42.653573+0000","last_fullsized":"2023-06-02T15:30:42.653573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:14.588404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663449+0000","last_change":"2023-06-02T15:30:38.650928+0000","last_active":"2023-06-02T15:30:42.663449+0000","last_peered":"2023-06-02T15:30:42.663449+0000","last_clean":"2023-06-02T15:30:42.663449+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:30:42.663449+0000","last_undegraded":"2023-06-02T15:30:42.663449+0000","last_fullsized":"2023-06-02T15:30:42.663449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.676823+0000","last_change":"2023-06-02T15:30:38.640368+0000","last_active":"2023-06-02T15:30:42.676823+0000","last_peered":"2023-06-02T15:30:42.676823+0000","last_clean":"2023-06-02T15:30:42.676823+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:30:42.676823+0000","last_undegraded":"2023-06-02T15:30:42.676823+0000","last_fullsized":"2023-06-02T15:30:42.676823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.668907+0000","last_change":"2023-06-02T15:30:38.639440+0000","last_active":"2023-06-02T15:30:42.668907+0000","last_peered":"2023-06-02T15:30:42.668907+0000","last_clean":"2023-06-02T15:30:42.668907+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:30:42.668907+0000","last_undegraded":"2023-06-02T15:30:42.668907+0000","last_fullsized":"2023-06-02T15:30:42.668907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.673165+0000","last_change":"2023-06-02T15:30:38.647961+0000","last_active":"2023-06-02T15:30:42.673165+0000","last_peered":"2023-06-02T15:30:42.673165+0000","last_clean":"2023-06-02T15:30:42.673165+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:30:42.673165+0000","last_undegraded":"2023-06-02T15:30:42.673165+0000","last_fullsized":"2023-06-02T15:30:42.673165+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.681575+0000","last_change":"2023-06-02T15:30:38.659299+0000","last_active":"2023-06-02T15:30:42.681575+0000","last_peered":"2023-06-02T15:30:42.681575+0000","last_clean":"2023-06-02T15:30:42.681575+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:30:42.681575+0000","last_undegraded":"2023-06-02T15:30:42.681575+0000","last_fullsized":"2023-06-02T15:30:42.681575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.661036+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:30:42.661036+0000","last_peered":"2023-06-02T15:30:42.661036+0000","last_clean":"2023-06-02T15:30:42.661036+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:30:42.661036+0000","last_undegraded":"2023-06-02T15:30:42.661036+0000","last_fullsized":"2023-06-02T15:30:42.661036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:15:27.850958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.666520+0000","last_change":"2023-06-02T15:30:38.639043+0000","last_active":"2023-06-02T15:30:42.666520+0000","last_peered":"2023-06-02T15:30:42.666520+0000","last_clean":"2023-06-02T15:30:42.666520+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:30:42.666520+0000","last_undegraded":"2023-06-02T15:30:42.666520+0000","last_fullsized":"2023-06-02T15:30:42.666520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.663732+0000","last_change":"2023-06-02T15:30:38.637413+0000","last_active":"2023-06-02T15:30:42.663732+0000","last_peered":"2023-06-02T15:30:42.663732+0000","last_clean":"2023-06-02T15:30:42.663732+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:30:42.663732+0000","last_undegraded":"2023-06-02T15:30:42.663732+0000","last_fullsized":"2023-06-02T15:30:42.663732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:22.390984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.659962+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:30:42.659962+0000","last_peered":"2023-06-02T15:30:42.659962+0000","last_clean":"2023-06-02T15:30:42.659962+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:30:42.659962+0000","last_undegraded":"2023-06-02T15:30:42.659962+0000","last_fullsized":"2023-06-02T15:30:42.659962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:17:55.191725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.676939+0000","last_change":"2023-06-02T15:30:38.650591+0000","last_active":"2023-06-02T15:30:42.676939+0000","last_peered":"2023-06-02T15:30:42.676939+0000","last_clean":"2023-06-02T15:30:42.676939+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:30:42.676939+0000","last_undegraded":"2023-06-02T15:30:42.676939+0000","last_fullsized":"2023-06-02T15:30:42.676939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-06-02T15:30:42.655693+0000","last_change":"2023-06-02T15:30:38.639026+0000","last_active":"2023-06-02T15:30:42.655693+0000","last_peered":"2023-06-02T15:30:42.655693+0000","last_clean":"2023-06-02T15:30:42.655693+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:30:42.655693+0000","last_undegraded":"2023-06-02T15:30:42.655693+0000","last_fullsized":"2023-06-02T15:30:42.655693+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:49.394624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4526,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9128,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362712,"statfs":{"total":96636764160,"available":96627417088,"internally_reserved":0,"allocated":360448,"data_stored":704090,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8524,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363316,"statfs":{"total":96636764160,"available":96628035584,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8528,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363312,"statfs":{"total":96636764160,"available":96628031488,"internally_reserved":0,"allocated":270336,"data_stored":109412,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8608,"kb_used_data":280,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363232,"statfs":{"total":96636764160,"available":96627949568,"internally_reserved":0,"allocated":286720,"data_stored":113562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8528,"kb_used_data":264,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363312,"statfs":{"total":96636764160,"available":96628031488,"internally_reserved":0,"allocated":270336,"data_stored":109852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8460,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363380,"statfs":{"total":96636764160,"available":96628101120,"internally_reserved":0,"allocated":266240,"data_stored":109762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9100,"kb_used_data":324,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362740,"statfs":{"total":96636764160,"available":96627445760,"internally_reserved":0,"allocated":331776,"data_stored":700130,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8588,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363252,"statfs":{"total":96636764160,"available":96627970048,"internally_reserved":0,"allocated":266240,"data_stored":109342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":3960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:31:01.843 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-02T15:31:01.843 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-06-02T15:31:01.843 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-06-02T15:31:01.844 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-06-02T15:31:01.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddc550640 1 Processor -- start 2023-06-02T15:31:01.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddc550640 1 -- start start 2023-06-02T15:31:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddc550640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0dd4149e00 0x7f0dd40a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddc550640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd414fe20 0x7f0dd41502a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddc550640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dd40bb0e0 con 0x7f0dd40ba880 2023-06-02T15:31:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddc550640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dd414a1d0 con 0x7f0dd4149e00 2023-06-02T15:31:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddc550640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40a61d0 con 0x7f0dd414fe20 2023-06-02T15:31:01.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddaaed640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd414fe20 0x7f0dd41502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0dda2ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0dd4149e00 0x7f0dd40a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddaaed640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd414fe20 0x7f0dd41502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:50168/0 (socket says 172.21.15.78:50168) 2023-06-02T15:31:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0dda2ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0dd4149e00 0x7f0dd40a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49376/0 (socket says 172.21.15.78:49376) 2023-06-02T15:31:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddaaed640 1 -- 172.21.15.78:0/810047374 learned_addr learned my addr 172.21.15.78:0/810047374 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:01.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0dd9aeb640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0dd40ba880 0x7f0dd40a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:40040/0 (socket says 172.21.15.78:40040) 2023-06-02T15:31:01.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddaaed640 1 -- 172.21.15.78:0/810047374 >> v2:172.21.15.132:3300/0 conn(0x7f0dd4149e00 msgr2=0x7f0dd40a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:01.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddaaed640 1 --2- 172.21.15.78:0/810047374 >> v2:172.21.15.132:3300/0 conn(0x7f0dd4149e00 0x7f0dd40a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddaaed640 1 -- 172.21.15.78:0/810047374 >> v1:172.21.15.132:6789/0 conn(0x7f0dd40ba880 legacy=0x7f0dd40a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0ddaaed640 1 -- 172.21.15.78:0/810047374 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd40a3810 con 0x7f0dd414fe20 2023-06-02T15:31:01.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.982+0000 7f0dda2ec640 1 --2- 172.21.15.78:0/810047374 >> v2:172.21.15.132:3300/0 conn(0x7f0dd4149e00 0x7f0dd40a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:31:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0ddaaed640 1 --2- 172.21.15.78:0/810047374 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd414fe20 0x7f0dd41502a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009e50 tx=0x7f0dcc01ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0fbecb052f42360 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0dd92ea640 1 -- 172.21.15.78:0/810047374 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0a56e0 con 0x7f0dd414fe20 2023-06-02T15:31:01.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0dd92ea640 1 -- 172.21.15.78:0/810047374 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dcc0a5840 con 0x7f0dd414fe20 2023-06-02T15:31:01.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0dd92ea640 1 -- 172.21.15.78:0/810047374 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dcc0a5bd0 con 0x7f0dd414fe20 2023-06-02T15:31:01.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0ddc550640 1 -- 172.21.15.78:0/810047374 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd414fe20 msgr2=0x7f0dd41502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:01.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0ddc550640 1 --2- 172.21.15.78:0/810047374 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd414fe20 0x7f0dd41502a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009e50 tx=0x7f0dcc01ca10 comp rx=0 tx=0).stop 2023-06-02T15:31:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0ddc550640 1 -- 172.21.15.78:0/810047374 shutdown_connections 2023-06-02T15:31:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0ddc550640 1 --2- 172.21.15.78:0/810047374 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd414fe20 0x7f0dd41502a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0ddc550640 1 --2- 172.21.15.78:0/810047374 >> v2:172.21.15.132:3300/0 conn(0x7f0dd4149e00 0x7f0dd40a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0ddc550640 1 -- 172.21.15.78:0/810047374 >> 172.21.15.78:0/810047374 conn(0x7f0dd40bcf50 msgr2=0x7f0dd40bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0ddc550640 1 -- 172.21.15.78:0/810047374 shutdown_connections 2023-06-02T15:31:01.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.986+0000 7f0ddc550640 1 -- 172.21.15.78:0/810047374 wait complete. 2023-06-02T15:31:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 Processor -- start 2023-06-02T15:31:01.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 -- start start 2023-06-02T15:31:01.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd40ba880 0x7f0dd40b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd4149e00 0x7f0dd40a1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd414fe20 0x7f0dd40bfad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40ba020 con 0x7f0dd40ba880 2023-06-02T15:31:02.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd414c360 con 0x7f0dd414fe20 2023-06-02T15:31:02.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd40a0c90 con 0x7f0dd4149e00 2023-06-02T15:31:02.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dda2ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd40ba880 0x7f0dd40b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dda2ec640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd40ba880 0x7f0dd40b9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57972/0 (socket says 172.21.15.78:57972) 2023-06-02T15:31:02.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dda2ec640 1 -- 172.21.15.78:0/1006004534 learned_addr learned my addr 172.21.15.78:0/1006004534 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:02.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dd9aeb640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd4149e00 0x7f0dd40a1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddaaed640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd414fe20 0x7f0dd40bfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dda2ec640 1 -- 172.21.15.78:0/1006004534 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd4149e00 msgr2=0x7f0dd40a1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dda2ec640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd4149e00 0x7f0dd40a1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dda2ec640 1 -- 172.21.15.78:0/1006004534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd414fe20 msgr2=0x7f0dd40bfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dda2ec640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd414fe20 0x7f0dd40bfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dda2ec640 1 -- 172.21.15.78:0/1006004534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd0009420 con 0x7f0dd40ba880 2023-06-02T15:31:02.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddaaed640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd414fe20 0x7f0dd40bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:02.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dda2ec640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd40ba880 0x7f0dd40b9ae0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000ebe0 tx=0x7f0dd000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dcaffd640 1 -- 172.21.15.78:0/1006004534 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd000eee0 con 0x7f0dd40ba880 2023-06-02T15:31:02.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dcaffd640 1 -- 172.21.15.78:0/1006004534 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd000cc30 con 0x7f0dd40ba880 2023-06-02T15:31:02.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 -- 172.21.15.78:0/1006004534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc009b30 con 0x7f0dd40ba880 2023-06-02T15:31:02.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0dcaffd640 1 -- 172.21.15.78:0/1006004534 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd0013470 con 0x7f0dd40ba880 2023-06-02T15:31:02.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 -- 172.21.15.78:0/1006004534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd4159700 con 0x7f0dd40ba880 2023-06-02T15:31:02.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.990+0000 7f0ddc550640 1 -- 172.21.15.78:0/1006004534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd40a2b00 con 0x7f0dd40ba880 2023-06-02T15:31:02.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.994+0000 7f0dcaffd640 1 -- 172.21.15.78:0/1006004534 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f0dd00135d0 con 0x7f0dd40ba880 2023-06-02T15:31:02.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.994+0000 7f0dcaffd640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0db8065c00 0x7f0db80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.994+0000 7f0dcaffd640 1 -- 172.21.15.78:0/1006004534 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0dd0083860 con 0x7f0dd40ba880 2023-06-02T15:31:02.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.994+0000 7f0dd9aeb640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0db8065c00 0x7f0db80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.994+0000 7f0dd9aeb640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0db8065c00 0x7f0db80680b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40ba3a0 tx=0x7f0dc4007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:01.998+0000 7f0dcaffd640 1 -- 172.21.15.78:0/1006004534 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f0dd0054890 con 0x7f0dd40ba880 2023-06-02T15:31:02.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 -- 172.21.15.78:0/1006004534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0dd4159890 con 0x7f0dd40ba880 2023-06-02T15:31:02.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0dcaffd640 1 -- 172.21.15.78:0/1006004534 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0dd0054420 con 0x7f0dd40ba880 2023-06-02T15:31:02.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:02.178 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-06-02T15:31:02.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 -- 172.21.15.78:0/1006004534 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0db8065c00 msgr2=0x7f0db80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0db8065c00 0x7f0db80680b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0dd40ba3a0 tx=0x7f0dc4007e50 comp rx=0 tx=0).stop 2023-06-02T15:31:02.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 -- 172.21.15.78:0/1006004534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd40ba880 msgr2=0x7f0dd40b9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd40ba880 0x7f0dd40b9ae0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0dd000ebe0 tx=0x7f0dd000c520 comp rx=0 tx=0).stop 2023-06-02T15:31:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 -- 172.21.15.78:0/1006004534 shutdown_connections 2023-06-02T15:31:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0dd414fe20 0x7f0dd40bfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0dd4149e00 0x7f0dd40a1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0db8065c00 0x7f0db80680b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 --2- 172.21.15.78:0/1006004534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0dd40ba880 0x7f0dd40b9ae0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 -- 172.21.15.78:0/1006004534 >> 172.21.15.78:0/1006004534 conn(0x7f0dd40bcf50 msgr2=0x7f0dd40a23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:02.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 -- 172.21.15.78:0/1006004534 shutdown_connections 2023-06-02T15:31:02.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.170+0000 7f0ddc550640 1 -- 172.21.15.78:0/1006004534 wait complete. 2023-06-02T15:31:02.194 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-06-02T15:31:02.195 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:31:02.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.294+0000 7f3498b9d640 1 Processor -- start 2023-06-02T15:31:02.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.294+0000 7f3498b9d640 1 -- start start 2023-06-02T15:31:02.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.294+0000 7f3498b9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940bf2b0 0x7f34940bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.294+0000 7f3498b9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34940b7fc0 0x7f34941521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.294+0000 7f3498b9d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940c0730 con 0x7f349406bd00 2023-06-02T15:31:02.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.294+0000 7f3498b9d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349406b5f0 con 0x7f34940b7fc0 2023-06-02T15:31:02.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.294+0000 7f3498b9d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940c04a0 con 0x7f34940bf2b0 2023-06-02T15:31:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f348bfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940bf2b0 0x7f34940bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3492d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34940b7fc0 0x7f34941521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f348bfff640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940bf2b0 0x7f34940bff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:50182/0 (socket says 172.21.15.78:50182) 2023-06-02T15:31:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f348bfff640 1 -- 172.21.15.78:0/3496307963 learned_addr learned my addr 172.21.15.78:0/3496307963 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:02.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f349259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f349406bd00 0x7f3494069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:40042/0 (socket says 172.21.15.78:40042) 2023-06-02T15:31:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3492d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34940b7fc0 0x7f34941521c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:49398/0 (socket says 172.21.15.78:49398) 2023-06-02T15:31:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f348bfff640 1 -- 172.21.15.78:0/3496307963 >> v2:172.21.15.132:3300/0 conn(0x7f34940b7fc0 msgr2=0x7f34941521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f348bfff640 1 --2- 172.21.15.78:0/3496307963 >> v2:172.21.15.132:3300/0 conn(0x7f34940b7fc0 0x7f34941521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f348bfff640 1 -- 172.21.15.78:0/3496307963 >> v1:172.21.15.132:6789/0 conn(0x7f349406bd00 legacy=0x7f3494069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f348bfff640 1 -- 172.21.15.78:0/3496307963 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940c0b20 con 0x7f34940bf2b0 2023-06-02T15:31:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f348bfff640 1 --2- 172.21.15.78:0/3496307963 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940bf2b0 0x7f34940bff60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f347c009870 tx=0x7f347c01ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f082ac2763e1c2c2 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3491d9b640 1 -- 172.21.15.78:0/3496307963 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0a8a30 con 0x7f34940bf2b0 2023-06-02T15:31:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3491d9b640 1 -- 172.21.15.78:0/3496307963 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347c0a8b90 con 0x7f34940bf2b0 2023-06-02T15:31:02.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3491d9b640 1 -- 172.21.15.78:0/3496307963 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347c0b0440 con 0x7f34940bf2b0 2023-06-02T15:31:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3498b9d640 1 -- 172.21.15.78:0/3496307963 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940bf2b0 msgr2=0x7f34940bff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3498b9d640 1 --2- 172.21.15.78:0/3496307963 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940bf2b0 0x7f34940bff60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f347c009870 tx=0x7f347c01ed30 comp rx=0 tx=0).stop 2023-06-02T15:31:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3498b9d640 1 -- 172.21.15.78:0/3496307963 shutdown_connections 2023-06-02T15:31:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3498b9d640 1 --2- 172.21.15.78:0/3496307963 >> v2:172.21.15.132:3300/0 conn(0x7f34940b7fc0 0x7f34941521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3498b9d640 1 --2- 172.21.15.78:0/3496307963 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940bf2b0 0x7f34940bff60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.298+0000 7f3498b9d640 1 -- 172.21.15.78:0/3496307963 >> 172.21.15.78:0/3496307963 conn(0x7f34940a6480 msgr2=0x7f34940a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 -- 172.21.15.78:0/3496307963 shutdown_connections 2023-06-02T15:31:02.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 -- 172.21.15.78:0/3496307963 wait complete. 2023-06-02T15:31:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 Processor -- start 2023-06-02T15:31:02.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 -- start start 2023-06-02T15:31:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f349406bd00 0x7f34941e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940b7fc0 0x7f34941e6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34940bf2b0 0x7f34940bca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34941d1610 con 0x7f34940bf2b0 2023-06-02T15:31:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34940bd560 con 0x7f349406bd00 2023-06-02T15:31:02.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34941d0ef0 con 0x7f34940b7fc0 2023-06-02T15:31:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3492d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34940bf2b0 0x7f34940bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3492d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34940bf2b0 0x7f34940bca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57976/0 (socket says 172.21.15.78:57976) 2023-06-02T15:31:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3492d9d640 1 -- 172.21.15.78:0/1284560731 learned_addr learned my addr 172.21.15.78:0/1284560731 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f348bfff640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940b7fc0 0x7f34941e6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f349259c640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f349406bd00 0x7f34941e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3492d9d640 1 -- 172.21.15.78:0/1284560731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940b7fc0 msgr2=0x7f34941e6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3492d9d640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940b7fc0 0x7f34941e6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3492d9d640 1 -- 172.21.15.78:0/1284560731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f349406bd00 msgr2=0x7f34941e7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3492d9d640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f349406bd00 0x7f34941e7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3492d9d640 1 -- 172.21.15.78:0/1284560731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347c0094d0 con 0x7f34940bf2b0 2023-06-02T15:31:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f349259c640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f349406bd00 0x7f34941e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3492d9d640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34940bf2b0 0x7f34940bca40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f348c00ef90 tx=0x7f348c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f348affd640 1 -- 172.21.15.78:0/1284560731 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c009ca0 con 0x7f34940bf2b0 2023-06-02T15:31:02.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f348affd640 1 -- 172.21.15.78:0/1284560731 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c00f040 con 0x7f34940bf2b0 2023-06-02T15:31:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 -- 172.21.15.78:0/1284560731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34940c0d70 con 0x7f34940bf2b0 2023-06-02T15:31:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f348affd640 1 -- 172.21.15.78:0/1284560731 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c0146c0 con 0x7f34940bf2b0 2023-06-02T15:31:02.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 -- 172.21.15.78:0/1284560731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34940aa880 con 0x7f34940bf2b0 2023-06-02T15:31:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f3498b9d640 1 -- 172.21.15.78:0/1284560731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34940c1310 con 0x7f34940bf2b0 2023-06-02T15:31:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.302+0000 7f348affd640 1 -- 172.21.15.78:0/1284560731 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f348c014820 con 0x7f34940bf2b0 2023-06-02T15:31:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.306+0000 7f348affd640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3474065c00 0x7f34740680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.306+0000 7f349259c640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3474065c00 0x7f34740680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.306+0000 7f348affd640 1 -- 172.21.15.78:0/1284560731 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f348c084590 con 0x7f34940bf2b0 2023-06-02T15:31:02.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.306+0000 7f349259c640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3474065c00 0x7f34740680b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3484007fd0 tx=0x7f3484009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.310+0000 7f348affd640 1 -- 172.21.15.78:0/1284560731 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f348c051b00 con 0x7f34940bf2b0 2023-06-02T15:31:02.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 -- 172.21.15.78:0/1284560731 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34940bd9b0 con 0x7f34940bf2b0 2023-06-02T15:31:02.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f348affd640 1 -- 172.21.15.78:0/1284560731 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f348c055120 con 0x7f34940bf2b0 2023-06-02T15:31:02.459 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:02.459 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:31:02.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 -- 172.21.15.78:0/1284560731 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3474065c00 msgr2=0x7f34740680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3474065c00 0x7f34740680b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3484007fd0 tx=0x7f3484009040 comp rx=0 tx=0).stop 2023-06-02T15:31:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 -- 172.21.15.78:0/1284560731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34940bf2b0 msgr2=0x7f34940bca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34940bf2b0 0x7f34940bca40 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f348c00ef90 tx=0x7f348c00c490 comp rx=0 tx=0).stop 2023-06-02T15:31:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 -- 172.21.15.78:0/1284560731 shutdown_connections 2023-06-02T15:31:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3474065c00 0x7f34740680b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f34940bf2b0 0x7f34940bca40 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f34940b7fc0 0x7f34941e6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 --2- 172.21.15.78:0/1284560731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f349406bd00 0x7f34941e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.450+0000 7f3498b9d640 1 -- 172.21.15.78:0/1284560731 >> 172.21.15.78:0/1284560731 conn(0x7f34940a6480 msgr2=0x7f34940a6850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.454+0000 7f3498b9d640 1 -- 172.21.15.78:0/1284560731 shutdown_connections 2023-06-02T15:31:02.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.454+0000 7f3498b9d640 1 -- 172.21.15.78:0/1284560731 wait complete. 2023-06-02T15:31:02.476 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-02T15:30:31.844882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-02T15:30:33.293644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-02T15:30:36.277798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-02T15:30:37.599884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-02T15:30:40.680165+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-02T15:31:02.478 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-02T15:31:02.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f546969c640 1 Processor -- start 2023-06-02T15:31:02.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f546969c640 1 -- start start 2023-06-02T15:31:02.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f546969c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bb0d0 0x7f54640bc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f546969c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f54640bab80 0x7f54640bc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f546969c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54640bced0 con 0x7f5464149b10 2023-06-02T15:31:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f546969c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f546414ce40 con 0x7f54640bab80 2023-06-02T15:31:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f546969c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5464149ee0 con 0x7f54640bb0d0 2023-06-02T15:31:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5462ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5464149b10 0x7f546406a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56084/0 (socket says 172.21.15.78:56084) 2023-06-02T15:31:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5462ffd640 1 -- 172.21.15.78:0/2667106052 learned_addr learned my addr 172.21.15.78:0/2667106052 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:02.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051584059 0 0) 0x7f54640bced0 con 0x7f5464149b10 2023-06-02T15:31:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f544c003530 con 0x7f5464149b10 2023-06-02T15:31:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f54637fe640 1 --2- 172.21.15.78:0/2667106052 >> v2:172.21.15.132:3300/0 conn(0x7f54640bab80 0x7f54640bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f54627fc640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bb0d0 0x7f54640bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2331695956 0 0) 0x7f544c003530 con 0x7f5464149b10 2023-06-02T15:31:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bb0d0 msgr2=0x7f54640bc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bb0d0 0x7f54640bc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 >> v2:172.21.15.132:3300/0 conn(0x7f54640bab80 msgr2=0x7f54640bc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 --2- 172.21.15.78:0/2667106052 >> v2:172.21.15.132:3300/0 conn(0x7f54640bab80 0x7f54640bc990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546414c550 con 0x7f5464149b10 2023-06-02T15:31:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f5454001680 con 0x7f5464149b10 2023-06-02T15:31:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 >> v1:172.21.15.78:6789/0 conn(0x7f5464149b10 legacy=0x7f546406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f544c0039f0 0x7f544c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bb0d0 0x7f544c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 0x7f544c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f546414ce40 con 0x7f544c004d10 2023-06-02T15:31:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5464149ee0 con 0x7f544c0039f0 2023-06-02T15:31:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f544c00bb50 con 0x7f54640bb0d0 2023-06-02T15:31:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f54637fe640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 0x7f544c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f5462ffd640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f544c0039f0 0x7f544c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f54627fc640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bb0d0 0x7f544c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f54637fe640 1 -- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bb0d0 msgr2=0x7f544c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f54637fe640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bb0d0 0x7f544c0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f54637fe640 1 -- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f544c0039f0 msgr2=0x7f544c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:02.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f54637fe640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f544c0039f0 0x7f544c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.582+0000 7f54637fe640 1 -- 172.21.15.78:0/2667106052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f544c003530 con 0x7f544c004d10 2023-06-02T15:31:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f54637fe640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 0x7f544c005180 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f545c007360 tx=0x7f545c01ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8f1b9010794a45 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c0a5d60 con 0x7f544c004d10 2023-06-02T15:31:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545c0ad440 con 0x7f544c004d10 2023-06-02T15:31:02.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5461ffb640 1 -- 172.21.15.78:0/2667106052 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545c0ad7d0 con 0x7f544c004d10 2023-06-02T15:31:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 -- 172.21.15.78:0/2667106052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 msgr2=0x7f544c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 --2- 172.21.15.78:0/2667106052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 0x7f544c005180 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f545c007360 tx=0x7f545c01ce60 comp rx=0 tx=0).stop 2023-06-02T15:31:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f54637fe640 1 -- 172.21.15.78:0/2667106052 reap_dead start 2023-06-02T15:31:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 -- 172.21.15.78:0/2667106052 shutdown_connections 2023-06-02T15:31:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 -- 172.21.15.78:0/2667106052 >> 172.21.15.78:0/2667106052 conn(0x7f54640bd800 msgr2=0x7f54640bdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 -- 172.21.15.78:0/2667106052 shutdown_connections 2023-06-02T15:31:02.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 -- 172.21.15.78:0/2667106052 wait complete. 2023-06-02T15:31:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 Processor -- start 2023-06-02T15:31:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 -- start start 2023-06-02T15:31:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 0x7f54640b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54640bf9b0 0x7f54640bef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bfe90 0x7f54641e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54640b88a0 con 0x7f544c004d10 2023-06-02T15:31:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54641e6950 con 0x7f54640bf9b0 2023-06-02T15:31:02.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f546969c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54640bf450 con 0x7f54640bfe90 2023-06-02T15:31:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5462ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 0x7f54640b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5462ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 0x7f54640b99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57986/0 (socket says 172.21.15.78:57986) 2023-06-02T15:31:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5462ffd640 1 -- 172.21.15.78:0/892715855 learned_addr learned my addr 172.21.15.78:0/892715855 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f54627fc640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54640bf9b0 0x7f54640bef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f54637fe640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bfe90 0x7f54641e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5462ffd640 1 -- 172.21.15.78:0/892715855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bfe90 msgr2=0x7f54641e70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5462ffd640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bfe90 0x7f54641e70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5462ffd640 1 -- 172.21.15.78:0/892715855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54640bf9b0 msgr2=0x7f54640bef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5462ffd640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54640bf9b0 0x7f54640bef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5462ffd640 1 -- 172.21.15.78:0/892715855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f546414cad0 con 0x7f544c004d10 2023-06-02T15:31:02.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f54637fe640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bfe90 0x7f54641e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:02.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.586+0000 7f5462ffd640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 0x7f54640b99f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f545400e7b0 tx=0x7f545400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f544b7fe640 1 -- 172.21.15.78:0/892715855 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545400ee60 con 0x7f544c004d10 2023-06-02T15:31:02.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f544b7fe640 1 -- 172.21.15.78:0/892715855 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545400c8d0 con 0x7f544c004d10 2023-06-02T15:31:02.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f544b7fe640 1 -- 172.21.15.78:0/892715855 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545400cc80 con 0x7f544c004d10 2023-06-02T15:31:02.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f546969c640 1 -- 172.21.15.78:0/892715855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f546414c7f0 con 0x7f544c004d10 2023-06-02T15:31:02.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f546969c640 1 -- 172.21.15.78:0/892715855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54640b6410 con 0x7f544c004d10 2023-06-02T15:31:02.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f546969c640 1 -- 172.21.15.78:0/892715855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5464073bc0 con 0x7f544c004d10 2023-06-02T15:31:02.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f544b7fe640 1 -- 172.21.15.78:0/892715855 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f545401d460 con 0x7f544c004d10 2023-06-02T15:31:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f544b7fe640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5450065c00 0x7f54500680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f54627fc640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5450065c00 0x7f54500680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f544b7fe640 1 -- 172.21.15.78:0/892715855 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5454083540 con 0x7f544c004d10 2023-06-02T15:31:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.590+0000 7f54627fc640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5450065c00 0x7f54500680b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f546406b060 tx=0x7f5458008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.594+0000 7f544b7fe640 1 -- 172.21.15.78:0/892715855 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f5454050ab0 con 0x7f544c004d10 2023-06-02T15:31:02.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.742+0000 7f546969c640 1 -- 172.21.15.78:0/892715855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f546406dd00 con 0x7f544c004d10 2023-06-02T15:31:02.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.742+0000 7f544b7fe640 1 -- 172.21.15.78:0/892715855 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f54540540d0 con 0x7f544c004d10 2023-06-02T15:31:02.751 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-02T15:31:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.742+0000 7f546969c640 1 -- 172.21.15.78:0/892715855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5450065c00 msgr2=0x7f54500680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.742+0000 7f546969c640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5450065c00 0x7f54500680b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f546406b060 tx=0x7f5458008040 comp rx=0 tx=0).stop 2023-06-02T15:31:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.742+0000 7f546969c640 1 -- 172.21.15.78:0/892715855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 msgr2=0x7f54640b99f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.742+0000 7f546969c640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 0x7f54640b99f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f545400e7b0 tx=0x7f545400ec70 comp rx=0 tx=0).stop 2023-06-02T15:31:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.746+0000 7f546969c640 1 -- 172.21.15.78:0/892715855 shutdown_connections 2023-06-02T15:31:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.746+0000 7f546969c640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f54640bfe90 0x7f54641e70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.746+0000 7f546969c640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54640bf9b0 0x7f54640bef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.746+0000 7f546969c640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5450065c00 0x7f54500680b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.746+0000 7f546969c640 1 --2- 172.21.15.78:0/892715855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f544c004d10 0x7f54640b99f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.746+0000 7f546969c640 1 -- 172.21.15.78:0/892715855 >> 172.21.15.78:0/892715855 conn(0x7f54640bd800 msgr2=0x7f5464148d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.746+0000 7f546969c640 1 -- 172.21.15.78:0/892715855 shutdown_connections 2023-06-02T15:31:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.746+0000 7f546969c640 1 -- 172.21.15.78:0/892715855 wait complete. 2023-06-02T15:31:02.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-02T15:31:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.878+0000 7fc7ce3c8640 1 Processor -- start 2023-06-02T15:31:02.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.878+0000 7fc7ce3c8640 1 -- start start 2023-06-02T15:31:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.878+0000 7fc7ce3c8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7c80a3da0 0x7fc7c80c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.878+0000 7fc7ce3c8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7c80c1fb0 0x7fc7c814ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c806bb50 con 0x7fc7c80bf260 2023-06-02T15:31:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c8152720 con 0x7fc7c80c1fb0 2023-06-02T15:31:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8152a00 con 0x7fc7c80a3da0 2023-06-02T15:31:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7cc965640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7c80c1fb0 0x7fc7c814ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7cc965640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7c80c1fb0 0x7fc7c814ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57988/0 (socket says 172.21.15.78:57988) 2023-06-02T15:31:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7cc965640 1 -- 172.21.15.78:0/2747220961 learned_addr learned my addr 172.21.15.78:0/2747220961 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7cc965640 1 -- 172.21.15.78:0/2747220961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7c80a3da0 msgr2=0x7fc7c80c1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:02.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7cc965640 1 --2- 172.21.15.78:0/2747220961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7c80a3da0 0x7fc7c80c1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7cc965640 1 -- 172.21.15.78:0/2747220961 >> v1:172.21.15.132:6789/0 conn(0x7fc7c80bf260 legacy=0x7fc7c814e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:02.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7cc965640 1 -- 172.21.15.78:0/2747220961 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c806c050 con 0x7fc7c80c1fb0 2023-06-02T15:31:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7cc965640 1 --2- 172.21.15.78:0/2747220961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80c1fb0 0x7fc7c814ee10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009e50 tx=0x7fc7c001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae11377320893ed server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7c6ffd640 1 -- 172.21.15.78:0/2747220961 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00af400 con 0x7fc7c80c1fb0 2023-06-02T15:31:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7c6ffd640 1 -- 172.21.15.78:0/2747220961 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c00ab050 con 0x7fc7c80c1fb0 2023-06-02T15:31:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7c6ffd640 1 -- 172.21.15.78:0/2747220961 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c00af780 con 0x7fc7c80c1fb0 2023-06-02T15:31:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/2747220961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80c1fb0 msgr2=0x7fc7c814ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 --2- 172.21.15.78:0/2747220961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80c1fb0 0x7fc7c814ee10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc7c0009e50 tx=0x7fc7c001f1c0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/2747220961 shutdown_connections 2023-06-02T15:31:02.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 --2- 172.21.15.78:0/2747220961 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80c1fb0 0x7fc7c814ee10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 --2- 172.21.15.78:0/2747220961 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7c80a3da0 0x7fc7c80c1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/2747220961 >> 172.21.15.78:0/2747220961 conn(0x7fc7c80c5570 msgr2=0x7fc7c80c1360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:02.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/2747220961 shutdown_connections 2023-06-02T15:31:02.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.882+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/2747220961 wait complete. 2023-06-02T15:31:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 Processor -- start 2023-06-02T15:31:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 -- start start 2023-06-02T15:31:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7c80a3da0 0x7fc7c81497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80bf260 0x7fc7c81e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c80c1fb0 0x7fc7c80c15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81e4720 con 0x7fc7c80bf260 2023-06-02T15:31:02.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c8149200 con 0x7fc7c80c1fb0 2023-06-02T15:31:02.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c81e5080 con 0x7fc7c80a3da0 2023-06-02T15:31:02.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80bf260 0x7fc7c81e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80bf260 0x7fc7c81e4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:57998/0 (socket says 172.21.15.78:57998) 2023-06-02T15:31:02.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c77fe640 1 -- 172.21.15.78:0/3863063894 learned_addr learned my addr 172.21.15.78:0/3863063894 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:02.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c77fe640 1 -- 172.21.15.78:0/3863063894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7c80a3da0 msgr2=0x7fc7c81497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c77fe640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7c80a3da0 0x7fc7c81497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c77fe640 1 -- 172.21.15.78:0/3863063894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c80c1fb0 msgr2=0x7fc7c80c15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c77fe640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c80c1fb0 0x7fc7c80c15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c77fe640 1 -- 172.21.15.78:0/3863063894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c0009b30 con 0x7fc7c80bf260 2023-06-02T15:31:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c77fe640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80bf260 0x7fc7c81e4b40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00c490 tx=0x7fc7bc001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c4ff9640 1 -- 172.21.15.78:0/3863063894 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc003600 con 0x7fc7c80bf260 2023-06-02T15:31:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c4ff9640 1 -- 172.21.15.78:0/3863063894 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7bc003780 con 0x7fc7c80bf260 2023-06-02T15:31:02.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/3863063894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c806afa0 con 0x7fc7c80bf260 2023-06-02T15:31:02.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c4ff9640 1 -- 172.21.15.78:0/3863063894 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7bc003b70 con 0x7fc7c80bf260 2023-06-02T15:31:02.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/3863063894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c80a4170 con 0x7fc7c80bf260 2023-06-02T15:31:02.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/3863063894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c806b130 con 0x7fc7c80bf260 2023-06-02T15:31:02.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c4ff9640 1 -- 172.21.15.78:0/3863063894 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fc7bc003cd0 con 0x7fc7c80bf260 2023-06-02T15:31:02.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c4ff9640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc7b4065c30 0x7fc7b40680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:02.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c4ff9640 1 -- 172.21.15.78:0/3863063894 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc7bc082bb0 con 0x7fc7c80bf260 2023-06-02T15:31:02.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c7fff640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc7b4065c30 0x7fc7b40680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:02.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.886+0000 7fc7c7fff640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc7b4065c30 0x7fc7b40680e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009730 tx=0x7fc7b8006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:02.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:02.890+0000 7fc7c4ff9640 1 -- 172.21.15.78:0/3863063894 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fc7bc050090 con 0x7fc7c80bf260 2023-06-02T15:31:03.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.042+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/3863063894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7c81e4860 con 0x7fc7c80bf260 2023-06-02T15:31:03.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.042+0000 7fc7c4ff9640 1 -- 172.21.15.78:0/3863063894 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7c81e4860 con 0x7fc7c80bf260 2023-06-02T15:31:03.052 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-02T15:31:03.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/3863063894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc7b4065c30 msgr2=0x7fc7b40680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc7b4065c30 0x7fc7b40680e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8009730 tx=0x7fc7b8006ca0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/3863063894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80bf260 msgr2=0x7fc7c81e4b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80bf260 0x7fc7c81e4b40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc00c490 tx=0x7fc7bc001e80 comp rx=0 tx=0).stop 2023-06-02T15:31:03.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/3863063894 shutdown_connections 2023-06-02T15:31:03.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c80c1fb0 0x7fc7c80c15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc7b4065c30 0x7fc7b40680e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7c80bf260 0x7fc7c81e4b40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 --2- 172.21.15.78:0/3863063894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7c80a3da0 0x7fc7c81497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/3863063894 >> 172.21.15.78:0/3863063894 conn(0x7fc7c80c5570 msgr2=0x7fc7c814a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:03.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/3863063894 shutdown_connections 2023-06-02T15:31:03.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.046+0000 7fc7ce3c8640 1 -- 172.21.15.78:0/3863063894 wait complete. 2023-06-02T15:31:03.072 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-02T15:31:03.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.186+0000 7fc739e81640 1 Processor -- start 2023-06-02T15:31:03.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.186+0000 7fc739e81640 1 -- start start 2023-06-02T15:31:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc734151f90 0x7fc7340c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7340aa5b0 0x7fc734158e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7340c0a50 con 0x7fc73406bd60 2023-06-02T15:31:03.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc734152360 con 0x7fc734151f90 2023-06-02T15:31:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc734152620 con 0x7fc7340aa5b0 2023-06-02T15:31:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7337fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc734151f90 0x7fc7340c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7337fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc734151f90 0x7fc7340c1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58012/0 (socket says 172.21.15.78:58012) 2023-06-02T15:31:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7337fe640 1 -- 172.21.15.78:0/531896772 learned_addr learned my addr 172.21.15.78:0/531896772 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:03.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc733fff640 1 --2- 172.21.15.78:0/531896772 >> v2:172.21.15.132:3300/0 conn(0x7fc7340aa5b0 0x7fc734158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7337fe640 1 -- 172.21.15.78:0/531896772 >> v2:172.21.15.132:3300/0 conn(0x7fc7340aa5b0 msgr2=0x7fc734158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:03.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7337fe640 1 --2- 172.21.15.78:0/531896772 >> v2:172.21.15.132:3300/0 conn(0x7fc7340aa5b0 0x7fc734158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7337fe640 1 -- 172.21.15.78:0/531896772 >> v1:172.21.15.132:6789/0 conn(0x7fc73406bd60 legacy=0x7fc73406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:03.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7337fe640 1 -- 172.21.15.78:0/531896772 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc734152900 con 0x7fc734151f90 2023-06-02T15:31:03.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc733fff640 1 --2- 172.21.15.78:0/531896772 >> v2:172.21.15.132:3300/0 conn(0x7fc7340aa5b0 0x7fc734158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:03.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7337fe640 1 --2- 172.21.15.78:0/531896772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc734151f90 0x7fc7340c1260 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc7340a42e0 tx=0x7fc72401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57bf6af051122dd server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:03.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7327fc640 1 -- 172.21.15.78:0/531896772 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240a89b0 con 0x7fc734151f90 2023-06-02T15:31:03.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7327fc640 1 -- 172.21.15.78:0/531896772 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7240a8b10 con 0x7fc734151f90 2023-06-02T15:31:03.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc7327fc640 1 -- 172.21.15.78:0/531896772 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240a8ea0 con 0x7fc734151f90 2023-06-02T15:31:03.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 -- 172.21.15.78:0/531896772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc734151f90 msgr2=0x7fc7340c1260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 --2- 172.21.15.78:0/531896772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc734151f90 0x7fc7340c1260 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fc7340a42e0 tx=0x7fc72401ecb0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 -- 172.21.15.78:0/531896772 shutdown_connections 2023-06-02T15:31:03.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 --2- 172.21.15.78:0/531896772 >> v2:172.21.15.132:3300/0 conn(0x7fc7340aa5b0 0x7fc734158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 --2- 172.21.15.78:0/531896772 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc734151f90 0x7fc7340c1260 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 -- 172.21.15.78:0/531896772 >> 172.21.15.78:0/531896772 conn(0x7fc7340a63c0 msgr2=0x7fc7340a67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:03.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 -- 172.21.15.78:0/531896772 shutdown_connections 2023-06-02T15:31:03.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.190+0000 7fc739e81640 1 -- 172.21.15.78:0/531896772 wait complete. 2023-06-02T15:31:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 Processor -- start 2023-06-02T15:31:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 -- start start 2023-06-02T15:31:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc73406bd60 0x7fc7340ba790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7340aa5b0 0x7fc7341e4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7341e4f80 0x7fc734149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340be5c0 con 0x7fc73406bd60 2023-06-02T15:31:03.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7340be860 con 0x7fc7341e4f80 2023-06-02T15:31:03.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7341e4070 con 0x7fc7340aa5b0 2023-06-02T15:31:03.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc7337fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc73406bd60 0x7fc7340ba790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc7337fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc73406bd60 0x7fc7340ba790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58028/0 (socket says 172.21.15.78:58028) 2023-06-02T15:31:03.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc7337fe640 1 -- 172.21.15.78:0/7583889 learned_addr learned my addr 172.21.15.78:0/7583889 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:03.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc732ffd640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7340aa5b0 0x7fc7341e4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc733fff640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7341e4f80 0x7fc734149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc7337fe640 1 -- 172.21.15.78:0/7583889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7340aa5b0 msgr2=0x7fc7341e4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc7337fe640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7340aa5b0 0x7fc7341e4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc7337fe640 1 -- 172.21.15.78:0/7583889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7341e4f80 msgr2=0x7fc734149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc7337fe640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7341e4f80 0x7fc734149210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc7337fe640 1 -- 172.21.15.78:0/7583889 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7240094d0 con 0x7fc73406bd60 2023-06-02T15:31:03.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc7337fe640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc73406bd60 0x7fc7340ba790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc7240b3040 tx=0x7fc72401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:03.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc71bfff640 1 -- 172.21.15.78:0/7583889 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240b0e80 con 0x7fc73406bd60 2023-06-02T15:31:03.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc71bfff640 1 -- 172.21.15.78:0/7583889 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7240bb480 con 0x7fc73406bd60 2023-06-02T15:31:03.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 -- 172.21.15.78:0/7583889 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7340c0ee0 con 0x7fc73406bd60 2023-06-02T15:31:03.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 -- 172.21.15.78:0/7583889 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7340bf320 con 0x7fc73406bd60 2023-06-02T15:31:03.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc71bfff640 1 -- 172.21.15.78:0/7583889 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7240bb830 con 0x7fc73406bd60 2023-06-02T15:31:03.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.194+0000 7fc739e81640 1 -- 172.21.15.78:0/7583889 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc714005260 con 0x7fc73406bd60 2023-06-02T15:31:03.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.198+0000 7fc71bfff640 1 -- 172.21.15.78:0/7583889 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fc7240bb990 con 0x7fc73406bd60 2023-06-02T15:31:03.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.198+0000 7fc71bfff640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc720065c30 0x7fc7200680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.198+0000 7fc71bfff640 1 -- 172.21.15.78:0/7583889 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc724122600 con 0x7fc73406bd60 2023-06-02T15:31:03.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.198+0000 7fc732ffd640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc720065c30 0x7fc7200680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.198+0000 7fc732ffd640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc720065c30 0x7fc7200680e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc73414b6a0 tx=0x7fc728009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:03.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.202+0000 7fc71bfff640 1 -- 172.21.15.78:0/7583889 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fc7240efc50 con 0x7fc73406bd60 2023-06-02T15:31:03.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.350+0000 7fc739e81640 1 -- 172.21.15.78:0/7583889 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc714005a90 con 0x7fc73406bd60 2023-06-02T15:31:03.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.350+0000 7fc71bfff640 1 -- 172.21.15.78:0/7583889 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc7240f3270 con 0x7fc73406bd60 2023-06-02T15:31:03.361 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 -- 172.21.15.78:0/7583889 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc720065c30 msgr2=0x7fc7200680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc720065c30 0x7fc7200680e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc73414b6a0 tx=0x7fc728009040 comp rx=0 tx=0).stop 2023-06-02T15:31:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 -- 172.21.15.78:0/7583889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc73406bd60 msgr2=0x7fc7340ba790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc73406bd60 0x7fc7340ba790 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc7240b3040 tx=0x7fc72401ba50 comp rx=0 tx=0).stop 2023-06-02T15:31:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 -- 172.21.15.78:0/7583889 shutdown_connections 2023-06-02T15:31:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7341e4f80 0x7fc734149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fc7340aa5b0 0x7fc7341e4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fc720065c30 0x7fc7200680e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 --2- 172.21.15.78:0/7583889 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc73406bd60 0x7fc7340ba790 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 -- 172.21.15.78:0/7583889 >> 172.21.15.78:0/7583889 conn(0x7fc7340a63c0 msgr2=0x7fc73414a290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:03.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 -- 172.21.15.78:0/7583889 shutdown_connections 2023-06-02T15:31:03.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.354+0000 7fc739e81640 1 -- 172.21.15.78:0/7583889 wait complete. 2023-06-02T15:31:03.380 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-02T15:31:03.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.494+0000 7f8261055640 1 Processor -- start 2023-06-02T15:31:03.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.494+0000 7f8261055640 1 -- start start 2023-06-02T15:31:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.494+0000 7f8261055640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c0aa5b0 0x7f825c159e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.494+0000 7f8261055640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c0c0a50 con 0x7f825c151f90 2023-06-02T15:31:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.494+0000 7f8261055640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f825c152360 con 0x7f825c06bd60 2023-06-02T15:31:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.494+0000 7f8261055640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c152620 con 0x7f825c0aa5b0 2023-06-02T15:31:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.494+0000 7f825ad9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f825c151f90 0x7f825c0c1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56094/0 (socket says 172.21.15.78:56094) 2023-06-02T15:31:03.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.494+0000 7f825ad9d640 1 -- 172.21.15.78:0/1160475658 learned_addr learned my addr 172.21.15.78:0/1160475658 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825b59e640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c0aa5b0 0x7f825c159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3131120830 0 0) 0x7f825c0c0a50 con 0x7f825c151f90 2023-06-02T15:31:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8244003530 con 0x7f825c151f90 2023-06-02T15:31:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 311370832 0 0) 0x7f8244003530 con 0x7f825c151f90 2023-06-02T15:31:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c0aa5b0 msgr2=0x7f825c159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c0aa5b0 0x7f825c159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 >> v1:172.21.15.132:6789/0 conn(0x7f825c06bd60 legacy=0x7f825c06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c152900 con 0x7f825c151f90 2023-06-02T15:31:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f824c001680 con 0x7f825c151f90 2023-06-02T15:31:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825b59e640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c0aa5b0 0x7f825c159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 >> v1:172.21.15.78:6789/0 conn(0x7f825c151f90 legacy=0x7f825c0c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8244003a20 0x7f8244003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c0aa5b0 0x7f82440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8244004d10 0x7f8244005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c152620 con 0x7f8244004d10 2023-06-02T15:31:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824400bbb0 con 0x7f8244003a20 2023-06-02T15:31:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f824400bd20 con 0x7f825c0aa5b0 2023-06-02T15:31:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825b59e640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8244004d10 0x7f8244005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825a59c640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c0aa5b0 0x7f82440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825ad9d640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8244003a20 0x7f8244003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825b59e640 1 -- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c0aa5b0 msgr2=0x7f82440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825b59e640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c0aa5b0 0x7f82440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825b59e640 1 -- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8244003a20 msgr2=0x7f8244003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:03.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825b59e640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8244003a20 0x7f8244003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825b59e640 1 -- 172.21.15.78:0/1160475658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8244003530 con 0x7f8244004d10 2023-06-02T15:31:03.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825ad9d640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8244003a20 0x7f8244003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:03.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825a59c640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c0aa5b0 0x7f82440047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825b59e640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8244004d10 0x7f8244005180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82540073b0 tx=0x7f825401ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=598688e438f1e1fb server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540a5d80 con 0x7f8244004d10 2023-06-02T15:31:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82540ad440 con 0x7f8244004d10 2023-06-02T15:31:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8259d9b640 1 -- 172.21.15.78:0/1160475658 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82540ad7b0 con 0x7f8244004d10 2023-06-02T15:31:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8261055640 1 -- 172.21.15.78:0/1160475658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8244004d10 msgr2=0x7f8244005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8261055640 1 --2- 172.21.15.78:0/1160475658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8244004d10 0x7f8244005180 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f82540073b0 tx=0x7f825401ce80 comp rx=0 tx=0).stop 2023-06-02T15:31:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f825b59e640 1 -- 172.21.15.78:0/1160475658 reap_dead start 2023-06-02T15:31:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8261055640 1 -- 172.21.15.78:0/1160475658 shutdown_connections 2023-06-02T15:31:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8261055640 1 -- 172.21.15.78:0/1160475658 >> 172.21.15.78:0/1160475658 conn(0x7f825c0a63c0 msgr2=0x7f825c0a67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8261055640 1 -- 172.21.15.78:0/1160475658 shutdown_connections 2023-06-02T15:31:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.498+0000 7f8261055640 1 -- 172.21.15.78:0/1160475658 wait complete. 2023-06-02T15:31:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 Processor -- start 2023-06-02T15:31:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 -- start start 2023-06-02T15:31:03.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c14e770 0x7f825c1d7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825c1daef0 0x7f825c1d8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c1d8660 0x7f825c1e7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0bdaf0 con 0x7f825c14e770 2023-06-02T15:31:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0bd150 con 0x7f825c1daef0 2023-06-02T15:31:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f825c0bd430 con 0x7f825c1d8660 2023-06-02T15:31:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c14e770 0x7f825c1d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c14e770 0x7f825c1d7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58042/0 (socket says 172.21.15.78:58042) 2023-06-02T15:31:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825ad9d640 1 -- 172.21.15.78:0/2567890557 learned_addr learned my addr 172.21.15.78:0/2567890557 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825a59c640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825c1daef0 0x7f825c1d8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825b59e640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c1d8660 0x7f825c1e7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825ad9d640 1 -- 172.21.15.78:0/2567890557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c1d8660 msgr2=0x7f825c1e7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825ad9d640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c1d8660 0x7f825c1e7060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825ad9d640 1 -- 172.21.15.78:0/2567890557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825c1daef0 msgr2=0x7f825c1d8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825ad9d640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825c1daef0 0x7f825c1d8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825ad9d640 1 -- 172.21.15.78:0/2567890557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f825c0bf320 con 0x7f825c14e770 2023-06-02T15:31:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825a59c640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825c1daef0 0x7f825c1d8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f825ad9d640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c14e770 0x7f825c1d7be0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f824c00db10 tx=0x7f824c007e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f82437fe640 1 -- 172.21.15.78:0/2567890557 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c004cc0 con 0x7f825c14e770 2023-06-02T15:31:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f82437fe640 1 -- 172.21.15.78:0/2567890557 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f824c004e20 con 0x7f825c14e770 2023-06-02T15:31:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 -- 172.21.15.78:0/2567890557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f825c0c1970 con 0x7f825c14e770 2023-06-02T15:31:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f82437fe640 1 -- 172.21.15.78:0/2567890557 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f824c0072f0 con 0x7f825c14e770 2023-06-02T15:31:03.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 -- 172.21.15.78:0/2567890557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f825c0c0ee0 con 0x7f825c14e770 2023-06-02T15:31:03.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f8261055640 1 -- 172.21.15.78:0/2567890557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f825c073bc0 con 0x7f825c14e770 2023-06-02T15:31:03.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.502+0000 7f82437fe640 1 -- 172.21.15.78:0/2567890557 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f824c007450 con 0x7f825c14e770 2023-06-02T15:31:03.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.506+0000 7f82437fe640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8248065c00 0x7f82480680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.506+0000 7f82437fe640 1 -- 172.21.15.78:0/2567890557 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f824c0831e0 con 0x7f825c14e770 2023-06-02T15:31:03.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.506+0000 7f825a59c640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8248065c00 0x7f82480680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.506+0000 7f825a59c640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8248065c00 0x7f82480680b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f825c1db660 tx=0x7f8250009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:03.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.510+0000 7f82437fe640 1 -- 172.21.15.78:0/2567890557 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f824c04c6e0 con 0x7f825c14e770 2023-06-02T15:31:03.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.662+0000 7f8261055640 1 -- 172.21.15.78:0/2567890557 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f825c0a5310 con 0x7f825c14e770 2023-06-02T15:31:03.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.662+0000 7f82437fe640 1 -- 172.21.15.78:0/2567890557 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f824c050770 con 0x7f825c14e770 2023-06-02T15:31:03.671 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-02T15:31:03.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.662+0000 7f8261055640 1 -- 172.21.15.78:0/2567890557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8248065c00 msgr2=0x7f82480680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.662+0000 7f8261055640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8248065c00 0x7f82480680b0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f825c1db660 tx=0x7f8250009040 comp rx=0 tx=0).stop 2023-06-02T15:31:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.662+0000 7f8261055640 1 -- 172.21.15.78:0/2567890557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c14e770 msgr2=0x7f825c1d7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.662+0000 7f8261055640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c14e770 0x7f825c1d7be0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f824c00db10 tx=0x7f824c007e40 comp rx=0 tx=0).stop 2023-06-02T15:31:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.666+0000 7f8261055640 1 -- 172.21.15.78:0/2567890557 shutdown_connections 2023-06-02T15:31:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.666+0000 7f8261055640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f825c1d8660 0x7f825c1e7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.666+0000 7f8261055640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f825c1daef0 0x7f825c1d8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.666+0000 7f8261055640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8248065c00 0x7f82480680b0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.666+0000 7f8261055640 1 --2- 172.21.15.78:0/2567890557 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f825c14e770 0x7f825c1d7be0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.666+0000 7f8261055640 1 -- 172.21.15.78:0/2567890557 >> 172.21.15.78:0/2567890557 conn(0x7f825c0a63c0 msgr2=0x7f825c150430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:03.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.666+0000 7f8261055640 1 -- 172.21.15.78:0/2567890557 shutdown_connections 2023-06-02T15:31:03.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.666+0000 7f8261055640 1 -- 172.21.15.78:0/2567890557 wait complete. 2023-06-02T15:31:03.690 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-02T15:31:03.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8403072640 1 Processor -- start 2023-06-02T15:31:03.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8403072640 1 -- start start 2023-06-02T15:31:03.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8403072640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83fc149b10 0x7f83fc06a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8403072640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc0bb0d0 0x7f83fc156d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8403072640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83fc14ce40 con 0x7f83fc06ae40 2023-06-02T15:31:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8403072640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83fc149ee0 con 0x7f83fc149b10 2023-06-02T15:31:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8403072640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc14c550 con 0x7f83fc0bb0d0 2023-06-02T15:31:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8400e0e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f83fc149b10 0x7f83fc06a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f83fbfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f83fc06ae40 0x7f83fc0bc450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44296/0 (socket says 172.21.15.78:44296) 2023-06-02T15:31:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f83fbfff640 1 -- 172.21.15.78:0/151659497 learned_addr learned my addr 172.21.15.78:0/151659497 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8400e0e640 1 -- 172.21.15.78:0/151659497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc0bb0d0 msgr2=0x7f83fc156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f840160f640 1 --2- 172.21.15.78:0/151659497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc0bb0d0 0x7f83fc156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f83fb7fe640 1 -- 172.21.15.78:0/151659497 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 985804140 0 0) 0x7f83fc14ce40 con 0x7f83fc06ae40 2023-06-02T15:31:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8400e0e640 1 --2- 172.21.15.78:0/151659497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc0bb0d0 0x7f83fc156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8400e0e640 1 -- 172.21.15.78:0/151659497 >> v1:172.21.15.78:6789/0 conn(0x7f83fc06ae40 legacy=0x7f83fc0bc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.806+0000 7f8400e0e640 1 -- 172.21.15.78:0/151659497 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc14c7f0 con 0x7f83fc149b10 2023-06-02T15:31:03.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8400e0e640 1 --2- 172.21.15.78:0/151659497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 0x7f83fc06a900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097c0 tx=0x7f83f001ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=556e7442376d00f4 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:03.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f83fb7fe640 1 -- 172.21.15.78:0/151659497 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00a8970 con 0x7f83fc149b10 2023-06-02T15:31:03.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f83fb7fe640 1 -- 172.21.15.78:0/151659497 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f00a8ad0 con 0x7f83fc149b10 2023-06-02T15:31:03.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f83fb7fe640 1 -- 172.21.15.78:0/151659497 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f00a8e60 con 0x7f83fc149b10 2023-06-02T15:31:03.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8403072640 1 -- 172.21.15.78:0/151659497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 msgr2=0x7f83fc06a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8403072640 1 --2- 172.21.15.78:0/151659497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 0x7f83fc06a900 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097c0 tx=0x7f83f001ec70 comp rx=0 tx=0).stop 2023-06-02T15:31:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8403072640 1 -- 172.21.15.78:0/151659497 shutdown_connections 2023-06-02T15:31:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8403072640 1 --2- 172.21.15.78:0/151659497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc0bb0d0 0x7f83fc156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8403072640 1 --2- 172.21.15.78:0/151659497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 0x7f83fc06a900 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8403072640 1 -- 172.21.15.78:0/151659497 >> 172.21.15.78:0/151659497 conn(0x7f83fc0bd800 msgr2=0x7f83fc0bdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8403072640 1 -- 172.21.15.78:0/151659497 shutdown_connections 2023-06-02T15:31:03.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8403072640 1 -- 172.21.15.78:0/151659497 wait complete. 2023-06-02T15:31:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8403072640 1 Processor -- start 2023-06-02T15:31:03.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.810+0000 7f8403072640 1 -- start start 2023-06-02T15:31:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8403072640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc06ae40 0x7f83fc0bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8403072640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83fc0bb0d0 0x7f83fc0b8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8403072640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 0x7f83fc0b95d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8403072640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0b8000 con 0x7f83fc149b10 2023-06-02T15:31:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8403072640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc1e5b20 con 0x7f83fc0bb0d0 2023-06-02T15:31:03.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8403072640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83fc0b9b10 con 0x7f83fc06ae40 2023-06-02T15:31:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f840160f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 0x7f83fc0b95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f840160f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 0x7f83fc0b95d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42288/0 (socket says 172.21.15.78:42288) 2023-06-02T15:31:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f840160f640 1 -- 172.21.15.78:0/1252865651 learned_addr learned my addr 172.21.15.78:0/1252865651 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f83fbfff640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83fc0bb0d0 0x7f83fc0b8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8400e0e640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc06ae40 0x7f83fc0bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f840160f640 1 -- 172.21.15.78:0/1252865651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc06ae40 msgr2=0x7f83fc0bf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f840160f640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc06ae40 0x7f83fc0bf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f840160f640 1 -- 172.21.15.78:0/1252865651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83fc0bb0d0 msgr2=0x7f83fc0b8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f840160f640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83fc0bb0d0 0x7f83fc0b8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f840160f640 1 -- 172.21.15.78:0/1252865651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f0009420 con 0x7f83fc149b10 2023-06-02T15:31:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f83fbfff640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83fc0bb0d0 0x7f83fc0b8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8400e0e640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc06ae40 0x7f83fc0bf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f840160f640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 0x7f83fc0b95d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f83f400cc60 tx=0x7f83f400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:03.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f83f97fa640 1 -- 172.21.15.78:0/1252865651 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f400ce70 con 0x7f83fc149b10 2023-06-02T15:31:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f83f97fa640 1 -- 172.21.15.78:0/1252865651 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f40039a0 con 0x7f83fc149b10 2023-06-02T15:31:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8403072640 1 -- 172.21.15.78:0/1252865651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83fc0b6410 con 0x7f83fc149b10 2023-06-02T15:31:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f83f97fa640 1 -- 172.21.15.78:0/1252865651 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4003d30 con 0x7f83fc149b10 2023-06-02T15:31:03.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8403072640 1 -- 172.21.15.78:0/1252865651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83fc14cad0 con 0x7f83fc149b10 2023-06-02T15:31:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f8403072640 1 -- 172.21.15.78:0/1252865651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83fc14d2b0 con 0x7f83fc149b10 2023-06-02T15:31:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f83f97fa640 1 -- 172.21.15.78:0/1252865651 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f83f4003e90 con 0x7f83fc149b10 2023-06-02T15:31:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f83f97fa640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f83e0065c00 0x7f83e00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.814+0000 7f83f97fa640 1 -- 172.21.15.78:0/1252865651 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f83f4083990 con 0x7f83fc149b10 2023-06-02T15:31:03.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.818+0000 7f8400e0e640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f83e0065c00 0x7f83e00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:03.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.818+0000 7f8400e0e640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f83e0065c00 0x7f83e00680b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f83f00b2000 tx=0x7f83f00aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:03.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.822+0000 7f83f97fa640 1 -- 172.21.15.78:0/1252865651 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f83f4050f00 con 0x7f83fc149b10 2023-06-02T15:31:03.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.974+0000 7f8403072640 1 -- 172.21.15.78:0/1252865651 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f83fc06abe0 con 0x7f83fc149b10 2023-06-02T15:31:03.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f83f97fa640 1 -- 172.21.15.78:0/1252865651 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f83f401d0a0 con 0x7f83fc149b10 2023-06-02T15:31:03.985 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:03.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 -- 172.21.15.78:0/1252865651 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f83e0065c00 msgr2=0x7f83e00680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f83e0065c00 0x7f83e00680b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f83f00b2000 tx=0x7f83f00aa070 comp rx=0 tx=0).stop 2023-06-02T15:31:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 -- 172.21.15.78:0/1252865651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 msgr2=0x7f83fc0b95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 0x7f83fc0b95d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f83f400cc60 tx=0x7f83f400a5c0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 -- 172.21.15.78:0/1252865651 shutdown_connections 2023-06-02T15:31:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f83e0065c00 0x7f83e00680b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83fc149b10 0x7f83fc0b95d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83fc0bb0d0 0x7f83fc0b8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 --2- 172.21.15.78:0/1252865651 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f83fc06ae40 0x7f83fc0bf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:03.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 -- 172.21.15.78:0/1252865651 >> 172.21.15.78:0/1252865651 conn(0x7f83fc0bd800 msgr2=0x7f83fc1471a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:03.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 -- 172.21.15.78:0/1252865651 shutdown_connections 2023-06-02T15:31:03.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:03.978+0000 7f8403072640 1 -- 172.21.15.78:0/1252865651 wait complete. 2023-06-02T15:31:04.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-02T15:31:04.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe82861640 1 Processor -- start 2023-06-02T15:31:04.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe82861640 1 -- start start 2023-06-02T15:31:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe82861640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbe7c06bd00 0x7fbe7c0bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe82861640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0b7fc0 0x7fbe7c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe82861640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c0c0730 con 0x7fbe7c0bf2b0 2023-06-02T15:31:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe82861640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c06b5f0 con 0x7fbe7c06bd00 2023-06-02T15:31:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe82861640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0c04a0 con 0x7fbe7c0b7fc0 2023-06-02T15:31:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe73fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbe7c0bf2b0 0x7fbe7c069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44310/0 (socket says 172.21.15.78:44310) 2023-06-02T15:31:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe73fff640 1 -- 172.21.15.78:0/14836482 learned_addr learned my addr 172.21.15.78:0/14836482 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7bfff640 1 --2- 172.21.15.78:0/14836482 >> v2:172.21.15.132:3300/0 conn(0x7fbe7c06bd00 0x7fbe7c0bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe80dfe640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0b7fc0 0x7fbe7c1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693150789 0 0) 0x7fbe7c0c0730 con 0x7fbe7c0bf2b0 2023-06-02T15:31:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe5c003530 con 0x7fbe7c0bf2b0 2023-06-02T15:31:04.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3760455512 0 0) 0x7fbe5c003530 con 0x7fbe7c0bf2b0 2023-06-02T15:31:04.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0b7fc0 msgr2=0x7fbe7c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:04.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0b7fc0 0x7fbe7c1521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 >> v2:172.21.15.132:3300/0 conn(0x7fbe7c06bd00 msgr2=0x7fbe7c0bff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:04.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 --2- 172.21.15.78:0/14836482 >> v2:172.21.15.132:3300/0 conn(0x7fbe7c06bd00 0x7fbe7c0bff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0c0b20 con 0x7fbe7c0bf2b0 2023-06-02T15:31:04.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fbe64001680 con 0x7fbe7c0bf2b0 2023-06-02T15:31:04.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 >> v1:172.21.15.78:6789/0 conn(0x7fbe7c0bf2b0 legacy=0x7fbe7c069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0b7fc0 0x7fbe5c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe5c003f00 0x7fbe5c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe5c004d10 0x7fbe5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0c04a0 con 0x7fbe5c004d10 2023-06-02T15:31:04.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c00b990 con 0x7fbe5c003f00 2023-06-02T15:31:04.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c00bb00 con 0x7fbe7c0b7fc0 2023-06-02T15:31:04.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe80dfe640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe5c004d10 0x7fbe5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe73fff640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe5c003f00 0x7fbe5c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe7bfff640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0b7fc0 0x7fbe5c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe80dfe640 1 -- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0b7fc0 msgr2=0x7fbe5c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe80dfe640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0b7fc0 0x7fbe5c003980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe80dfe640 1 -- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe5c003f00 msgr2=0x7fbe5c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe80dfe640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe5c003f00 0x7fbe5c0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.118+0000 7fbe80dfe640 1 -- 172.21.15.78:0/14836482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c003530 con 0x7fbe5c004d10 2023-06-02T15:31:04.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe80dfe640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe5c004d10 0x7fbe5c005180 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0b83b0 tx=0x7fbe7401cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75656fa0d7ad1b2 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:04.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740a5c10 con 0x7fbe5c004d10 2023-06-02T15:31:04.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7400f040 con 0x7fbe5c004d10 2023-06-02T15:31:04.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe7b7fe640 1 -- 172.21.15.78:0/14836482 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740ad440 con 0x7fbe5c004d10 2023-06-02T15:31:04.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 -- 172.21.15.78:0/14836482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe5c004d10 msgr2=0x7fbe5c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 --2- 172.21.15.78:0/14836482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe5c004d10 0x7fbe5c005180 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0b83b0 tx=0x7fbe7401cc00 comp rx=0 tx=0).stop 2023-06-02T15:31:04.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe80dfe640 1 -- 172.21.15.78:0/14836482 reap_dead start 2023-06-02T15:31:04.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 -- 172.21.15.78:0/14836482 shutdown_connections 2023-06-02T15:31:04.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 -- 172.21.15.78:0/14836482 >> 172.21.15.78:0/14836482 conn(0x7fbe7c0a6480 msgr2=0x7fbe7c0a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:04.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 -- 172.21.15.78:0/14836482 shutdown_connections 2023-06-02T15:31:04.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 -- 172.21.15.78:0/14836482 wait complete. 2023-06-02T15:31:04.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 Processor -- start 2023-06-02T15:31:04.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 -- start start 2023-06-02T15:31:04.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe7c1e6870 0x7fbe7c1e6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0bd610 0x7fbe7c1e7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c1d0910 0x7fbe7c1cf710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0c4080 con 0x7fbe7c1d0910 2023-06-02T15:31:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0be8c0 con 0x7fbe7c1e6870 2023-06-02T15:31:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe82861640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0bde10 con 0x7fbe7c0bd610 2023-06-02T15:31:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe80dfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c1d0910 0x7fbe7c1cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe80dfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c1d0910 0x7fbe7c1cf710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42304/0 (socket says 172.21.15.78:42304) 2023-06-02T15:31:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe80dfe640 1 -- 172.21.15.78:0/490096322 learned_addr learned my addr 172.21.15.78:0/490096322 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe7bfff640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe7c1e6870 0x7fbe7c1e6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe73fff640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0bd610 0x7fbe7c1e7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe80dfe640 1 -- 172.21.15.78:0/490096322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0bd610 msgr2=0x7fbe7c1e7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe80dfe640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0bd610 0x7fbe7c1e7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe80dfe640 1 -- 172.21.15.78:0/490096322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe7c1e6870 msgr2=0x7fbe7c1e6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe80dfe640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe7c1e6870 0x7fbe7c1e6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe80dfe640 1 -- 172.21.15.78:0/490096322 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0c0d70 con 0x7fbe7c1d0910 2023-06-02T15:31:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.122+0000 7fbe73fff640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0bd610 0x7fbe7c1e7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe80dfe640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c1d0910 0x7fbe7c1cf710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbe7401c670 tx=0x7fbe74009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe797fa640 1 -- 172.21.15.78:0/490096322 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740ae890 con 0x7fbe7c1d0910 2023-06-02T15:31:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe797fa640 1 -- 172.21.15.78:0/490096322 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe740ae9f0 con 0x7fbe7c1d0910 2023-06-02T15:31:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe82861640 1 -- 172.21.15.78:0/490096322 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c0aa880 con 0x7fbe7c1d0910 2023-06-02T15:31:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe797fa640 1 -- 172.21.15.78:0/490096322 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe740aed80 con 0x7fbe7c1d0910 2023-06-02T15:31:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe82861640 1 -- 172.21.15.78:0/490096322 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c0c1310 con 0x7fbe7c1d0910 2023-06-02T15:31:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe82861640 1 -- 172.21.15.78:0/490096322 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c0bea70 con 0x7fbe7c1d0910 2023-06-02T15:31:04.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe797fa640 1 -- 172.21.15.78:0/490096322 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fbe740b4040 con 0x7fbe7c1d0910 2023-06-02T15:31:04.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe797fa640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbe60065c00 0x7fbe600680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe797fa640 1 -- 172.21.15.78:0/490096322 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbe7411ddd0 con 0x7fbe7c1d0910 2023-06-02T15:31:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe7bfff640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbe60065c00 0x7fbe600680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.126+0000 7fbe7bfff640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbe60065c00 0x7fbe600680b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009ab0 tx=0x7fbe6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:04.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.130+0000 7fbe797fa640 1 -- 172.21.15.78:0/490096322 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fbe7c0bea70 con 0x7fbe7c1d0910 2023-06-02T15:31:04.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.306+0000 7fbe82861640 1 -- 172.21.15.78:0/490096322 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe7c0bea70 con 0x7fbe7c1d0910 2023-06-02T15:31:04.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe797fa640 1 -- 172.21.15.78:0/490096322 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3888 (secure 0 0 0) 0x7fbe7411ff40 con 0x7fbe7c1d0910 2023-06-02T15:31:04.318 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:04.318 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/4074209272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4074209272},{"type":"v1","addr":"172.21.15.78:6836","nonce":4074209272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/987093145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":987093145},{"type":"v1","addr":"172.21.15.78:6837","nonce":987093145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-02T15:30:38.611635+0000","modified":"2023-06-02T15:30:54.737249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/3115859297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3115859297},{"type":"v1","addr":"172.21.15.132:6833","nonce":3115859297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-02T15:31:04.318 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-06-02T15:31:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 -- 172.21.15.78:0/490096322 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbe60065c00 msgr2=0x7fbe600680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbe60065c00 0x7fbe600680b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009ab0 tx=0x7fbe6c008040 comp rx=0 tx=0).stop 2023-06-02T15:31:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 -- 172.21.15.78:0/490096322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c1d0910 msgr2=0x7fbe7c1cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c1d0910 0x7fbe7c1cf710 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fbe7401c670 tx=0x7fbe74009750 comp rx=0 tx=0).stop 2023-06-02T15:31:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 -- 172.21.15.78:0/490096322 shutdown_connections 2023-06-02T15:31:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fbe60065c00 0x7fbe600680b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c1d0910 0x7fbe7c1cf710 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fbe7c0bd610 0x7fbe7c1e7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 --2- 172.21.15.78:0/490096322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbe7c1e6870 0x7fbe7c1e6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 -- 172.21.15.78:0/490096322 >> 172.21.15.78:0/490096322 conn(0x7fbe7c0a6480 msgr2=0x7fbe7c1d95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:04.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 -- 172.21.15.78:0/490096322 shutdown_connections 2023-06-02T15:31:04.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.310+0000 7fbe82861640 1 -- 172.21.15.78:0/490096322 wait complete. 2023-06-02T15:31:04.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:31:04.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f44a5381640 1 Processor -- start 2023-06-02T15:31:04.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f44a5381640 1 -- start start 2023-06-02T15:31:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f44a5381640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f44a0149e00 0x7f44a00a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f44a5381640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a00bb0e0 con 0x7f44a014fe20 2023-06-02T15:31:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f44a5381640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a00a3810 con 0x7f44a00ba880 2023-06-02T15:31:04.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f44a5381640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a014a1d0 con 0x7f44a0149e00 2023-06-02T15:31:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f44a014fe20 0x7f44a01502a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44316/0 (socket says 172.21.15.78:44316) 2023-06-02T15:31:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449f7fe640 1 -- 172.21.15.78:0/2636675499 learned_addr learned my addr 172.21.15.78:0/2636675499 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 884128174 0 0) 0x7f44a00bb0e0 con 0x7f44a014fe20 2023-06-02T15:31:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4488003530 con 0x7f44a014fe20 2023-06-02T15:31:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449effd640 1 --2- 172.21.15.78:0/2636675499 >> v2:172.21.15.132:3300/0 conn(0x7f44a0149e00 0x7f44a00a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 277137797 0 0) 0x7f4488003530 con 0x7f44a014fe20 2023-06-02T15:31:04.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 >> v2:172.21.15.132:3300/0 conn(0x7f44a0149e00 msgr2=0x7f44a00a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 --2- 172.21.15.78:0/2636675499 >> v2:172.21.15.132:3300/0 conn(0x7f44a0149e00 0x7f44a00a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 >> v1:172.21.15.132:6789/0 conn(0x7f44a00ba880 legacy=0x7f44a00a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00a3af0 con 0x7f44a014fe20 2023-06-02T15:31:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f4498001a00 con 0x7f44a014fe20 2023-06-02T15:31:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 >> v1:172.21.15.78:6789/0 conn(0x7f44a014fe20 legacy=0x7f44a01502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4488003980 0x7f4488003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880047d0 0x7f4488004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4488005180 0x7f448800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a014a1d0 con 0x7f4488003980 2023-06-02T15:31:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448800c110 con 0x7f44880047d0 2023-06-02T15:31:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448800c2d0 con 0x7f4488005180 2023-06-02T15:31:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449effd640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4488003980 0x7f4488003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449e7fc640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880047d0 0x7f4488004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449effd640 1 -- 172.21.15.78:0/2636675499 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4488005180 msgr2=0x7f448800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:04.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449f7fe640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4488005180 0x7f448800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449effd640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4488005180 0x7f448800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449effd640 1 -- 172.21.15.78:0/2636675499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880047d0 msgr2=0x7f4488004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449effd640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880047d0 0x7f4488004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449effd640 1 -- 172.21.15.78:0/2636675499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4488003530 con 0x7f4488003980 2023-06-02T15:31:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.434+0000 7f449f7fe640 1 -- 172.21.15.78:0/2636675499 reap_dead start 2023-06-02T15:31:04.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f449e7fc640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880047d0 0x7f4488004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:04.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f449effd640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4488003980 0x7f4488003d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f449400ba00 tx=0x7f449401c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fed886e077bc6e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940ad410 con 0x7f4488003980 2023-06-02T15:31:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44940a7030 con 0x7f4488003980 2023-06-02T15:31:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f449dffb640 1 -- 172.21.15.78:0/2636675499 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940ad7b0 con 0x7f4488003980 2023-06-02T15:31:04.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f44a5381640 1 -- 172.21.15.78:0/2636675499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4488003980 msgr2=0x7f4488003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f44a5381640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4488003980 0x7f4488003d90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f449400ba00 tx=0x7f449401c620 comp rx=0 tx=0).stop 2023-06-02T15:31:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f44a5381640 1 -- 172.21.15.78:0/2636675499 shutdown_connections 2023-06-02T15:31:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f44a5381640 1 --2- 172.21.15.78:0/2636675499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4488003980 0x7f4488003d90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f44a5381640 1 -- 172.21.15.78:0/2636675499 >> 172.21.15.78:0/2636675499 conn(0x7f44a00bcf50 msgr2=0x7f44a00bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f44a5381640 1 -- 172.21.15.78:0/2636675499 shutdown_connections 2023-06-02T15:31:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f44a5381640 1 -- 172.21.15.78:0/2636675499 wait complete. 2023-06-02T15:31:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f44a5381640 1 Processor -- start 2023-06-02T15:31:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.438+0000 7f44a5381640 1 -- start start 2023-06-02T15:31:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44a5381640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4488003980 0x7f44a00710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44a5381640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00b6960 0x7f44a01437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44a5381640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a00b6e20 0x7f44a0143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44a5381640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00a61d0 con 0x7f44a00b6960 2023-06-02T15:31:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44a5381640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a0071620 con 0x7f44a00b6e20 2023-06-02T15:31:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44a5381640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00b9040 con 0x7f4488003980 2023-06-02T15:31:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00b6960 0x7f44a01437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00b6960 0x7f44a01437f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42328/0 (socket says 172.21.15.78:42328) 2023-06-02T15:31:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449e7fc640 1 -- 172.21.15.78:0/4081942142 learned_addr learned my addr 172.21.15.78:0/4081942142 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449effd640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4488003980 0x7f44a00710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449e7fc640 1 -- 172.21.15.78:0/4081942142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4488003980 msgr2=0x7f44a00710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449e7fc640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4488003980 0x7f44a00710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449e7fc640 1 -- 172.21.15.78:0/4081942142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a00b6e20 msgr2=0x7f44a0143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449f7fe640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a00b6e20 0x7f44a0143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449e7fc640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a00b6e20 0x7f44a0143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449e7fc640 1 -- 172.21.15.78:0/4081942142 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a01503d0 con 0x7f44a00b6960 2023-06-02T15:31:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449e7fc640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00b6960 0x7f44a01437f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4490000f30 tx=0x7f449000d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44877fe640 1 -- 172.21.15.78:0/4081942142 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449000b070 con 0x7f44a00b6960 2023-06-02T15:31:04.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44877fe640 1 -- 172.21.15.78:0/4081942142 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44900052d0 con 0x7f44a00b6960 2023-06-02T15:31:04.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44a5381640 1 -- 172.21.15.78:0/4081942142 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a0150240 con 0x7f44a00b6960 2023-06-02T15:31:04.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44877fe640 1 -- 172.21.15.78:0/4081942142 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4490003620 con 0x7f44a00b6960 2023-06-02T15:31:04.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44a5381640 1 -- 172.21.15.78:0/4081942142 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a0150560 con 0x7f44a00b6960 2023-06-02T15:31:04.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44a5381640 1 -- 172.21.15.78:0/4081942142 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a0073bc0 con 0x7f44a00b6960 2023-06-02T15:31:04.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44877fe640 1 -- 172.21.15.78:0/4081942142 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f4490003780 con 0x7f44a00b6960 2023-06-02T15:31:04.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44877fe640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f448c065c30 0x7f448c0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449effd640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f448c065c30 0x7f448c0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f44877fe640 1 -- 172.21.15.78:0/4081942142 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4490082a90 con 0x7f44a00b6960 2023-06-02T15:31:04.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.442+0000 7f449effd640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f448c065c30 0x7f448c0680e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f44880057b0 tx=0x7f44940046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:04.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.446+0000 7f44877fe640 1 -- 172.21.15.78:0/4081942142 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f449004b6e0 con 0x7f44a00b6960 2023-06-02T15:31:04.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.590+0000 7f44a5381640 1 -- 172.21.15.78:0/4081942142 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44a00a2eb0 con 0x7f44a00b6960 2023-06-02T15:31:04.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.590+0000 7f44877fe640 1 -- 172.21.15.78:0/4081942142 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f4490050020 con 0x7f44a00b6960 2023-06-02T15:31:04.600 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:04.600 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:31:04.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 -- 172.21.15.78:0/4081942142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f448c065c30 msgr2=0x7f448c0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f448c065c30 0x7f448c0680e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f44880057b0 tx=0x7f44940046d0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 -- 172.21.15.78:0/4081942142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00b6960 msgr2=0x7f44a01437f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00b6960 0x7f44a01437f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4490000f30 tx=0x7f449000d530 comp rx=0 tx=0).stop 2023-06-02T15:31:04.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 -- 172.21.15.78:0/4081942142 shutdown_connections 2023-06-02T15:31:04.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44a00b6e20 0x7f44a0143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f448c065c30 0x7f448c0680e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44a00b6960 0x7f44a01437f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 --2- 172.21.15.78:0/4081942142 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4488003980 0x7f44a00710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 -- 172.21.15.78:0/4081942142 >> 172.21.15.78:0/4081942142 conn(0x7f44a00bcf50 msgr2=0x7f44a0148d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:04.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 -- 172.21.15.78:0/4081942142 shutdown_connections 2023-06-02T15:31:04.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.594+0000 7f44a5381640 1 -- 172.21.15.78:0/4081942142 wait complete. 2023-06-02T15:31:04.617 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-02T15:30:31.844882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-02T15:30:33.293644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-02T15:30:36.277798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-02T15:30:37.599884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-02T15:30:40.680165+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-02T15:31:04.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-02T15:31:04.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.726+0000 7f9ef6105640 1 Processor -- start 2023-06-02T15:31:04.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.726+0000 7f9ef6105640 1 -- start start 2023-06-02T15:31:04.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9ef6105640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ef006cfc0 0x7f9ef00718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9ef6105640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef014d220 con 0x7f9ef006c250 2023-06-02T15:31:04.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9ef6105640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef00ba850 con 0x7f9ef00a59e0 2023-06-02T15:31:04.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9ef6105640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef00ba640 con 0x7f9ef006cfc0 2023-06-02T15:31:04.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eeeffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9ef006cfc0 0x7f9ef00718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eeffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9ef006c250 0x7f9ef0149660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44318/0 (socket says 172.21.15.78:44318) 2023-06-02T15:31:04.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eeffff640 1 -- 172.21.15.78:0/3571400631 learned_addr learned my addr 172.21.15.78:0/3571400631 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:04.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eeeffd640 1 -- 172.21.15.78:0/3571400631 >> v1:172.21.15.132:6789/0 conn(0x7f9ef00a59e0 legacy=0x7f9ef014f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:04.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eeeffd640 1 -- 172.21.15.78:0/3571400631 >> v1:172.21.15.78:6789/0 conn(0x7f9ef006c250 legacy=0x7f9ef0149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eeeffd640 1 -- 172.21.15.78:0/3571400631 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef014cf40 con 0x7f9ef006cfc0 2023-06-02T15:31:04.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eee7fc640 1 -- 172.21.15.78:0/3571400631 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984929357 0 0) 0x7f9ef014d220 con 0x7f9ef006c250 2023-06-02T15:31:04.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eeeffd640 1 --2- 172.21.15.78:0/3571400631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 0x7f9ef00718d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00097c0 tx=0x7f9ee001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8482dcff44ecb22d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:04.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eee7fc640 1 -- 172.21.15.78:0/3571400631 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00ab600 con 0x7f9ef006cfc0 2023-06-02T15:31:04.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eee7fc640 1 -- 172.21.15.78:0/3571400631 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee00a7050 con 0x7f9ef006cfc0 2023-06-02T15:31:04.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.730+0000 7f9eee7fc640 1 -- 172.21.15.78:0/3571400631 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00ab980 con 0x7f9ef006cfc0 2023-06-02T15:31:04.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- 172.21.15.78:0/3571400631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 msgr2=0x7f9ef00718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 --2- 172.21.15.78:0/3571400631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 0x7f9ef00718d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00097c0 tx=0x7f9ee001c3b0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- 172.21.15.78:0/3571400631 shutdown_connections 2023-06-02T15:31:04.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 --2- 172.21.15.78:0/3571400631 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 0x7f9ef00718d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- 172.21.15.78:0/3571400631 >> 172.21.15.78:0/3571400631 conn(0x7f9ef00a2170 msgr2=0x7f9ef00a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:04.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- 172.21.15.78:0/3571400631 shutdown_connections 2023-06-02T15:31:04.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- 172.21.15.78:0/3571400631 wait complete. 2023-06-02T15:31:04.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 Processor -- start 2023-06-02T15:31:04.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- start start 2023-06-02T15:31:04.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef006c250 0x7f9ef014f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 0x7f9ef0141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ef00a59e0 0x7f9ef014d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0141670 con 0x7f9ef006cfc0 2023-06-02T15:31:04.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef014e020 con 0x7f9ef00a59e0 2023-06-02T15:31:04.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef014dd40 con 0x7f9ef006c250 2023-06-02T15:31:04.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eeeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 0x7f9ef0141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eeeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 0x7f9ef0141130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42346/0 (socket says 172.21.15.78:42346) 2023-06-02T15:31:04.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eeeffd640 1 -- 172.21.15.78:0/2730839535 learned_addr learned my addr 172.21.15.78:0/2730839535 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:04.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eeeffd640 1 -- 172.21.15.78:0/2730839535 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef006c250 msgr2=0x7f9ef014f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eef7fe640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef006c250 0x7f9ef014f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eeffff640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ef00a59e0 0x7f9ef014d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eeeffd640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef006c250 0x7f9ef014f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eeeffd640 1 -- 172.21.15.78:0/2730839535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ef00a59e0 msgr2=0x7f9ef014d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eeeffd640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ef00a59e0 0x7f9ef014d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eeeffd640 1 -- 172.21.15.78:0/2730839535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee0009420 con 0x7f9ef006cfc0 2023-06-02T15:31:04.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9eeeffd640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 0x7f9ef0141130 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00ae040 tx=0x7f9ee001abf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:04.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ed7fff640 1 -- 172.21.15.78:0/2730839535 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00b7450 con 0x7f9ef006cfc0 2023-06-02T15:31:04.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ed7fff640 1 -- 172.21.15.78:0/2730839535 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee00b75b0 con 0x7f9ef006cfc0 2023-06-02T15:31:04.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ed7fff640 1 -- 172.21.15.78:0/2730839535 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee00b7960 con 0x7f9ef006cfc0 2023-06-02T15:31:04.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- 172.21.15.78:0/2730839535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef0149f00 con 0x7f9ef006cfc0 2023-06-02T15:31:04.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.734+0000 7f9ef6105640 1 -- 172.21.15.78:0/2730839535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef0149d70 con 0x7f9ef006cfc0 2023-06-02T15:31:04.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.738+0000 7f9ef6105640 1 -- 172.21.15.78:0/2730839535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef015a400 con 0x7f9ef006cfc0 2023-06-02T15:31:04.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.738+0000 7f9ed7fff640 1 -- 172.21.15.78:0/2730839535 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f9ee00b7ac0 con 0x7f9ef006cfc0 2023-06-02T15:31:04.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.738+0000 7f9ed7fff640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9edc065c00 0x7f9edc0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:04.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.738+0000 7f9eef7fe640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9edc065c00 0x7f9edc0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:04.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.738+0000 7f9ed7fff640 1 -- 172.21.15.78:0/2730839535 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9ee011dfd0 con 0x7f9ef006cfc0 2023-06-02T15:31:04.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.738+0000 7f9eef7fe640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9edc065c00 0x7f9edc0680b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4003d60 tx=0x7f9ee4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:04.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.742+0000 7f9ed7fff640 1 -- 172.21.15.78:0/2730839535 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f9ee00eb4b0 con 0x7f9ef006cfc0 2023-06-02T15:31:04.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 -- 172.21.15.78:0/2730839535 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9ef0073bc0 con 0x7f9ef006cfc0 2023-06-02T15:31:04.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ed7fff640 1 -- 172.21.15.78:0/2730839535 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ee00bb0a0 con 0x7f9ef006cfc0 2023-06-02T15:31:04.894 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-02T15:31:04.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 -- 172.21.15.78:0/2730839535 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9edc065c00 msgr2=0x7f9edc0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9edc065c00 0x7f9edc0680b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4003d60 tx=0x7f9ee4009040 comp rx=0 tx=0).stop 2023-06-02T15:31:04.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 -- 172.21.15.78:0/2730839535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 msgr2=0x7f9ef0141130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:04.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 0x7f9ef0141130 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9ee00ae040 tx=0x7f9ee001abf0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 -- 172.21.15.78:0/2730839535 shutdown_connections 2023-06-02T15:31:04.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ef00a59e0 0x7f9ef014d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9edc065c00 0x7f9edc0680b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9ef006cfc0 0x7f9ef0141130 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 --2- 172.21.15.78:0/2730839535 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9ef006c250 0x7f9ef014f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:04.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 -- 172.21.15.78:0/2730839535 >> 172.21.15.78:0/2730839535 conn(0x7f9ef00a2170 msgr2=0x7f9ef00bb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:04.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 -- 172.21.15.78:0/2730839535 shutdown_connections 2023-06-02T15:31:04.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:04.886+0000 7f9ef6105640 1 -- 172.21.15.78:0/2730839535 wait complete. 2023-06-02T15:31:04.911 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-02T15:31:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.010+0000 7f50496b4640 1 Processor -- start 2023-06-02T15:31:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.010+0000 7f50496b4640 1 -- start start 2023-06-02T15:31:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50496b4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5044151f90 0x7f50440c1260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50496b4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f504406bd60 0x7f504406a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50496b4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f50440aa5b0 0x7f504406a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50496b4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f504406ada0 con 0x7f504406bd60 2023-06-02T15:31:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50496b4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50440c0a50 con 0x7f50440aa5b0 2023-06-02T15:31:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50496b4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5044152360 con 0x7f5044151f90 2023-06-02T15:31:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50427fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f504406bd60 0x7f504406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50427fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f504406bd60 0x7f504406a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42356/0 (socket says 172.21.15.78:42356) 2023-06-02T15:31:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50427fc640 1 -- 172.21.15.78:0/2333077250 learned_addr learned my addr 172.21.15.78:0/2333077250 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50437fe640 1 --2- 172.21.15.78:0/2333077250 >> v2:172.21.15.132:3300/0 conn(0x7f50440aa5b0 0x7f504406a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f5042ffd640 1 --2- 172.21.15.78:0/2333077250 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5044151f90 0x7f50440c1260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50427fc640 1 -- 172.21.15.78:0/2333077250 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5044151f90 msgr2=0x7f50440c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50427fc640 1 --2- 172.21.15.78:0/2333077250 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5044151f90 0x7f50440c1260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50427fc640 1 -- 172.21.15.78:0/2333077250 >> v2:172.21.15.132:3300/0 conn(0x7f50440aa5b0 msgr2=0x7f504406a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50427fc640 1 --2- 172.21.15.78:0/2333077250 >> v2:172.21.15.132:3300/0 conn(0x7f50440aa5b0 0x7f504406a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50427fc640 1 -- 172.21.15.78:0/2333077250 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5044152620 con 0x7f504406bd60 2023-06-02T15:31:05.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50437fe640 1 --2- 172.21.15.78:0/2333077250 >> v2:172.21.15.132:3300/0 conn(0x7f50440aa5b0 0x7f504406a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f50427fc640 1 --2- 172.21.15.78:0/2333077250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f504406bd60 0x7f504406a320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5044072a20 tx=0x7f503801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d49a70b07c7ca0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f5041ffb640 1 -- 172.21.15.78:0/2333077250 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50380a89b0 con 0x7f504406bd60 2023-06-02T15:31:05.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f5041ffb640 1 -- 172.21.15.78:0/2333077250 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50380a8b10 con 0x7f504406bd60 2023-06-02T15:31:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.014+0000 7f5041ffb640 1 -- 172.21.15.78:0/2333077250 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50380a8ea0 con 0x7f504406bd60 2023-06-02T15:31:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- 172.21.15.78:0/2333077250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f504406bd60 msgr2=0x7f504406a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 --2- 172.21.15.78:0/2333077250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f504406bd60 0x7f504406a320 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5044072a20 tx=0x7f503801ecf0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- 172.21.15.78:0/2333077250 shutdown_connections 2023-06-02T15:31:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 --2- 172.21.15.78:0/2333077250 >> v2:172.21.15.132:3300/0 conn(0x7f50440aa5b0 0x7f504406a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 --2- 172.21.15.78:0/2333077250 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f504406bd60 0x7f504406a320 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 --2- 172.21.15.78:0/2333077250 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5044151f90 0x7f50440c1260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- 172.21.15.78:0/2333077250 >> 172.21.15.78:0/2333077250 conn(0x7f50440a63c0 msgr2=0x7f50440a67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- 172.21.15.78:0/2333077250 shutdown_connections 2023-06-02T15:31:05.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- 172.21.15.78:0/2333077250 wait complete. 2023-06-02T15:31:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 Processor -- start 2023-06-02T15:31:05.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- start start 2023-06-02T15:31:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f504406bd60 0x7f504414e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440aa5b0 0x7f50441e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5044151f90 0x7f50441e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50440bead0 con 0x7f5044151f90 2023-06-02T15:31:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50441e6880 con 0x7f50440aa5b0 2023-06-02T15:31:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f504414ea40 con 0x7f504406bd60 2023-06-02T15:31:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50437fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5044151f90 0x7f50441e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50437fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5044151f90 0x7f50441e70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42364/0 (socket says 172.21.15.78:42364) 2023-06-02T15:31:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50437fe640 1 -- 172.21.15.78:0/268195418 learned_addr learned my addr 172.21.15.78:0/268195418 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50427fc640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440aa5b0 0x7f50441e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50437fe640 1 -- 172.21.15.78:0/268195418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f504406bd60 msgr2=0x7f504414e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50437fe640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f504406bd60 0x7f504414e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50437fe640 1 -- 172.21.15.78:0/268195418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440aa5b0 msgr2=0x7f50441e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50437fe640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440aa5b0 0x7f50441e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50437fe640 1 -- 172.21.15.78:0/268195418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50380094d0 con 0x7f5044151f90 2023-06-02T15:31:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50427fc640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440aa5b0 0x7f50441e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50437fe640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5044151f90 0x7f50441e70f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f503c00cea0 tx=0x7f503c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f502b7fe640 1 -- 172.21.15.78:0/268195418 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c003ba0 con 0x7f5044151f90 2023-06-02T15:31:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f502b7fe640 1 -- 172.21.15.78:0/268195418 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f503c003d20 con 0x7f5044151f90 2023-06-02T15:31:05.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f502b7fe640 1 -- 172.21.15.78:0/268195418 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503c00d880 con 0x7f5044151f90 2023-06-02T15:31:05.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- 172.21.15.78:0/268195418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50440bf320 con 0x7f5044151f90 2023-06-02T15:31:05.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.018+0000 7f50496b4640 1 -- 172.21.15.78:0/268195418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5044152900 con 0x7f5044151f90 2023-06-02T15:31:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.022+0000 7f50496b4640 1 -- 172.21.15.78:0/268195418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50440c0ee0 con 0x7f5044151f90 2023-06-02T15:31:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.022+0000 7f502b7fe640 1 -- 172.21.15.78:0/268195418 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f503c00d9e0 con 0x7f5044151f90 2023-06-02T15:31:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.022+0000 7f502b7fe640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5030065c00 0x7f50300680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.022+0000 7f502b7fe640 1 -- 172.21.15.78:0/268195418 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f503c083f70 con 0x7f5044151f90 2023-06-02T15:31:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.022+0000 7f5042ffd640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5030065c00 0x7f50300680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.022+0000 7f5042ffd640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5030065c00 0x7f50300680b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f503400a790 tx=0x7f5034008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.026+0000 7f502b7fe640 1 -- 172.21.15.78:0/268195418 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f503c04c6e0 con 0x7f5044151f90 2023-06-02T15:31:05.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.174+0000 7f50496b4640 1 -- 172.21.15.78:0/268195418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5044073bc0 con 0x7f5044151f90 2023-06-02T15:31:05.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.174+0000 7f502b7fe640 1 -- 172.21.15.78:0/268195418 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f503c051450 con 0x7f5044151f90 2023-06-02T15:31:05.184 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-02T15:31:05.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 -- 172.21.15.78:0/268195418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5030065c00 msgr2=0x7f50300680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5030065c00 0x7f50300680b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f503400a790 tx=0x7f5034008040 comp rx=0 tx=0).stop 2023-06-02T15:31:05.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 -- 172.21.15.78:0/268195418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5044151f90 msgr2=0x7f50441e70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5044151f90 0x7f50441e70f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f503c00cea0 tx=0x7f503c00cf90 comp rx=0 tx=0).stop 2023-06-02T15:31:05.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 -- 172.21.15.78:0/268195418 shutdown_connections 2023-06-02T15:31:05.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5030065c00 0x7f50300680b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5044151f90 0x7f50441e70f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f50440aa5b0 0x7f50441e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 --2- 172.21.15.78:0/268195418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f504406bd60 0x7f504414e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 -- 172.21.15.78:0/268195418 >> 172.21.15.78:0/268195418 conn(0x7f50440a63c0 msgr2=0x7f50440a4330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 -- 172.21.15.78:0/268195418 shutdown_connections 2023-06-02T15:31:05.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.178+0000 7f50496b4640 1 -- 172.21.15.78:0/268195418 wait complete. 2023-06-02T15:31:05.202 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-02T15:31:05.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.314+0000 7f888366d640 1 Processor -- start 2023-06-02T15:31:05.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.314+0000 7f888366d640 1 -- start start 2023-06-02T15:31:05.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f888366d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f887c06cfc0 0x7f887c0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f888366d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c14d220 con 0x7f887c0a59e0 2023-06-02T15:31:05.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f888366d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f887c0ba850 con 0x7f887c06c250 2023-06-02T15:31:05.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f888366d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887c0ba640 con 0x7f887c06cfc0 2023-06-02T15:31:05.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8881409640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f887c0a59e0 0x7f887c14f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44326/0 (socket says 172.21.15.78:44326) 2023-06-02T15:31:05.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8881409640 1 -- 172.21.15.78:0/1600146369 learned_addr learned my addr 172.21.15.78:0/1600146369 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8880c08640 1 --2- 172.21.15.78:0/1600146369 >> v2:172.21.15.132:3300/0 conn(0x7f887c06cfc0 0x7f887c0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513636075 0 0) 0x7f887c14d220 con 0x7f887c0a59e0 2023-06-02T15:31:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8864003530 con 0x7f887c0a59e0 2023-06-02T15:31:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 504645522 0 0) 0x7f8864003530 con 0x7f887c0a59e0 2023-06-02T15:31:05.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 >> v2:172.21.15.132:3300/0 conn(0x7f887c06cfc0 msgr2=0x7f887c0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 --2- 172.21.15.78:0/1600146369 >> v2:172.21.15.132:3300/0 conn(0x7f887c06cfc0 0x7f887c0718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 >> v1:172.21.15.132:6789/0 conn(0x7f887c06c250 legacy=0x7f887c149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c14cf40 con 0x7f887c0a59e0 2023-06-02T15:31:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f8874001a00 con 0x7f887c0a59e0 2023-06-02T15:31:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 >> v1:172.21.15.78:6789/0 conn(0x7f887c0a59e0 legacy=0x7f887c14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 --2- 172.21.15.78:0/1600146369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88640039f0 0x7f8864003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 --2- 172.21.15.78:0/1600146369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88640047d0 0x7f8864004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 --2- 172.21.15.78:0/1600146369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88640051d0 0x7f886400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0ba640 con 0x7f88640039f0 2023-06-02T15:31:05.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886400c110 con 0x7f88640047d0 2023-06-02T15:31:05.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886400c2d0 con 0x7f88640051d0 2023-06-02T15:31:05.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8881409640 1 --2- 172.21.15.78:0/1600146369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88640039f0 0x7f8864003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8880c08640 1 --2- 172.21.15.78:0/1600146369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88640047d0 0x7f8864004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8881409640 1 -- 172.21.15.78:0/1600146369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88640051d0 msgr2=0x7f886400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:05.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8881409640 1 --2- 172.21.15.78:0/1600146369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88640051d0 0x7f886400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8881409640 1 -- 172.21.15.78:0/1600146369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88640047d0 msgr2=0x7f8864004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8881409640 1 --2- 172.21.15.78:0/1600146369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88640047d0 0x7f8864004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8881409640 1 -- 172.21.15.78:0/1600146369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864003530 con 0x7f88640039f0 2023-06-02T15:31:05.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.318+0000 7f8881c0a640 1 -- 172.21.15.78:0/1600146369 reap_dead start 2023-06-02T15:31:05.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8881409640 1 --2- 172.21.15.78:0/1600146369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88640039f0 0x7f8864003e00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f887400a800 tx=0x7f887401d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d2f61784e9387fb server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88740072d0 con 0x7f88640039f0 2023-06-02T15:31:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88740a8070 con 0x7f88640039f0 2023-06-02T15:31:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f887bfff640 1 -- 172.21.15.78:0/1600146369 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88740076f0 con 0x7f88640039f0 2023-06-02T15:31:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- 172.21.15.78:0/1600146369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88640039f0 msgr2=0x7f8864003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 --2- 172.21.15.78:0/1600146369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88640039f0 0x7f8864003e00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f887400a800 tx=0x7f887401d2e0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- 172.21.15.78:0/1600146369 shutdown_connections 2023-06-02T15:31:05.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 --2- 172.21.15.78:0/1600146369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f88640039f0 0x7f8864003e00 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- 172.21.15.78:0/1600146369 >> 172.21.15.78:0/1600146369 conn(0x7f887c0a2170 msgr2=0x7f887c0a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- 172.21.15.78:0/1600146369 shutdown_connections 2023-06-02T15:31:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- 172.21.15.78:0/1600146369 wait complete. 2023-06-02T15:31:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 Processor -- start 2023-06-02T15:31:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- start start 2023-06-02T15:31:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88640039f0 0x7f887c0a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f887c0b9a50 0x7f887c0c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f887c0704e0 0x7f887c070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0bed40 con 0x7f887c0b9a50 2023-06-02T15:31:05.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0bea30 con 0x7f887c0704e0 2023-06-02T15:31:05.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f887c0be320 con 0x7f88640039f0 2023-06-02T15:31:05.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8880c08640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f887c0b9a50 0x7f887c0c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8880c08640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f887c0b9a50 0x7f887c0c03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42380/0 (socket says 172.21.15.78:42380) 2023-06-02T15:31:05.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8880c08640 1 -- 172.21.15.78:0/2520771285 learned_addr learned my addr 172.21.15.78:0/2520771285 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:05.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8881409640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88640039f0 0x7f887c0a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8880c08640 1 -- 172.21.15.78:0/2520771285 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88640039f0 msgr2=0x7f887c0a5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8880c08640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88640039f0 0x7f887c0a5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8880c08640 1 -- 172.21.15.78:0/2520771285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f887c0704e0 msgr2=0x7f887c070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8881c0a640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f887c0704e0 0x7f887c070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8880c08640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f887c0704e0 0x7f887c070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8880c08640 1 -- 172.21.15.78:0/2520771285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c1497f0 con 0x7f887c0b9a50 2023-06-02T15:31:05.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8880c08640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f887c0b9a50 0x7f887c0c03d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f88700108d0 tx=0x7f8870010d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8879ffb640 1 -- 172.21.15.78:0/2520771285 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8870009670 con 0x7f887c0b9a50 2023-06-02T15:31:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8879ffb640 1 -- 172.21.15.78:0/2520771285 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887000eb00 con 0x7f887c0b9a50 2023-06-02T15:31:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- 172.21.15.78:0/2520771285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f887c149660 con 0x7f887c0b9a50 2023-06-02T15:31:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f8879ffb640 1 -- 172.21.15.78:0/2520771285 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887000ee90 con 0x7f887c0b9a50 2023-06-02T15:31:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.322+0000 7f888366d640 1 -- 172.21.15.78:0/2520771285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f887c149980 con 0x7f887c0b9a50 2023-06-02T15:31:05.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.326+0000 7f888366d640 1 -- 172.21.15.78:0/2520771285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f887c0be4e0 con 0x7f887c0b9a50 2023-06-02T15:31:05.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.326+0000 7f8879ffb640 1 -- 172.21.15.78:0/2520771285 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f887001c400 con 0x7f887c0b9a50 2023-06-02T15:31:05.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.326+0000 7f8879ffb640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8868065c00 0x7f88680680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.326+0000 7f8879ffb640 1 -- 172.21.15.78:0/2520771285 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8870083ab0 con 0x7f887c0b9a50 2023-06-02T15:31:05.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.326+0000 7f8881409640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8868065c00 0x7f88680680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.326+0000 7f8881409640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8868065c00 0x7f88680680b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f88740ad000 tx=0x7f8874009050 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.330+0000 7f8879ffb640 1 -- 172.21.15.78:0/2520771285 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f8870051070 con 0x7f887c0b9a50 2023-06-02T15:31:05.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.474+0000 7f888366d640 1 -- 172.21.15.78:0/2520771285 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f887c0be4e0 con 0x7f887c0b9a50 2023-06-02T15:31:05.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.474+0000 7f8879ffb640 1 -- 172.21.15.78:0/2520771285 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f887c0be4e0 con 0x7f887c0b9a50 2023-06-02T15:31:05.485 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 -- 172.21.15.78:0/2520771285 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8868065c00 msgr2=0x7f88680680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8868065c00 0x7f88680680b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f88740ad000 tx=0x7f8874009050 comp rx=0 tx=0).stop 2023-06-02T15:31:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 -- 172.21.15.78:0/2520771285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f887c0b9a50 msgr2=0x7f887c0c03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f887c0b9a50 0x7f887c0c03d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f88700108d0 tx=0x7f8870010d90 comp rx=0 tx=0).stop 2023-06-02T15:31:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 -- 172.21.15.78:0/2520771285 shutdown_connections 2023-06-02T15:31:05.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f887c0704e0 0x7f887c070950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8868065c00 0x7f88680680b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f887c0b9a50 0x7f887c0c03d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 --2- 172.21.15.78:0/2520771285 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f88640039f0 0x7f887c0a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 -- 172.21.15.78:0/2520771285 >> 172.21.15.78:0/2520771285 conn(0x7f887c0a2170 msgr2=0x7f887c148bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 -- 172.21.15.78:0/2520771285 shutdown_connections 2023-06-02T15:31:05.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.478+0000 7f888366d640 1 -- 172.21.15.78:0/2520771285 wait complete. 2023-06-02T15:31:05.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-02T15:31:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.614+0000 7f87806b3640 1 Processor -- start 2023-06-02T15:31:05.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.614+0000 7f87806b3640 1 -- start start 2023-06-02T15:31:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f87806b3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f877806ff30 0x7f8778070300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f87806b3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87780bc5d0 0x7f877814b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f87806b3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8778071230 con 0x7f877814bcb0 2023-06-02T15:31:05.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f87806b3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87780bc3a0 con 0x7f877806ff30 2023-06-02T15:31:05.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f87806b3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87780bc100 con 0x7f87780bc5d0 2023-06-02T15:31:05.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877dc4e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87780bc5d0 0x7f877814b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877e44f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f877806ff30 0x7f8778070300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877e44f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f877806ff30 0x7f8778070300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:54734/0 (socket says 172.21.15.78:54734) 2023-06-02T15:31:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877e44f640 1 -- 172.21.15.78:0/3891507497 learned_addr learned my addr 172.21.15.78:0/3891507497 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877dc4e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87780bc5d0 0x7f877814b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:54622/0 (socket says 172.21.15.78:54622) 2023-06-02T15:31:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877ec50640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f877814bcb0 0x7f877814e570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:59502/0 (socket says 172.21.15.78:59502) 2023-06-02T15:31:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877e44f640 1 -- 172.21.15.78:0/3891507497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87780bc5d0 msgr2=0x7f877814b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:05.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877e44f640 1 --2- 172.21.15.78:0/3891507497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87780bc5d0 0x7f877814b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877e44f640 1 -- 172.21.15.78:0/3891507497 >> v1:172.21.15.132:6789/0 conn(0x7f877814bcb0 legacy=0x7f877814e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877e44f640 1 -- 172.21.15.78:0/3891507497 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8778070ec0 con 0x7f877806ff30 2023-06-02T15:31:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.618+0000 7f877dc4e640 1 --2- 172.21.15.78:0/3891507497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87780bc5d0 0x7f877814b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:31:05.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877e44f640 1 --2- 172.21.15.78:0/3891507497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f877806ff30 0x7f8778070300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8770009e50 tx=0x7f877001ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64b3afa10ed1d714 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877d44d640 1 -- 172.21.15.78:0/3891507497 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700a57f0 con 0x7f877806ff30 2023-06-02T15:31:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877d44d640 1 -- 172.21.15.78:0/3891507497 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87700a5950 con 0x7f877806ff30 2023-06-02T15:31:05.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877d44d640 1 -- 172.21.15.78:0/3891507497 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700a5ce0 con 0x7f877806ff30 2023-06-02T15:31:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 -- 172.21.15.78:0/3891507497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f877806ff30 msgr2=0x7f8778070300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 --2- 172.21.15.78:0/3891507497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f877806ff30 0x7f8778070300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8770009e50 tx=0x7f877001ca10 comp rx=0 tx=0).stop 2023-06-02T15:31:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 -- 172.21.15.78:0/3891507497 shutdown_connections 2023-06-02T15:31:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 --2- 172.21.15.78:0/3891507497 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f87780bc5d0 0x7f877814b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 --2- 172.21.15.78:0/3891507497 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f877806ff30 0x7f8778070300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 -- 172.21.15.78:0/3891507497 >> 172.21.15.78:0/3891507497 conn(0x7f87780bd750 msgr2=0x7f87780bdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:05.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 -- 172.21.15.78:0/3891507497 shutdown_connections 2023-06-02T15:31:05.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 -- 172.21.15.78:0/3891507497 wait complete. 2023-06-02T15:31:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 Processor -- start 2023-06-02T15:31:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 -- start start 2023-06-02T15:31:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f877806ff30 0x7f877813aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87780bc5d0 0x7f87781422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f877814bcb0 0x7f87781e6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877814cd50 con 0x7f87780bc5d0 2023-06-02T15:31:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87781493a0 con 0x7f877814bcb0 2023-06-02T15:31:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f87806b3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877813d780 con 0x7f877806ff30 2023-06-02T15:31:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877dc4e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87780bc5d0 0x7f87781422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877dc4e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87780bc5d0 0x7f87781422f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42394/0 (socket says 172.21.15.78:42394) 2023-06-02T15:31:05.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877dc4e640 1 -- 172.21.15.78:0/2033954111 learned_addr learned my addr 172.21.15.78:0/2033954111 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877ec50640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f877814bcb0 0x7f87781e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877e44f640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f877806ff30 0x7f877813aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877dc4e640 1 -- 172.21.15.78:0/2033954111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f877806ff30 msgr2=0x7f877813aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877dc4e640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f877806ff30 0x7f877813aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877dc4e640 1 -- 172.21.15.78:0/2033954111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f877814bcb0 msgr2=0x7f87781e6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877dc4e640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f877814bcb0 0x7f87781e6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877dc4e640 1 -- 172.21.15.78:0/2033954111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8768009420 con 0x7f87780bc5d0 2023-06-02T15:31:05.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877e44f640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f877806ff30 0x7f877813aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:05.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f877dc4e640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87780bc5d0 0x7f87781422f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f876800ebe0 tx=0x7f876800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.622+0000 7f876effd640 1 -- 172.21.15.78:0/2033954111 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876800eee0 con 0x7f87780bc5d0 2023-06-02T15:31:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.626+0000 7f876effd640 1 -- 172.21.15.78:0/2033954111 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f876800cc30 con 0x7f87780bc5d0 2023-06-02T15:31:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.626+0000 7f87806b3640 1 -- 172.21.15.78:0/2033954111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8770009b30 con 0x7f87780bc5d0 2023-06-02T15:31:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.626+0000 7f876effd640 1 -- 172.21.15.78:0/2033954111 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8768013470 con 0x7f87780bc5d0 2023-06-02T15:31:05.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.626+0000 7f87806b3640 1 -- 172.21.15.78:0/2033954111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877814f220 con 0x7f87780bc5d0 2023-06-02T15:31:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.626+0000 7f87806b3640 1 -- 172.21.15.78:0/2033954111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877814f090 con 0x7f87780bc5d0 2023-06-02T15:31:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.626+0000 7f876effd640 1 -- 172.21.15.78:0/2033954111 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f87680135d0 con 0x7f87780bc5d0 2023-06-02T15:31:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.626+0000 7f876effd640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f875c065c00 0x7f875c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.626+0000 7f877e44f640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f875c065c00 0x7f875c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.626+0000 7f876effd640 1 -- 172.21.15.78:0/2033954111 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f87680838a0 con 0x7f87780bc5d0 2023-06-02T15:31:05.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.626+0000 7f877e44f640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f875c065c00 0x7f875c0680b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f87700ae000 tx=0x7f87700a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.630+0000 7f876effd640 1 -- 172.21.15.78:0/2033954111 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f87680548a0 con 0x7f87780bc5d0 2023-06-02T15:31:05.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.782+0000 7f87806b3640 1 -- 172.21.15.78:0/2033954111 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8778149610 con 0x7f87780bc5d0 2023-06-02T15:31:05.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.782+0000 7f876effd640 1 -- 172.21.15.78:0/2033954111 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8768054430 con 0x7f87780bc5d0 2023-06-02T15:31:05.791 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-02T15:31:05.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.782+0000 7f87806b3640 1 -- 172.21.15.78:0/2033954111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f875c065c00 msgr2=0x7f875c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.782+0000 7f87806b3640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f875c065c00 0x7f875c0680b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f87700ae000 tx=0x7f87700a7070 comp rx=0 tx=0).stop 2023-06-02T15:31:05.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.786+0000 7f87806b3640 1 -- 172.21.15.78:0/2033954111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87780bc5d0 msgr2=0x7f87781422f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.786+0000 7f87806b3640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87780bc5d0 0x7f87781422f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f876800ebe0 tx=0x7f876800c520 comp rx=0 tx=0).stop 2023-06-02T15:31:05.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.786+0000 7f87806b3640 1 -- 172.21.15.78:0/2033954111 shutdown_connections 2023-06-02T15:31:05.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.786+0000 7f87806b3640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f877814bcb0 0x7f87781e6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.786+0000 7f87806b3640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f875c065c00 0x7f875c0680b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.786+0000 7f87806b3640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87780bc5d0 0x7f87781422f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.786+0000 7f87806b3640 1 --2- 172.21.15.78:0/2033954111 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f877806ff30 0x7f877813aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.786+0000 7f87806b3640 1 -- 172.21.15.78:0/2033954111 >> 172.21.15.78:0/2033954111 conn(0x7f87780bd750 msgr2=0x7f877806c920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:05.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.786+0000 7f87806b3640 1 -- 172.21.15.78:0/2033954111 shutdown_connections 2023-06-02T15:31:05.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.786+0000 7f87806b3640 1 -- 172.21.15.78:0/2033954111 wait complete. 2023-06-02T15:31:05.809 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-02T15:31:05.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff428ba3640 1 Processor -- start 2023-06-02T15:31:05.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff428ba3640 1 -- start start 2023-06-02T15:31:05.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff428ba3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4240bb0d0 0x7ff4240bc450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff428ba3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff4240bab80 0x7ff4240bc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff428ba3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4240bced0 con 0x7ff424149b10 2023-06-02T15:31:05.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff428ba3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42414ce40 con 0x7ff4240bab80 2023-06-02T15:31:05.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff428ba3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff424149ee0 con 0x7ff4240bb0d0 2023-06-02T15:31:05.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff42259c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff424149b10 0x7ff42406a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44328/0 (socket says 172.21.15.78:44328) 2023-06-02T15:31:05.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff42259c640 1 -- 172.21.15.78:0/1324733500 learned_addr learned my addr 172.21.15.78:0/1324733500 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:05.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff422d9d640 1 --2- 172.21.15.78:0/1324733500 >> v2:172.21.15.78:3300/0 conn(0x7ff4240bab80 0x7ff4240bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff42159a640 1 -- 172.21.15.78:0/1324733500 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281354401 0 0) 0x7ff4240bced0 con 0x7ff424149b10 2023-06-02T15:31:05.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff42159a640 1 -- 172.21.15.78:0/1324733500 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff40c003530 con 0x7ff424149b10 2023-06-02T15:31:05.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff421d9b640 1 --2- 172.21.15.78:0/1324733500 >> v2:172.21.15.132:3300/0 conn(0x7ff4240bb0d0 0x7ff4240bc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff422d9d640 1 -- 172.21.15.78:0/1324733500 >> v2:172.21.15.132:3300/0 conn(0x7ff4240bb0d0 msgr2=0x7ff4240bc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:05.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff422d9d640 1 --2- 172.21.15.78:0/1324733500 >> v2:172.21.15.132:3300/0 conn(0x7ff4240bb0d0 0x7ff4240bc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff422d9d640 1 -- 172.21.15.78:0/1324733500 >> v1:172.21.15.78:6789/0 conn(0x7ff424149b10 legacy=0x7ff42406a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.922+0000 7ff422d9d640 1 -- 172.21.15.78:0/1324733500 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42414c550 con 0x7ff4240bab80 2023-06-02T15:31:05.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff422d9d640 1 --2- 172.21.15.78:0/1324733500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 0x7ff4240bc990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff42406efd0 tx=0x7ff41c01f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6c3336137d2a25 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42159a640 1 -- 172.21.15.78:0/1324733500 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0b0440 con 0x7ff4240bab80 2023-06-02T15:31:05.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42159a640 1 -- 172.21.15.78:0/1324733500 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff41c0b05a0 con 0x7ff4240bab80 2023-06-02T15:31:05.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42159a640 1 -- 172.21.15.78:0/1324733500 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff41c0b0930 con 0x7ff4240bab80 2023-06-02T15:31:05.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- 172.21.15.78:0/1324733500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 msgr2=0x7ff4240bc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 --2- 172.21.15.78:0/1324733500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 0x7ff4240bc990 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff42406efd0 tx=0x7ff41c01f0f0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- 172.21.15.78:0/1324733500 shutdown_connections 2023-06-02T15:31:05.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 --2- 172.21.15.78:0/1324733500 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 0x7ff4240bc990 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 --2- 172.21.15.78:0/1324733500 >> v2:172.21.15.132:3300/0 conn(0x7ff4240bb0d0 0x7ff4240bc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- 172.21.15.78:0/1324733500 >> 172.21.15.78:0/1324733500 conn(0x7ff4240bd800 msgr2=0x7ff4240bdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:05.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- 172.21.15.78:0/1324733500 shutdown_connections 2023-06-02T15:31:05.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- 172.21.15.78:0/1324733500 wait complete. 2023-06-02T15:31:05.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 Processor -- start 2023-06-02T15:31:05.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- start start 2023-06-02T15:31:05.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 0x7ff42413f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4240bb0d0 0x7ff4240b8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff424149b10 0x7ff4241e48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240b9ed0 con 0x7ff4240bab80 2023-06-02T15:31:05.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240b9920 con 0x7ff4240bb0d0 2023-06-02T15:31:05.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4240c0480 con 0x7ff424149b10 2023-06-02T15:31:05.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 0x7ff42413f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 0x7ff42413f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42414/0 (socket says 172.21.15.78:42414) 2023-06-02T15:31:05.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42259c640 1 -- 172.21.15.78:0/1767890332 learned_addr learned my addr 172.21.15.78:0/1767890332 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:05.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff421d9b640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4240bb0d0 0x7ff4240b8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42259c640 1 -- 172.21.15.78:0/1767890332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff424149b10 msgr2=0x7ff4241e48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff422d9d640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff424149b10 0x7ff4241e48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42259c640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff424149b10 0x7ff4241e48c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42259c640 1 -- 172.21.15.78:0/1767890332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4240bb0d0 msgr2=0x7ff4240b8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:05.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42259c640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4240bb0d0 0x7ff4240b8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:05.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42259c640 1 -- 172.21.15.78:0/1767890332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff41c009a70 con 0x7ff4240bab80 2023-06-02T15:31:05.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff421d9b640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4240bb0d0 0x7ff4240b8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:05.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff42259c640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 0x7ff42413f790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c420 tx=0x7ff41400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff412ffd640 1 -- 172.21.15.78:0/1767890332 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff414005cf0 con 0x7ff4240bab80 2023-06-02T15:31:05.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff412ffd640 1 -- 172.21.15.78:0/1767890332 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff414005e50 con 0x7ff4240bab80 2023-06-02T15:31:05.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff412ffd640 1 -- 172.21.15.78:0/1767890332 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4140072d0 con 0x7ff4240bab80 2023-06-02T15:31:05.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- 172.21.15.78:0/1767890332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42414cad0 con 0x7ff4240bab80 2023-06-02T15:31:05.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.926+0000 7ff428ba3640 1 -- 172.21.15.78:0/1767890332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42414c7f0 con 0x7ff4240bab80 2023-06-02T15:31:05.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.930+0000 7ff428ba3640 1 -- 172.21.15.78:0/1767890332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4240b9ae0 con 0x7ff4240bab80 2023-06-02T15:31:05.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.930+0000 7ff412ffd640 1 -- 172.21.15.78:0/1767890332 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7ff414007430 con 0x7ff4240bab80 2023-06-02T15:31:05.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.930+0000 7ff412ffd640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff404065c00 0x7ff4040680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:05.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.930+0000 7ff421d9b640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff404065c00 0x7ff4040680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:05.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.930+0000 7ff412ffd640 1 -- 172.21.15.78:0/1767890332 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff414082a80 con 0x7ff4240bab80 2023-06-02T15:31:05.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.930+0000 7ff421d9b640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff404065c00 0x7ff4040680b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff42406aaf0 tx=0x7ff418008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:05.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:05.934+0000 7ff412ffd640 1 -- 172.21.15.78:0/1767890332 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7ff41404a6e0 con 0x7ff4240bab80 2023-06-02T15:31:06.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.082+0000 7ff428ba3640 1 -- 172.21.15.78:0/1767890332 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff4240b6410 con 0x7ff4240bab80 2023-06-02T15:31:06.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff412ffd640 1 -- 172.21.15.78:0/1767890332 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff414017020 con 0x7ff4240bab80 2023-06-02T15:31:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 -- 172.21.15.78:0/1767890332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff404065c00 msgr2=0x7ff4040680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff404065c00 0x7ff4040680b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff42406aaf0 tx=0x7ff418008040 comp rx=0 tx=0).stop 2023-06-02T15:31:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 -- 172.21.15.78:0/1767890332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 msgr2=0x7ff42413f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 0x7ff42413f790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff41400c420 tx=0x7ff41400c8e0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 -- 172.21.15.78:0/1767890332 shutdown_connections 2023-06-02T15:31:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff424149b10 0x7ff4241e48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4240bb0d0 0x7ff4240b8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff404065c00 0x7ff4040680b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 --2- 172.21.15.78:0/1767890332 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4240bab80 0x7ff42413f790 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 -- 172.21.15.78:0/1767890332 >> 172.21.15.78:0/1767890332 conn(0x7ff4240bd800 msgr2=0x7ff42406a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:06.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 -- 172.21.15.78:0/1767890332 shutdown_connections 2023-06-02T15:31:06.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.086+0000 7ff428ba3640 1 -- 172.21.15.78:0/1767890332 wait complete. 2023-06-02T15:31:06.111 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-02T15:31:06.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.206+0000 7f23a6170640 1 Processor -- start 2023-06-02T15:31:06.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.206+0000 7f23a6170640 1 -- start start 2023-06-02T15:31:06.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f23a6170640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23a00ba880 0x7f23a00a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f23a6170640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23a014fe20 0x7f23a01502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f23a6170640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23a00bb0e0 con 0x7f23a0149e00 2023-06-02T15:31:06.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f23a6170640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23a014a1d0 con 0x7f23a00ba880 2023-06-02T15:31:06.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f23a6170640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00a61d0 con 0x7f23a014fe20 2023-06-02T15:31:06.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23a00ba880 0x7f23a00a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f23a0149e00 0x7f23a00a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44330/0 (socket says 172.21.15.78:44330) 2023-06-02T15:31:06.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23a00ba880 0x7f23a00a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42416/0 (socket says 172.21.15.78:42416) 2023-06-02T15:31:06.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239f7fe640 1 -- 172.21.15.78:0/3433043360 learned_addr learned my addr 172.21.15.78:0/3433043360 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:06.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239effd640 1 -- 172.21.15.78:0/3433043360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23a014fe20 msgr2=0x7f23a01502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:06.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239effd640 1 --2- 172.21.15.78:0/3433043360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23a014fe20 0x7f23a01502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239effd640 1 -- 172.21.15.78:0/3433043360 >> v1:172.21.15.78:6789/0 conn(0x7f23a0149e00 legacy=0x7f23a00a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239effd640 1 -- 172.21.15.78:0/3433043360 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a00a3810 con 0x7f23a00ba880 2023-06-02T15:31:06.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239effd640 1 --2- 172.21.15.78:0/3433043360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 0x7f23a00a5bd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f23940097c0 tx=0x7f239401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aeb2475dba2b270 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:06.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239e7fc640 1 -- 172.21.15.78:0/3433043360 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940ab600 con 0x7f23a00ba880 2023-06-02T15:31:06.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239e7fc640 1 -- 172.21.15.78:0/3433043360 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23940a7050 con 0x7f23a00ba880 2023-06-02T15:31:06.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f239e7fc640 1 -- 172.21.15.78:0/3433043360 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23940ab980 con 0x7f23a00ba880 2023-06-02T15:31:06.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f23a6170640 1 -- 172.21.15.78:0/3433043360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 msgr2=0x7f23a00a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.210+0000 7f23a6170640 1 --2- 172.21.15.78:0/3433043360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 0x7f23a00a5bd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f23940097c0 tx=0x7f239401c480 comp rx=0 tx=0).stop 2023-06-02T15:31:06.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- 172.21.15.78:0/3433043360 shutdown_connections 2023-06-02T15:31:06.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 --2- 172.21.15.78:0/3433043360 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23a014fe20 0x7f23a01502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 --2- 172.21.15.78:0/3433043360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 0x7f23a00a5bd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- 172.21.15.78:0/3433043360 >> 172.21.15.78:0/3433043360 conn(0x7f23a00bcf50 msgr2=0x7f23a00bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:06.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- 172.21.15.78:0/3433043360 shutdown_connections 2023-06-02T15:31:06.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- 172.21.15.78:0/3433043360 wait complete. 2023-06-02T15:31:06.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 Processor -- start 2023-06-02T15:31:06.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- start start 2023-06-02T15:31:06.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 0x7f23a0155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23a0149e00 0x7f23a00a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23a014fe20 0x7f23a0141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a00a1dd0 con 0x7f23a00ba880 2023-06-02T15:31:06.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0155a60 con 0x7f23a014fe20 2023-06-02T15:31:06.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23a0148c10 con 0x7f23a0149e00 2023-06-02T15:31:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f239f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 0x7f23a0155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f239f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 0x7f23a0155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42426/0 (socket says 172.21.15.78:42426) 2023-06-02T15:31:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f239f7fe640 1 -- 172.21.15.78:0/1355295836 learned_addr learned my addr 172.21.15.78:0/1355295836 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f239f7fe640 1 -- 172.21.15.78:0/1355295836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23a0149e00 msgr2=0x7f23a00a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f239f7fe640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23a0149e00 0x7f23a00a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f239f7fe640 1 -- 172.21.15.78:0/1355295836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23a014fe20 msgr2=0x7f23a0141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f239f7fe640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23a014fe20 0x7f23a0141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f239f7fe640 1 -- 172.21.15.78:0/1355295836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2394009420 con 0x7f23a00ba880 2023-06-02T15:31:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f239f7fe640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 0x7f23a0155520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f239800cba0 tx=0x7f239800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f2387fff640 1 -- 172.21.15.78:0/1355295836 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800ad40 con 0x7f23a00ba880 2023-06-02T15:31:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f2387fff640 1 -- 172.21.15.78:0/1355295836 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2398012400 con 0x7f23a00ba880 2023-06-02T15:31:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f2387fff640 1 -- 172.21.15.78:0/1355295836 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800aea0 con 0x7f23a00ba880 2023-06-02T15:31:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- 172.21.15.78:0/1355295836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23a0159700 con 0x7f23a00ba880 2023-06-02T15:31:06.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- 172.21.15.78:0/1355295836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23a00a2b00 con 0x7f23a00ba880 2023-06-02T15:31:06.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f23a6170640 1 -- 172.21.15.78:0/1355295836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23a0159890 con 0x7f23a00ba880 2023-06-02T15:31:06.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.214+0000 7f2387fff640 1 -- 172.21.15.78:0/1355295836 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f2398007070 con 0x7f23a00ba880 2023-06-02T15:31:06.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.218+0000 7f2387fff640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f238c065c30 0x7f238c0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.218+0000 7f2387fff640 1 -- 172.21.15.78:0/1355295836 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f23980834d0 con 0x7f23a00ba880 2023-06-02T15:31:06.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.218+0000 7f239effd640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f238c065c30 0x7f238c0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.218+0000 7f239effd640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f238c065c30 0x7f238c0680e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23940ad000 tx=0x7f2394004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:06.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.222+0000 7f2387fff640 1 -- 172.21.15.78:0/1355295836 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f239804a6e0 con 0x7f23a00ba880 2023-06-02T15:31:06.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 -- 172.21.15.78:0/1355295836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23a009ff50 con 0x7f23a00ba880 2023-06-02T15:31:06.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f2387fff640 1 -- 172.21.15.78:0/1355295836 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3888 (secure 0 0 0) 0x7f2398054580 con 0x7f23a00ba880 2023-06-02T15:31:06.402 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:06.402 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/4074209272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4074209272},{"type":"v1","addr":"172.21.15.78:6836","nonce":4074209272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/987093145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":987093145},{"type":"v1","addr":"172.21.15.78:6837","nonce":987093145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-02T15:30:38.611635+0000","modified":"2023-06-02T15:30:54.737249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/3115859297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3115859297},{"type":"v1","addr":"172.21.15.132:6833","nonce":3115859297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-02T15:31:06.403 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-06-02T15:31:06.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 -- 172.21.15.78:0/1355295836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f238c065c30 msgr2=0x7f238c0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f238c065c30 0x7f238c0680e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f23940ad000 tx=0x7f2394004740 comp rx=0 tx=0).stop 2023-06-02T15:31:06.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 -- 172.21.15.78:0/1355295836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 msgr2=0x7f23a0155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 0x7f23a0155520 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f239800cba0 tx=0x7f239800a430 comp rx=0 tx=0).stop 2023-06-02T15:31:06.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 -- 172.21.15.78:0/1355295836 shutdown_connections 2023-06-02T15:31:06.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23a014fe20 0x7f23a0141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f23a0149e00 0x7f23a00a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f238c065c30 0x7f238c0680e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 --2- 172.21.15.78:0/1355295836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23a00ba880 0x7f23a0155520 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 -- 172.21.15.78:0/1355295836 >> 172.21.15.78:0/1355295836 conn(0x7f23a00bcf50 msgr2=0x7f23a00a23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:06.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 -- 172.21.15.78:0/1355295836 shutdown_connections 2023-06-02T15:31:06.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.394+0000 7f23a6170640 1 -- 172.21.15.78:0/1355295836 wait complete. 2023-06-02T15:31:06.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:31:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.514+0000 7f1c85d51640 1 Processor -- start 2023-06-02T15:31:06.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.514+0000 7f1c85d51640 1 -- start start 2023-06-02T15:31:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.514+0000 7f1c85d51640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c800ba880 0x7f1c800a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.514+0000 7f1c85d51640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8014fe20 0x7f1c801502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.514+0000 7f1c85d51640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c800bb0e0 con 0x7f1c80149e00 2023-06-02T15:31:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.514+0000 7f1c85d51640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8014a1d0 con 0x7f1c800ba880 2023-06-02T15:31:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.514+0000 7f1c85d51640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c800a61d0 con 0x7f1c8014fe20 2023-06-02T15:31:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.514+0000 7f1c7f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1c80149e00 0x7f1c800a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44334/0 (socket says 172.21.15.78:44334) 2023-06-02T15:31:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.514+0000 7f1c7f7fe640 1 -- 172.21.15.78:0/2012217658 learned_addr learned my addr 172.21.15.78:0/2012217658 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7effd640 1 --2- 172.21.15.78:0/2012217658 >> v2:172.21.15.132:3300/0 conn(0x7f1c800ba880 0x7f1c800a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277886315 0 0) 0x7f1c800bb0e0 con 0x7f1c80149e00 2023-06-02T15:31:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7ffff640 1 --2- 172.21.15.78:0/2012217658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8014fe20 0x7f1c801502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c68003530 con 0x7f1c80149e00 2023-06-02T15:31:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4212269026 0 0) 0x7f1c68003530 con 0x7f1c80149e00 2023-06-02T15:31:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8014fe20 msgr2=0x7f1c801502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 --2- 172.21.15.78:0/2012217658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8014fe20 0x7f1c801502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 >> v2:172.21.15.132:3300/0 conn(0x7f1c800ba880 msgr2=0x7f1c800a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 --2- 172.21.15.78:0/2012217658 >> v2:172.21.15.132:3300/0 conn(0x7f1c800ba880 0x7f1c800a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800a3810 con 0x7f1c80149e00 2023-06-02T15:31:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f1c70001680 con 0x7f1c80149e00 2023-06-02T15:31:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 >> v1:172.21.15.78:6789/0 conn(0x7f1c80149e00 legacy=0x7f1c800a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 --2- 172.21.15.78:0/2012217658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c68003980 0x7f1c68003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 --2- 172.21.15.78:0/2012217658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 0x7f1c68004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 --2- 172.21.15.78:0/2012217658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8014fe20 0x7f1c68004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8014a1d0 con 0x7f1c680043b0 2023-06-02T15:31:06.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c800a61d0 con 0x7f1c68003980 2023-06-02T15:31:06.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6800b990 con 0x7f1c8014fe20 2023-06-02T15:31:06.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7effd640 1 --2- 172.21.15.78:0/2012217658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 0x7f1c68004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7effd640 1 -- 172.21.15.78:0/2012217658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8014fe20 msgr2=0x7f1c68004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:06.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7effd640 1 --2- 172.21.15.78:0/2012217658 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c8014fe20 0x7f1c68004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7effd640 1 -- 172.21.15.78:0/2012217658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c68003980 msgr2=0x7f1c68003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:06.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7effd640 1 --2- 172.21.15.78:0/2012217658 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c68003980 0x7f1c68003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7effd640 1 -- 172.21.15.78:0/2012217658 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c68003530 con 0x7f1c680043b0 2023-06-02T15:31:06.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7effd640 1 --2- 172.21.15.78:0/2012217658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 0x7f1c68004870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009fc0 tx=0x7f1c7401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb5f47dfeb887de server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:06.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740a5cb0 con 0x7f1c680043b0 2023-06-02T15:31:06.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7400f040 con 0x7f1c680043b0 2023-06-02T15:31:06.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7e7fc640 1 -- 172.21.15.78:0/2012217658 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c740ad680 con 0x7f1c680043b0 2023-06-02T15:31:06.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c85d51640 1 -- 172.21.15.78:0/2012217658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 msgr2=0x7f1c68004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c85d51640 1 --2- 172.21.15.78:0/2012217658 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 0x7f1c68004870 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f1c74009fc0 tx=0x7f1c7401cca0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c7ffff640 1 -- 172.21.15.78:0/2012217658 reap_dead start 2023-06-02T15:31:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c85d51640 1 -- 172.21.15.78:0/2012217658 shutdown_connections 2023-06-02T15:31:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c85d51640 1 -- 172.21.15.78:0/2012217658 >> 172.21.15.78:0/2012217658 conn(0x7f1c800bcf50 msgr2=0x7f1c800bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.518+0000 7f1c85d51640 1 -- 172.21.15.78:0/2012217658 shutdown_connections 2023-06-02T15:31:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 -- 172.21.15.78:0/2012217658 wait complete. 2023-06-02T15:31:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 Processor -- start 2023-06-02T15:31:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 -- start start 2023-06-02T15:31:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 0x7f1c8014d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c800be9f0 0x7f1c800703c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c800bee40 0x7f1c80070900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c801e1ce0 con 0x7f1c680043b0 2023-06-02T15:31:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c80143430 con 0x7f1c800bee40 2023-06-02T15:31:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8014d7e0 con 0x7f1c800be9f0 2023-06-02T15:31:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 0x7f1c8014d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7f7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 0x7f1c8014d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42440/0 (socket says 172.21.15.78:42440) 2023-06-02T15:31:06.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7f7fe640 1 -- 172.21.15.78:0/474917454 learned_addr learned my addr 172.21.15.78:0/474917454 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:06.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7effd640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c800be9f0 0x7f1c800703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7ffff640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c800bee40 0x7f1c80070900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7f7fe640 1 -- 172.21.15.78:0/474917454 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c800be9f0 msgr2=0x7f1c800703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7f7fe640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c800be9f0 0x7f1c800703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7f7fe640 1 -- 172.21.15.78:0/474917454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c800bee40 msgr2=0x7f1c80070900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7f7fe640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c800bee40 0x7f1c80070900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7f7fe640 1 -- 172.21.15.78:0/474917454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800a3dd0 con 0x7f1c680043b0 2023-06-02T15:31:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c7f7fe640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 0x7f1c8014d2a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1c70000f70 tx=0x7f1c7000f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c67fff640 1 -- 172.21.15.78:0/474917454 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70007d00 con 0x7f1c680043b0 2023-06-02T15:31:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c67fff640 1 -- 172.21.15.78:0/474917454 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c70007e60 con 0x7f1c680043b0 2023-06-02T15:31:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 -- 172.21.15.78:0/474917454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c800a3af0 con 0x7f1c680043b0 2023-06-02T15:31:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c67fff640 1 -- 172.21.15.78:0/474917454 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7000a2f0 con 0x7f1c680043b0 2023-06-02T15:31:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 -- 172.21.15.78:0/474917454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c800a2b00 con 0x7f1c680043b0 2023-06-02T15:31:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c85d51640 1 -- 172.21.15.78:0/474917454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c80073bc0 con 0x7f1c680043b0 2023-06-02T15:31:06.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.522+0000 7f1c67fff640 1 -- 172.21.15.78:0/474917454 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f1c7000a450 con 0x7f1c680043b0 2023-06-02T15:31:06.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.526+0000 7f1c67fff640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1c6c065c30 0x7f1c6c0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.526+0000 7f1c67fff640 1 -- 172.21.15.78:0/474917454 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1c70085770 con 0x7f1c680043b0 2023-06-02T15:31:06.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.526+0000 7f1c7effd640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1c6c065c30 0x7f1c6c0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.526+0000 7f1c7effd640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1c6c065c30 0x7f1c6c0680e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1c740af000 tx=0x7f1c740a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:06.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.530+0000 7f1c67fff640 1 -- 172.21.15.78:0/474917454 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f1c70052ce0 con 0x7f1c680043b0 2023-06-02T15:31:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.670+0000 7f1c85d51640 1 -- 172.21.15.78:0/474917454 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c8006fd00 con 0x7f1c680043b0 2023-06-02T15:31:06.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c67fff640 1 -- 172.21.15.78:0/474917454 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f1c70056300 con 0x7f1c680043b0 2023-06-02T15:31:06.681 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:06.681 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:31:06.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 -- 172.21.15.78:0/474917454 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1c6c065c30 msgr2=0x7f1c6c0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1c6c065c30 0x7f1c6c0680e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1c740af000 tx=0x7f1c740a7040 comp rx=0 tx=0).stop 2023-06-02T15:31:06.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 -- 172.21.15.78:0/474917454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 msgr2=0x7f1c8014d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 0x7f1c8014d2a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1c70000f70 tx=0x7f1c7000f940 comp rx=0 tx=0).stop 2023-06-02T15:31:06.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 -- 172.21.15.78:0/474917454 shutdown_connections 2023-06-02T15:31:06.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c800bee40 0x7f1c80070900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1c800be9f0 0x7f1c800703c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1c6c065c30 0x7f1c6c0680e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 --2- 172.21.15.78:0/474917454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1c680043b0 0x7f1c8014d2a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 -- 172.21.15.78:0/474917454 >> 172.21.15.78:0/474917454 conn(0x7f1c800bcf50 msgr2=0x7f1c800a23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:06.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 -- 172.21.15.78:0/474917454 shutdown_connections 2023-06-02T15:31:06.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.674+0000 7f1c85d51640 1 -- 172.21.15.78:0/474917454 wait complete. 2023-06-02T15:31:06.699 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-02T15:31:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.806+0000 7f915372e640 1 Processor -- start 2023-06-02T15:31:06.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.806+0000 7f915372e640 1 -- start start 2023-06-02T15:31:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f915372e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f914c0a2e40 0x7f914c14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f915372e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 0x7f914c14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f915372e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c152b50 con 0x7f914c14be20 2023-06-02T15:31:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f915372e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c0a0990 con 0x7f914c0a2e40 2023-06-02T15:31:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f915372e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c06d200 con 0x7f914c0a28f0 2023-06-02T15:31:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9151ccb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 0x7f914c14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9150cc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f914c0a2e40 0x7f914c14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f91514ca640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f914c14be20 0x7f914c06c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:59514/0 (socket says 172.21.15.78:59514) 2023-06-02T15:31:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9151ccb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 0x7f914c14ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3301/0 says I am v2:172.21.15.78:54710/0 (socket says 172.21.15.78:54710) 2023-06-02T15:31:06.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f91514ca640 1 -- 172.21.15.78:0/3323897118 learned_addr learned my addr 172.21.15.78:0/3323897118 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:06.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9150cc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f914c0a2e40 0x7f914c14e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.78:54820/0 (socket says 172.21.15.78:54820) 2023-06-02T15:31:06.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9151ccb640 1 -- 172.21.15.78:0/3323897118 >> v2:172.21.15.132:3300/0 conn(0x7f914c0a2e40 msgr2=0x7f914c14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:06.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9151ccb640 1 --2- 172.21.15.78:0/3323897118 >> v2:172.21.15.132:3300/0 conn(0x7f914c0a2e40 0x7f914c14e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9151ccb640 1 -- 172.21.15.78:0/3323897118 >> v1:172.21.15.132:6789/0 conn(0x7f914c14be20 legacy=0x7f914c06c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9151ccb640 1 -- 172.21.15.78:0/3323897118 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c152870 con 0x7f914c0a28f0 2023-06-02T15:31:06.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9151ccb640 1 --2- 172.21.15.78:0/3323897118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 0x7f914c14ecf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9144009d90 tx=0x7f914401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26472488f843552a server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:06.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9143fff640 1 -- 172.21.15.78:0/3323897118 <== mon.2 v2:172.21.15.132:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91440a58c0 con 0x7f914c0a28f0 2023-06-02T15:31:06.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9143fff640 1 -- 172.21.15.78:0/3323897118 <== mon.2 v2:172.21.15.132:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91440a5a20 con 0x7f914c0a28f0 2023-06-02T15:31:06.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.810+0000 7f9143fff640 1 -- 172.21.15.78:0/3323897118 <== mon.2 v2:172.21.15.132:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91440a5db0 con 0x7f914c0a28f0 2023-06-02T15:31:06.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- 172.21.15.78:0/3323897118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 msgr2=0x7f914c14ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 --2- 172.21.15.78:0/3323897118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 0x7f914c14ecf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9144009d90 tx=0x7f914401c950 comp rx=0 tx=0).stop 2023-06-02T15:31:06.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- 172.21.15.78:0/3323897118 shutdown_connections 2023-06-02T15:31:06.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 --2- 172.21.15.78:0/3323897118 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 0x7f914c14ecf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 --2- 172.21.15.78:0/3323897118 >> v2:172.21.15.132:3300/0 conn(0x7f914c0a2e40 0x7f914c14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- 172.21.15.78:0/3323897118 >> 172.21.15.78:0/3323897118 conn(0x7f914c0bcf50 msgr2=0x7f914c0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:06.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- 172.21.15.78:0/3323897118 shutdown_connections 2023-06-02T15:31:06.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- 172.21.15.78:0/3323897118 wait complete. 2023-06-02T15:31:06.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 Processor -- start 2023-06-02T15:31:06.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- start start 2023-06-02T15:31:06.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 0x7f914c14e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f914c0a2e40 0x7f914c1452c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f914c14be20 0x7f914c145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c1eaa90 con 0x7f914c14be20 2023-06-02T15:31:06.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c071e10 con 0x7f914c0a2e40 2023-06-02T15:31:06.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c1eaf20 con 0x7f914c0a28f0 2023-06-02T15:31:06.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9151ccb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f914c14be20 0x7f914c145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9151ccb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f914c14be20 0x7f914c145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42444/0 (socket says 172.21.15.78:42444) 2023-06-02T15:31:06.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9151ccb640 1 -- 172.21.15.78:0/1122524948 learned_addr learned my addr 172.21.15.78:0/1122524948 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:06.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9150cc9640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f914c0a2e40 0x7f914c1452c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f91514ca640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 0x7f914c14e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9151ccb640 1 -- 172.21.15.78:0/1122524948 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 msgr2=0x7f914c14e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9151ccb640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 0x7f914c14e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9151ccb640 1 -- 172.21.15.78:0/1122524948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f914c0a2e40 msgr2=0x7f914c1452c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:06.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9151ccb640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f914c0a2e40 0x7f914c1452c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:06.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9151ccb640 1 -- 172.21.15.78:0/1122524948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144009a70 con 0x7f914c14be20 2023-06-02T15:31:06.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9151ccb640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f914c14be20 0x7f914c145800 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9144009d90 tx=0x7f91440196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:06.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9141ffb640 1 -- 172.21.15.78:0/1122524948 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91440b9860 con 0x7f914c14be20 2023-06-02T15:31:06.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9141ffb640 1 -- 172.21.15.78:0/1122524948 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91440b99c0 con 0x7f914c14be20 2023-06-02T15:31:06.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- 172.21.15.78:0/1122524948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c15b800 con 0x7f914c14be20 2023-06-02T15:31:06.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f9141ffb640 1 -- 172.21.15.78:0/1122524948 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91440b9d70 con 0x7f914c14be20 2023-06-02T15:31:06.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.814+0000 7f915372e640 1 -- 172.21.15.78:0/1122524948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c0a01e0 con 0x7f914c14be20 2023-06-02T15:31:06.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.818+0000 7f915372e640 1 -- 172.21.15.78:0/1122524948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c15b990 con 0x7f914c14be20 2023-06-02T15:31:06.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.818+0000 7f9141ffb640 1 -- 172.21.15.78:0/1122524948 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f91440ad440 con 0x7f914c14be20 2023-06-02T15:31:06.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.818+0000 7f9141ffb640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9130065c00 0x7f91300680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:06.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.818+0000 7f9141ffb640 1 -- 172.21.15.78:0/1122524948 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f914411eca0 con 0x7f914c14be20 2023-06-02T15:31:06.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.818+0000 7f91514ca640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9130065c00 0x7f91300680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:06.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.818+0000 7f91514ca640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9130065c00 0x7f91300680b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f913c005890 tx=0x7f913c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:06.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:06.822+0000 7f9141ffb640 1 -- 172.21.15.78:0/1122524948 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f91440ec2f0 con 0x7f914c14be20 2023-06-02T15:31:07.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.006+0000 7f915372e640 1 -- 172.21.15.78:0/1122524948 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f914c1eac40 con 0x7f914c14be20 2023-06-02T15:31:07.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.006+0000 7f9141ffb640 1 -- 172.21.15.78:0/1122524948 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3888 (secure 0 0 0) 0x7f914c1eac40 con 0x7f914c14be20 2023-06-02T15:31:07.016 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:07.017 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/4074209272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4074209272},{"type":"v1","addr":"172.21.15.78:6836","nonce":4074209272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/987093145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":987093145},{"type":"v1","addr":"172.21.15.78:6837","nonce":987093145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-02T15:30:38.611635+0000","modified":"2023-06-02T15:30:54.737249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/3115859297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3115859297},{"type":"v1","addr":"172.21.15.132:6833","nonce":3115859297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-02T15:31:07.017 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-06-02T15:31:07.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 -- 172.21.15.78:0/1122524948 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9130065c00 msgr2=0x7f91300680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9130065c00 0x7f91300680b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f913c005890 tx=0x7f913c009040 comp rx=0 tx=0).stop 2023-06-02T15:31:07.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 -- 172.21.15.78:0/1122524948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f914c14be20 msgr2=0x7f914c145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f914c14be20 0x7f914c145800 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f9144009d90 tx=0x7f91440196f0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 -- 172.21.15.78:0/1122524948 shutdown_connections 2023-06-02T15:31:07.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9130065c00 0x7f91300680b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f914c14be20 0x7f914c145800 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f914c0a2e40 0x7f914c1452c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 --2- 172.21.15.78:0/1122524948 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f914c0a28f0 0x7f914c14e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 -- 172.21.15.78:0/1122524948 >> 172.21.15.78:0/1122524948 conn(0x7f914c0bcf50 msgr2=0x7f914c0bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 -- 172.21.15.78:0/1122524948 shutdown_connections 2023-06-02T15:31:07.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.010+0000 7f915372e640 1 -- 172.21.15.78:0/1122524948 wait complete. 2023-06-02T15:31:07.336 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-06-02T15:30:38.611635+0000', 'modified': '2023-06-02T15:30:54.737249+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4273}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4273': {'gid': 4273, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6833/3115859297', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6832', 'nonce': 3115859297}, {'type': 'v1', 'addr': '172.21.15.132:6833', 'nonce': 3115859297}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-06-02T15:31:07.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-06-02T15:31:07.337 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-06-02T15:31:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8ebb97a640 1 Processor -- start 2023-06-02T15:31:07.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8ebb97a640 1 -- start start 2023-06-02T15:31:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8ebb97a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8eb406cfc0 0x7f8eb40718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8ebb97a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8eb406c250 0x7f8eb4149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8ebb97a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8eb414d220 con 0x7f8eb40a59e0 2023-06-02T15:31:07.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8ebb97a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb40ba640 con 0x7f8eb406cfc0 2023-06-02T15:31:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8ebb97a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8eb414cd30 con 0x7f8eb406c250 2023-06-02T15:31:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8eb8f15640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8eb406cfc0 0x7f8eb40718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8eb8f15640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8eb406cfc0 0x7f8eb40718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42450/0 (socket says 172.21.15.78:42450) 2023-06-02T15:31:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8eb8f15640 1 -- 172.21.15.78:0/2729628321 learned_addr learned my addr 172.21.15.78:0/2729628321 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8eb8f15640 1 -- 172.21.15.78:0/2729628321 >> v2:172.21.15.132:3300/0 conn(0x7f8eb406c250 msgr2=0x7f8eb4149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/2729628321 >> v2:172.21.15.132:3300/0 conn(0x7f8eb406c250 0x7f8eb4149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8eb8f15640 1 -- 172.21.15.78:0/2729628321 >> v1:172.21.15.132:6789/0 conn(0x7f8eb40a59e0 legacy=0x7f8eb414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.462+0000 7f8eb8f15640 1 -- 172.21.15.78:0/2729628321 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb40ba850 con 0x7f8eb406cfc0 2023-06-02T15:31:07.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/2729628321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb406cfc0 0x7f8eb40718d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8eb406ae10 tx=0x7f8ea401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23a1843df38e5ba server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8eabfff640 1 -- 172.21.15.78:0/2729628321 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40ac640 con 0x7f8eb406cfc0 2023-06-02T15:31:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8eabfff640 1 -- 172.21.15.78:0/2729628321 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40ac7a0 con 0x7f8eb406cfc0 2023-06-02T15:31:07.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8eabfff640 1 -- 172.21.15.78:0/2729628321 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40acb30 con 0x7f8eb406cfc0 2023-06-02T15:31:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 -- 172.21.15.78:0/2729628321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb406cfc0 msgr2=0x7f8eb40718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 --2- 172.21.15.78:0/2729628321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb406cfc0 0x7f8eb40718d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f8eb406ae10 tx=0x7f8ea401c400 comp rx=0 tx=0).stop 2023-06-02T15:31:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 -- 172.21.15.78:0/2729628321 shutdown_connections 2023-06-02T15:31:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 --2- 172.21.15.78:0/2729628321 >> v2:172.21.15.132:3300/0 conn(0x7f8eb406c250 0x7f8eb4149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 --2- 172.21.15.78:0/2729628321 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb406cfc0 0x7f8eb40718d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 -- 172.21.15.78:0/2729628321 >> 172.21.15.78:0/2729628321 conn(0x7f8eb40a2170 msgr2=0x7f8eb40a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:07.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 -- 172.21.15.78:0/2729628321 shutdown_connections 2023-06-02T15:31:07.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 -- 172.21.15.78:0/2729628321 wait complete. 2023-06-02T15:31:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 Processor -- start 2023-06-02T15:31:07.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 -- start start 2023-06-02T15:31:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8eb406c250 0x7f8eb4148360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb406cfc0 0x7f8eb41e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb40a59e0 0x7f8eb4070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb4071940 con 0x7f8eb40a59e0 2023-06-02T15:31:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb41488a0 con 0x7f8eb406cfc0 2023-06-02T15:31:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8ebb97a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb41e8530 con 0x7f8eb406c250 2023-06-02T15:31:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8eb9f17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb40a59e0 0x7f8eb4070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8eb9f17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb40a59e0 0x7f8eb4070b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42454/0 (socket says 172.21.15.78:42454) 2023-06-02T15:31:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8eb9f17640 1 -- 172.21.15.78:0/823384040 learned_addr learned my addr 172.21.15.78:0/823384040 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb406cfc0 0x7f8eb41e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.466+0000 7f8eb9716640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8eb406c250 0x7f8eb4148360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8eb9f17640 1 -- 172.21.15.78:0/823384040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8eb406c250 msgr2=0x7f8eb4148360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8eb9f17640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8eb406c250 0x7f8eb4148360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8eb9f17640 1 -- 172.21.15.78:0/823384040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb406cfc0 msgr2=0x7f8eb41e7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8eb9f17640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb406cfc0 0x7f8eb41e7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8eb9f17640 1 -- 172.21.15.78:0/823384040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40094d0 con 0x7f8eb40a59e0 2023-06-02T15:31:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb406cfc0 0x7f8eb41e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8eb9f17640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb40a59e0 0x7f8eb4070b20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00b9a0 tx=0x7f8eac00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8ea9ffb640 1 -- 172.21.15.78:0/823384040 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac00cba0 con 0x7f8eb40a59e0 2023-06-02T15:31:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8ea9ffb640 1 -- 172.21.15.78:0/823384040 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eac00cd20 con 0x7f8eb40a59e0 2023-06-02T15:31:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8ebb97a640 1 -- 172.21.15.78:0/823384040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb40a5f40 con 0x7f8eb40a59e0 2023-06-02T15:31:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8ea9ffb640 1 -- 172.21.15.78:0/823384040 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac014680 con 0x7f8eb40a59e0 2023-06-02T15:31:07.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8ebb97a640 1 -- 172.21.15.78:0/823384040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb40a5db0 con 0x7f8eb40a59e0 2023-06-02T15:31:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8ea9ffb640 1 -- 172.21.15.78:0/823384040 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f8eac01d3b0 con 0x7f8eb40a59e0 2023-06-02T15:31:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8ea9ffb640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e98065c00 0x7f8e980680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8ea9ffb640 1 -- 172.21.15.78:0/823384040 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8eac083510 con 0x7f8eb40a59e0 2023-06-02T15:31:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8eb9716640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e98065c00 0x7f8e980680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8eb9716640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e98065c00 0x7f8e980680b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00016c0 tx=0x7f8eb0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8ebea9c000 1 Processor -- start 2023-06-02T15:31:07.483 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.470+0000 7f8ebea9c000 1 -- start start 2023-06-02T15:31:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e80b50 0x55bfd4e80f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4e81830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ec8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4d47a20 con 0x55bfd4e81460 2023-06-02T15:31:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4c81680 con 0x55bfd4e80b50 2023-06-02T15:31:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4cd4920 con 0x55bfd4e81d70 2023-06-02T15:31:07.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4e81830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4e81830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42460/0 (socket says 172.21.15.78:42460) 2023-06-02T15:31:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 -- 172.21.15.78:0/1051283482 learned_addr learned my addr 172.21.15.78:0/1051283482 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 -- 172.21.15.78:0/1051283482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 msgr2=0x55bfd4ec8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb9f17640 1 --2- 172.21.15.78:0/1051283482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ec8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb9716640 1 --2- 172.21.15.78:0/1051283482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e80b50 0x55bfd4e80f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/1051283482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ec8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 -- 172.21.15.78:0/1051283482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e80b50 msgr2=0x55bfd4e80f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/1051283482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e80b50 0x55bfd4e80f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 -- 172.21.15.78:0/1051283482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfd4c931b0 con 0x55bfd4e81460 2023-06-02T15:31:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/1051283482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4e81830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8ea401c8e0 tx=0x7f8ea40a6070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5833b7d6f6078a38 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8e9effd640 1 -- 172.21.15.78:0/1051283482 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40acb90 con 0x55bfd4e81460 2023-06-02T15:31:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8e9effd640 1 -- 172.21.15.78:0/1051283482 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40accf0 con 0x55bfd4e81460 2023-06-02T15:31:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8e9effd640 1 -- 172.21.15.78:0/1051283482 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40b7620 con 0x55bfd4e81460 2023-06-02T15:31:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- 172.21.15.78:0/1051283482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 msgr2=0x55bfd4e81830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/1051283482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4e81830 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8ea401c8e0 tx=0x7f8ea40a6070 comp rx=0 tx=0).stop 2023-06-02T15:31:07.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- 172.21.15.78:0/1051283482 shutdown_connections 2023-06-02T15:31:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/1051283482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ec8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/1051283482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4e81830 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/1051283482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e80b50 0x55bfd4e80f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- 172.21.15.78:0/1051283482 >> 172.21.15.78:0/1051283482 conn(0x55bfd4d79350 msgr2=0x55bfd4e86780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- 172.21.15.78:0/1051283482 shutdown_connections 2023-06-02T15:31:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- 172.21.15.78:0/1051283482 wait complete. 2023-06-02T15:31:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- start start 2023-06-02T15:31:07.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 Processor -- start 2023-06-02T15:31:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e80b50 0x55bfd4eb6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4eb6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e81d70 0x55bfd4ec6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4ccda60 con 0x55bfd4e81460 2023-06-02T15:31:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4c6d5a0 con 0x55bfd4e81d70 2023-06-02T15:31:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4c6d260 con 0x55bfd4e80b50 2023-06-02T15:31:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 10 client.0 _ll_register_callbacks cb 0x55bfd4e6bd70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-02T15:31:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4eb6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4eb6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42468/0 (socket says 172.21.15.78:42468) 2023-06-02T15:31:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 -- 172.21.15.78:0/3390604365 learned_addr learned my addr 172.21.15.78:0/3390604365 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:07.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb9716640 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e80b50 0x55bfd4eb6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb9f17640 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e81d70 0x55bfd4ec6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 -- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e80b50 msgr2=0x55bfd4eb6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e80b50 0x55bfd4eb6920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 -- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e81d70 msgr2=0x55bfd4ec6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e81d70 0x55bfd4ec6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 -- 172.21.15.78:0/3390604365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb40ba850 con 0x55bfd4e81460 2023-06-02T15:31:07.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4eb6e60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4008010 tx=0x7f8ea401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115c74ed548fa89d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8e93fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-06-02T15:31:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8e93fff640 1 -- 172.21.15.78:0/3390604365 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea40acc90 con 0x55bfd4e81460 2023-06-02T15:31:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8e93fff640 1 -- 172.21.15.78:0/3390604365 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8ea40acdf0 con 0x55bfd4e81460 2023-06-02T15:31:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3390604365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfd4ccc3b0 con 0x55bfd4e81460 2023-06-02T15:31:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8e93fff640 1 -- 172.21.15.78:0/3390604365 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ea4003620 con 0x55bfd4e81460 2023-06-02T15:31:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 10 client.4854 fetch_fsmap learned FSMap version 9 2023-06-02T15:31:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.474+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3390604365 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55bfd49ca890 con 0x55bfd4e81460 2023-06-02T15:31:07.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8e93fff640 1 -- 172.21.15.78:0/3390604365 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bfd4ccc3b0 con 0x55bfd4e81460 2023-06-02T15:31:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8e93fff640 1 -- 172.21.15.78:0/3390604365 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 9) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f8ea4003780 con 0x55bfd4e81460 2023-06-02T15:31:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 10 client.4854 fetch_fsmap finished waiting for FSMap version 9 2023-06-02T15:31:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 10 client.4854 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-02T15:31:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 20 client.4854 populate_metadata read hostname 'smithi078' 2023-06-02T15:31:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x55bfd4ec7490 0x55bfd4ec7860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 4 client.4854 mds_command: new command op to 4273 tid=0[{"prefix": "get_command_descriptions"}] 2023-06-02T15:31:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3390604365 --> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bfd4cfd0a0 con 0x55bfd4ec7490 2023-06-02T15:31:07.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8eb9716640 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x55bfd4ec7490 0x55bfd4ec7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8e93fff640 10 client.4854 ms_handle_connect on v2:172.21.15.132:6832/3115859297 2023-06-02T15:31:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8eb9716640 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x55bfd4ec7490 0x55bfd4ec7860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d637de6102f55743 server_cookie=d66534cbc348902 in_seq=0 out_seq=0 2023-06-02T15:31:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8e93fff640 1 -- 172.21.15.78:0/3390604365 <== mds.0 v2:172.21.15.132:6832/3115859297 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55bfd4cfd0a0 con 0x55bfd4ec7490 2023-06-02T15:31:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8e93fff640 10 client.4854 handle_command_reply: tid=0 2023-06-02T15:31:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 client.4854 shutdown 2023-06-02T15:31:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3390604365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 msgr2=0x55bfd4eb6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4eb6e60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4008010 tx=0x7f8ea401ac40 comp rx=0 tx=0).stop 2023-06-02T15:31:07.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3390604365 shutdown_connections 2023-06-02T15:31:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x55bfd4ec7490 0x55bfd4ec7860 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e81d70 0x55bfd4ec6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4eb6e60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8e93fff640 0 client.4854 ms_handle_reset on v2:172.21.15.132:6832/3115859297 2023-06-02T15:31:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/3390604365 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e80b50 0x55bfd4eb6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3390604365 >> 172.21.15.78:0/3390604365 conn(0x55bfd4d79350 msgr2=0x55bfd4eba7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:07.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3390604365 shutdown_connections 2023-06-02T15:31:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3390604365 wait complete. 2023-06-02T15:31:07.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.478+0000 7f8ebea9c000 20 client.4854 trim_cache size 0 max 16384 2023-06-02T15:31:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 Processor -- start 2023-06-02T15:31:07.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 -- start start 2023-06-02T15:31:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e80b50 0x55bfd4ed7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4ed7240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ed5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd498b940 con 0x55bfd4e81460 2023-06-02T15:31:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4ccd270 con 0x55bfd4e80b50 2023-06-02T15:31:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4cc6070 con 0x55bfd4e81d70 2023-06-02T15:31:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb8f15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4ed7240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb8f15640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4ed7240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42480/0 (socket says 172.21.15.78:42480) 2023-06-02T15:31:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb8f15640 1 -- 172.21.15.78:0/3498873103 learned_addr learned my addr 172.21.15.78:0/3498873103 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:07.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb8f15640 1 -- 172.21.15.78:0/3498873103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 msgr2=0x55bfd4ed5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb9716640 1 --2- 172.21.15.78:0/3498873103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e80b50 0x55bfd4ed7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb9f17640 1 --2- 172.21.15.78:0/3498873103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ed5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/3498873103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ed5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb8f15640 1 -- 172.21.15.78:0/3498873103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e80b50 msgr2=0x55bfd4ed7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/3498873103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e80b50 0x55bfd4ed7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb8f15640 1 -- 172.21.15.78:0/3498873103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfd4c93460 con 0x55bfd4e81460 2023-06-02T15:31:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/3498873103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4ed7240 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8ea401c440 tx=0x7f8ea40c2070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152f2d8543eed079 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:07.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8e9f7fe640 1 -- 172.21.15.78:0/3498873103 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4003c90 con 0x55bfd4e81460 2023-06-02T15:31:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8e9f7fe640 1 -- 172.21.15.78:0/3498873103 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ea40c4070 con 0x55bfd4e81460 2023-06-02T15:31:07.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8e9f7fe640 1 -- 172.21.15.78:0/3498873103 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ea4003820 con 0x55bfd4e81460 2023-06-02T15:31:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3498873103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 msgr2=0x55bfd4ed7240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/3498873103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4ed7240 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8ea401c440 tx=0x7f8ea40c2070 comp rx=0 tx=0).stop 2023-06-02T15:31:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3498873103 shutdown_connections 2023-06-02T15:31:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/3498873103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ed5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/3498873103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e81460 0x55bfd4ed7240 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/3498873103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e80b50 0x55bfd4ed7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3498873103 >> 172.21.15.78:0/3498873103 conn(0x55bfd4d79350 msgr2=0x55bfd4ec5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3498873103 shutdown_connections 2023-06-02T15:31:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 -- 172.21.15.78:0/3498873103 wait complete. 2023-06-02T15:31:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.494+0000 7f8ebea9c000 1 -- start start 2023-06-02T15:31:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 Processor -- start 2023-06-02T15:31:07.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e80b50 0x55bfd4ee5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e81460 0x55bfd4ee63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ee6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4d6e1b0 con 0x55bfd4e80b50 2023-06-02T15:31:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4cd1bd0 con 0x55bfd4e81460 2023-06-02T15:31:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bfd4c90b10 con 0x55bfd4e81d70 2023-06-02T15:31:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 10 client.0 _ll_register_callbacks cb 0x55bfd4c6e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-06-02T15:31:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb9716640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e80b50 0x55bfd4ee5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb9716640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e80b50 0x55bfd4ee5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42482/0 (socket says 172.21.15.78:42482) 2023-06-02T15:31:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb9716640 1 -- 172.21.15.78:0/2244194969 learned_addr learned my addr 172.21.15.78:0/2244194969 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb9716640 1 -- 172.21.15.78:0/2244194969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 msgr2=0x55bfd4ee6920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb9716640 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ee6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb9716640 1 -- 172.21.15.78:0/2244194969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e81460 msgr2=0x55bfd4ee63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb9716640 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e81460 0x55bfd4ee63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb9716640 1 -- 172.21.15.78:0/2244194969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bfd49ca890 con 0x55bfd4e80b50 2023-06-02T15:31:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb9716640 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e80b50 0x55bfd4ee5ea0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0005040 tx=0x7f8eb0000fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d59799fe51bc0a9 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:07.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8e93fff640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-06-02T15:31:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8e93fff640 1 -- 172.21.15.78:0/2244194969 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0024c60 con 0x55bfd4e80b50 2023-06-02T15:31:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8e93fff640 1 -- 172.21.15.78:0/2244194969 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8eb0024dc0 con 0x55bfd4e80b50 2023-06-02T15:31:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- 172.21.15.78:0/2244194969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfd4c88c00 con 0x55bfd4e80b50 2023-06-02T15:31:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8e93fff640 1 -- 172.21.15.78:0/2244194969 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8eb000e860 con 0x55bfd4e80b50 2023-06-02T15:31:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 10 client.4860 fetch_fsmap learned FSMap version 9 2023-06-02T15:31:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- 172.21.15.78:0/2244194969 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55bfd4c78ce0 con 0x55bfd4e80b50 2023-06-02T15:31:07.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8e93fff640 1 -- 172.21.15.78:0/2244194969 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bfd4c88c00 con 0x55bfd4e80b50 2023-06-02T15:31:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8e93fff640 1 -- 172.21.15.78:0/2244194969 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 9) v1 ==== 2569+0+0 (secure 0 0 0) 0x7f8eb0020030 con 0x55bfd4e80b50 2023-06-02T15:31:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 10 client.4860 fetch_fsmap finished waiting for FSMap version 9 2023-06-02T15:31:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 10 client.4860 resolve_mds: resolved name 'b' to daemon mds.b 2023-06-02T15:31:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 20 client.4860 populate_metadata read hostname 'smithi078' 2023-06-02T15:31:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x55bfd4f23bc0 0x55bfd4f25fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 4 client.4860 mds_command: new command op to 4273 tid=0[{"prefix": "status"}] 2023-06-02T15:31:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- 172.21.15.78:0/2244194969 --> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55bfd4cc6ae0 con 0x55bfd4f23bc0 2023-06-02T15:31:07.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x55bfd4f23bc0 0x55bfd4f25fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8e93fff640 10 client.4860 ms_handle_connect on v2:172.21.15.132:6832/3115859297 2023-06-02T15:31:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8eb8f15640 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x55bfd4f23bc0 0x55bfd4f25fa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=425f66c6812c938f server_cookie=11df51217111ec2b in_seq=0 out_seq=0 2023-06-02T15:31:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8e93fff640 1 -- 172.21.15.78:0/2244194969 <== mds.0 v2:172.21.15.132:6832/3115859297 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55bfd4cc6ae0 con 0x55bfd4f23bc0 2023-06-02T15:31:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8e93fff640 10 client.4860 handle_command_reply: tid=0 2023-06-02T15:31:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 client.4860 shutdown 2023-06-02T15:31:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- 172.21.15.78:0/2244194969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e80b50 msgr2=0x55bfd4ee5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e80b50 0x55bfd4ee5ea0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8eb0005040 tx=0x7f8eb0000fc0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- 172.21.15.78:0/2244194969 shutdown_connections 2023-06-02T15:31:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.132:6832/3115859297,v1:172.21.15.132:6833/3115859297] conn(0x55bfd4f23bc0 0x55bfd4f25fa0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x55bfd4e81d70 0x55bfd4ee6920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55bfd4e81460 0x55bfd4ee63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8e93fff640 0 client.4860 ms_handle_reset on v2:172.21.15.132:6832/3115859297 2023-06-02T15:31:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 --2- 172.21.15.78:0/2244194969 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x55bfd4e80b50 0x55bfd4ee5ea0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- 172.21.15.78:0/2244194969 >> 172.21.15.78:0/2244194969 conn(0x55bfd4d79350 msgr2=0x55bfd4ec5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:07.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- 172.21.15.78:0/2244194969 shutdown_connections 2023-06-02T15:31:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 1 -- 172.21.15.78:0/2244194969 wait complete. 2023-06-02T15:31:07.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.498+0000 7f8ebea9c000 20 client.4860 trim_cache size 0 max 16384 2023-06-02T15:31:07.517 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-02T15:31:07.517 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "9af8d860-9431-412c-b8a4-990228d6b597", 2023-06-02T15:31:07.517 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-06-02T15:31:07.517 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4273, 2023-06-02T15:31:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-06-02T15:31:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-06-02T15:31:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-06-02T15:31:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 28.888558368999998, 2023-06-02T15:31:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 9, 2023-06-02T15:31:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 25, 2023-06-02T15:31:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 25, 2023-06-02T15:31:07.518 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 33.893071788 2023-06-02T15:31:07.519 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-02T15:31:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 -- 172.21.15.78:0/823384040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e98065c00 msgr2=0x7f8e980680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e98065c00 0x7f8e980680b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8eb00016c0 tx=0x7f8eb0009040 comp rx=0 tx=0).stop 2023-06-02T15:31:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 -- 172.21.15.78:0/823384040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb40a59e0 msgr2=0x7f8eb4070b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb40a59e0 0x7f8eb4070b20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f8eac00b9a0 tx=0x7f8eac00be60 comp rx=0 tx=0).stop 2023-06-02T15:31:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 -- 172.21.15.78:0/823384040 shutdown_connections 2023-06-02T15:31:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f8e98065c00 0x7f8e980680b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8eb40a59e0 0x7f8eb4070b20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8eb406cfc0 0x7f8eb41e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 --2- 172.21.15.78:0/823384040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f8eb406c250 0x7f8eb4148360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 -- 172.21.15.78:0/823384040 >> 172.21.15.78:0/823384040 conn(0x7f8eb40a2170 msgr2=0x7f8eb41465f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 -- 172.21.15.78:0/823384040 shutdown_connections 2023-06-02T15:31:07.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.502+0000 7f8ebb97a640 1 -- 172.21.15.78:0/823384040 wait complete. 2023-06-02T15:31:07.524 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-06-02T15:31:07.552 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-06-02T15:31:07.552 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2023-06-02T15:31:07.552 INFO:tasks.ceph_fuse:client.0 config is {} 2023-06-02T15:31:07.553 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-02T15:31:07.553 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-02T15:31:07.553 INFO:tasks.ceph_fuse:client.1 config is {} 2023-06-02T15:31:07.553 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-06-02T15:31:07.553 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-02T15:31:07.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:07.554 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-06-02T15:31:07.560 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-06-02T15:31:07.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:07.561 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-06-02T15:31:07.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:07.617 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-06-02T15:31:07.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:07.789 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-06-02T15:31:07.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:07.796 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2023-06-02T15:31:07.853 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2023-06-02T15:31:07.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:31:07.855 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-06-02T15:31:07.855 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-02T15:31:07.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafd197c640 1 Processor -- start 2023-06-02T15:31:07.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafd197c640 1 -- start start 2023-06-02T15:31:07.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafd197c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fafcc149e00 0x7fafcc0a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafd197c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafcc14fe20 0x7fafcc1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafd197c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafcc0bb0e0 con 0x7fafcc0ba880 2023-06-02T15:31:07.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafd197c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafcc14a1d0 con 0x7fafcc149e00 2023-06-02T15:31:07.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafd197c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0a61d0 con 0x7fafcc14fe20 2023-06-02T15:31:07.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafcaffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fafcc149e00 0x7fafcc0a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafcaffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fafcc149e00 0x7fafcc0a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42486/0 (socket says 172.21.15.78:42486) 2023-06-02T15:31:07.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafcaffd640 1 -- 172.21.15.78:0/2538906341 learned_addr learned my addr 172.21.15.78:0/2538906341 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:07.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafcb7fe640 1 --2- 172.21.15.78:0/2538906341 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafcc14fe20 0x7fafcc1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafcaffd640 1 -- 172.21.15.78:0/2538906341 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafcc14fe20 msgr2=0x7fafcc1502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:07.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafcaffd640 1 --2- 172.21.15.78:0/2538906341 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafcc14fe20 0x7fafcc1502a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafcaffd640 1 -- 172.21.15.78:0/2538906341 >> v1:172.21.15.132:6789/0 conn(0x7fafcc0ba880 legacy=0x7fafcc0a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.978+0000 7fafcaffd640 1 -- 172.21.15.78:0/2538906341 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafcc0a3810 con 0x7fafcc149e00 2023-06-02T15:31:07.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcaffd640 1 --2- 172.21.15.78:0/2538906341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc149e00 0x7fafcc0a5bd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009870 tx=0x7fafb401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eab372a7aba197d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:07.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafc9ffb640 1 -- 172.21.15.78:0/2538906341 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40ab600 con 0x7fafcc149e00 2023-06-02T15:31:07.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafc9ffb640 1 -- 172.21.15.78:0/2538906341 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb40a7050 con 0x7fafcc149e00 2023-06-02T15:31:07.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafc9ffb640 1 -- 172.21.15.78:0/2538906341 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40ab980 con 0x7fafcc149e00 2023-06-02T15:31:07.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 -- 172.21.15.78:0/2538906341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc149e00 msgr2=0x7fafcc0a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 --2- 172.21.15.78:0/2538906341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc149e00 0x7fafcc0a5bd0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009870 tx=0x7fafb401c540 comp rx=0 tx=0).stop 2023-06-02T15:31:07.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 -- 172.21.15.78:0/2538906341 shutdown_connections 2023-06-02T15:31:07.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 --2- 172.21.15.78:0/2538906341 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafcc14fe20 0x7fafcc1502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 --2- 172.21.15.78:0/2538906341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc149e00 0x7fafcc0a5bd0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 -- 172.21.15.78:0/2538906341 >> 172.21.15.78:0/2538906341 conn(0x7fafcc0bcf50 msgr2=0x7fafcc0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:07.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 -- 172.21.15.78:0/2538906341 shutdown_connections 2023-06-02T15:31:07.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 -- 172.21.15.78:0/2538906341 wait complete. 2023-06-02T15:31:07.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 Processor -- start 2023-06-02T15:31:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 -- start start 2023-06-02T15:31:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc0ba880 0x7fafcc14a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafcc149e00 0x7fafcc0a1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafcc14fe20 0x7fafcc0c09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0a0bf0 con 0x7fafcc0ba880 2023-06-02T15:31:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc0a0ed0 con 0x7fafcc14fe20 2023-06-02T15:31:07.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafd197c640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafcc14bf40 con 0x7fafcc149e00 2023-06-02T15:31:07.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc0ba880 0x7fafcc14a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc0ba880 0x7fafcc14a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42490/0 (socket says 172.21.15.78:42490) 2023-06-02T15:31:07.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcaffd640 1 -- 172.21.15.78:0/1079452759 learned_addr learned my addr 172.21.15.78:0/1079452759 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:07.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcb7fe640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafcc14fe20 0x7fafcc0c09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafca7fc640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafcc149e00 0x7fafcc0a1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcaffd640 1 -- 172.21.15.78:0/1079452759 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafcc149e00 msgr2=0x7fafcc0a1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcaffd640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafcc149e00 0x7fafcc0a1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcaffd640 1 -- 172.21.15.78:0/1079452759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafcc14fe20 msgr2=0x7fafcc0c09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcaffd640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafcc14fe20 0x7fafcc0c09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcaffd640 1 -- 172.21.15.78:0/1079452759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb40094d0 con 0x7fafcc0ba880 2023-06-02T15:31:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcb7fe640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafcc14fe20 0x7fafcc0c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.982+0000 7fafcaffd640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc0ba880 0x7fafcc14a520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fafb40097c0 tx=0x7fafb40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafc3fff640 1 -- 172.21.15.78:0/1079452759 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40b6640 con 0x7fafcc0ba880 2023-06-02T15:31:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafc3fff640 1 -- 172.21.15.78:0/1079452759 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb40b67a0 con 0x7fafcc0ba880 2023-06-02T15:31:07.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafd197c640 1 -- 172.21.15.78:0/1079452759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafcc159700 con 0x7fafcc0ba880 2023-06-02T15:31:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafc3fff640 1 -- 172.21.15.78:0/1079452759 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40b6b30 con 0x7fafcc0ba880 2023-06-02T15:31:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafd197c640 1 -- 172.21.15.78:0/1079452759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafcc0a2b00 con 0x7fafcc0ba880 2023-06-02T15:31:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafd197c640 1 -- 172.21.15.78:0/1079452759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafcc159890 con 0x7fafcc0ba880 2023-06-02T15:31:07.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafc3fff640 1 -- 172.21.15.78:0/1079452759 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fafb40b2040 con 0x7fafcc0ba880 2023-06-02T15:31:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafc3fff640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fafac065c00 0x7fafac0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafca7fc640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fafac065c00 0x7fafac0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafc3fff640 1 -- 172.21.15.78:0/1079452759 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fafb411ceb0 con 0x7fafcc0ba880 2023-06-02T15:31:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.986+0000 7fafca7fc640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fafac065c00 0x7fafac0680b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fafbc007fd0 tx=0x7fafbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:07.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:07.990+0000 7fafc3fff640 1 -- 172.21.15.78:0/1079452759 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fafb40ea300 con 0x7fafcc0ba880 2023-06-02T15:31:08.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 -- 172.21.15.78:0/1079452759 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fafcc073bc0 con 0x7fafcc0ba880 2023-06-02T15:31:08.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafc3fff640 1 -- 172.21.15.78:0/1079452759 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fafb40b0070 con 0x7fafcc0ba880 2023-06-02T15:31:08.186 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-02T15:31:08.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 -- 172.21.15.78:0/1079452759 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fafac065c00 msgr2=0x7fafac0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:08.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fafac065c00 0x7fafac0680b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fafbc007fd0 tx=0x7fafbc009040 comp rx=0 tx=0).stop 2023-06-02T15:31:08.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 -- 172.21.15.78:0/1079452759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc0ba880 msgr2=0x7fafcc14a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:08.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc0ba880 0x7fafcc14a520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fafb40097c0 tx=0x7fafb40192e0 comp rx=0 tx=0).stop 2023-06-02T15:31:08.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 -- 172.21.15.78:0/1079452759 shutdown_connections 2023-06-02T15:31:08.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafcc14fe20 0x7fafcc0c09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:08.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fafcc149e00 0x7fafcc0a1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:08.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fafac065c00 0x7fafac0680b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:08.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 --2- 172.21.15.78:0/1079452759 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fafcc0ba880 0x7fafcc14a520 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:08.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 -- 172.21.15.78:0/1079452759 >> 172.21.15.78:0/1079452759 conn(0x7fafcc0bcf50 msgr2=0x7fafcc0bbd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:08.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 -- 172.21.15.78:0/1079452759 shutdown_connections 2023-06-02T15:31:08.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:08.178+0000 7fafd197c640 1 -- 172.21.15.78:0/1079452759 wait complete. 2023-06-02T15:31:08.204 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-02T15:31:08.204 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-02T15:31:08.205 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi150.front.sepia.ceph.com 2023-06-02T15:31:08.205 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-06-02T15:31:08.205 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-06-02T15:31:08.205 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-02T15:31:08.205 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-02T15:31:08.206 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-02T15:31:08.206 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-06-02T15:31:08.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.206 DEBUG:teuthology.orchestra.run.smithi150:> ip addr 2023-06-02T15:31:08.213 INFO:teuthology.orchestra.run.smithi150.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-02T15:31:08.213 INFO:teuthology.orchestra.run.smithi150.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-02T15:31:08.213 INFO:teuthology.orchestra.run.smithi150.stdout: inet 127.0.0.1/8 scope host lo 2023-06-02T15:31:08.213 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:31:08.213 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 ::1/128 scope host 2023-06-02T15:31:08.214 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:31:08.214 INFO:teuthology.orchestra.run.smithi150.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-02T15:31:08.214 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bc brd ff:ff:ff:ff:ff:ff 2023-06-02T15:31:08.214 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f0 2023-06-02T15:31:08.214 INFO:teuthology.orchestra.run.smithi150.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-02T15:31:08.214 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:d9:da:bd brd ff:ff:ff:ff:ff:ff 2023-06-02T15:31:08.214 INFO:teuthology.orchestra.run.smithi150.stdout: altname enp7s0f1 2023-06-02T15:31:08.215 INFO:teuthology.orchestra.run.smithi150.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-02T15:31:08.215 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:34 brd ff:ff:ff:ff:ff:ff 2023-06-02T15:31:08.215 INFO:teuthology.orchestra.run.smithi150.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-02T15:31:08.215 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 0c:c4:7a:88:6e:35 brd ff:ff:ff:ff:ff:ff 2023-06-02T15:31:08.215 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.21.15.150/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-02T15:31:08.215 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft 42348sec preferred_lft 42348sec 2023-06-02T15:31:08.215 INFO:teuthology.orchestra.run.smithi150.stdout: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2023-06-02T15:31:08.215 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:31:08.216 INFO:teuthology.orchestra.run.smithi150.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-02T15:31:08.216 INFO:teuthology.orchestra.run.smithi150.stdout: link/ether 02:42:36:21:50:76 brd ff:ff:ff:ff:ff:ff 2023-06-02T15:31:08.216 INFO:teuthology.orchestra.run.smithi150.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-02T15:31:08.216 INFO:teuthology.orchestra.run.smithi150.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:31:08.216 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-02T15:31:08.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.217 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-06-02T15:31:08.217 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-06-02T15:31:08.218 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add name ceph-brx type bridge 2023-06-02T15:31:08.218 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr flush dev ceph-brx 2023-06-02T15:31:08.218 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set ceph-brx up 2023-06-02T15:31:08.218 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-02T15:31:08.219 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-06-02T15:31:08.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.296 DEBUG:teuthology.orchestra.run.smithi150:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-02T15:31:08.347 INFO:teuthology.orchestra.run.smithi150.stdout:1 2023-06-02T15:31:08.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.349 DEBUG:teuthology.orchestra.run.smithi150:> route 2023-06-02T15:31:08.400 INFO:teuthology.orchestra.run.smithi150.stdout:Kernel IP routing table 2023-06-02T15:31:08.401 INFO:teuthology.orchestra.run.smithi150.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-02T15:31:08.401 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-02T15:31:08.401 INFO:teuthology.orchestra.run.smithi150.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-02T15:31:08.401 INFO:teuthology.orchestra.run.smithi150.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-02T15:31:08.401 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-02T15:31:08.401 INFO:teuthology.orchestra.run.smithi150.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-02T15:31:08.401 INFO:teuthology.orchestra.run.smithi150.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-02T15:31:08.401 INFO:teuthology.orchestra.run.smithi150.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-02T15:31:08.402 INFO:teuthology.orchestra.run.smithi150.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-02T15:31:08.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.402 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-06-02T15:31:08.402 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-06-02T15:31:08.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-02T15:31:08.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-02T15:31:08.403 DEBUG:teuthology.orchestra.run.smithi150:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-02T15:31:08.403 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-06-02T15:31:08.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.475 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-06-02T15:31:08.523 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.524 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list-id 2023-06-02T15:31:08.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.572 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-06-02T15:31:08.572 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-06-02T15:31:08.572 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-02T15:31:08.573 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-06-02T15:31:08.573 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-06-02T15:31:08.639 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-06-02T15:31:08.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.639 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-06-02T15:31:08.640 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-06-02T15:31:08.640 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-06-02T15:31:08.640 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-02T15:31:08.640 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-06-02T15:31:08.641 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-06-02T15:31:08.641 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-06-02T15:31:08.641 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-06-02T15:31:08.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.735 DEBUG:teuthology.orchestra.run.smithi150:> (cd / && exec bash -c ' 2023-06-02T15:31:08.735 DEBUG:teuthology.orchestra.run.smithi150:> set -e 2023-06-02T15:31:08.735 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set brx.0 up 2023-06-02T15:31:08.735 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link set dev brx.0 master ceph-brx 2023-06-02T15:31:08.736 DEBUG:teuthology.orchestra.run.smithi150:> ') 2023-06-02T15:31:08.754 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-06-02T15:31:08.755 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-02T15:31:08.755 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-06-02T15:31:08.802 INFO:teuthology.orchestra.run.smithi150.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-06-02T15:31:08.802 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-02T15:31:08.803 DEBUG:teuthology.orchestra.run.smithi150:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-06-02T15:31:08.850 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-06-02T15:31:08.907 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-02T15:31:08.907 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-02T15:31:08.961 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-02T15:31:08.963 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-02T15:31:08.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:08.964 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-06-02T15:31:09.010 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-02T15:31:09.011 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-06-02T15:31:09.056 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-06-02T15:31:09.070 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-02T15:31:09.070 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-02T15:31:09.125 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-02T15:31:09.126 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-02T15:31:09.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:09.127 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-06-02T15:31:09.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi150.stderr:2023-06-02T15:31:09.127+0000 7ff63ac92580 -1 init, newargv = 0x556b7562a1a0 newargc=15 2023-06-02T15:31:09.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi150.stderr:ceph-fuse[32469]: starting ceph client 2023-06-02T15:31:09.142 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi150.stderr:ceph-fuse[32469]: starting fuse 2023-06-02T15:31:10.238 DEBUG:teuthology.orchestra.run.smithi150:> sudo modprobe fuse 2023-06-02T15:31:10.253 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-02T15:31:10.253 DEBUG:teuthology.orchestra.run.smithi150:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-02T15:31:10.305 INFO:teuthology.orchestra.run.smithi150.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-02T15:31:10.306 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-02T15:31:10.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:10.307 DEBUG:teuthology.orchestra.run.smithi150:> ls /sys/fs/fuse/connections 2023-06-02T15:31:10.355 INFO:teuthology.orchestra.run.smithi150.stdout:45 2023-06-02T15:31:10.355 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-02T15:31:10.356 DEBUG:teuthology.orchestra.run.smithi150:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-02T15:31:10.356 DEBUG:teuthology.orchestra.run.smithi150:> import glob 2023-06-02T15:31:10.356 DEBUG:teuthology.orchestra.run.smithi150:> import re 2023-06-02T15:31:10.357 DEBUG:teuthology.orchestra.run.smithi150:> import os 2023-06-02T15:31:10.357 DEBUG:teuthology.orchestra.run.smithi150:> import subprocess 2023-06-02T15:31:10.357 DEBUG:teuthology.orchestra.run.smithi150:> 2023-06-02T15:31:10.358 DEBUG:teuthology.orchestra.run.smithi150:> def _find_admin_socket(client_name): 2023-06-02T15:31:10.358 DEBUG:teuthology.orchestra.run.smithi150:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-06-02T15:31:10.359 DEBUG:teuthology.orchestra.run.smithi150:> files = glob.glob(asok_path) 2023-06-02T15:31:10.359 DEBUG:teuthology.orchestra.run.smithi150:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-06-02T15:31:10.360 DEBUG:teuthology.orchestra.run.smithi150:> 2023-06-02T15:31:10.360 DEBUG:teuthology.orchestra.run.smithi150:> # Given a non-glob path, it better be there 2023-06-02T15:31:10.360 DEBUG:teuthology.orchestra.run.smithi150:> if "*" not in asok_path: 2023-06-02T15:31:10.360 DEBUG:teuthology.orchestra.run.smithi150:> assert(len(files) == 1) 2023-06-02T15:31:10.361 DEBUG:teuthology.orchestra.run.smithi150:> return files[0] 2023-06-02T15:31:10.361 DEBUG:teuthology.orchestra.run.smithi150:> 2023-06-02T15:31:10.361 DEBUG:teuthology.orchestra.run.smithi150:> for f in files: 2023-06-02T15:31:10.361 DEBUG:teuthology.orchestra.run.smithi150:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-02T15:31:10.361 DEBUG:teuthology.orchestra.run.smithi150:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-02T15:31:10.362 DEBUG:teuthology.orchestra.run.smithi150:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-02T15:31:10.362 DEBUG:teuthology.orchestra.run.smithi150:> contents = proc_f.read() 2023-06-02T15:31:10.362 DEBUG:teuthology.orchestra.run.smithi150:> if mountpoint in contents: 2023-06-02T15:31:10.362 DEBUG:teuthology.orchestra.run.smithi150:> return f 2023-06-02T15:31:10.363 DEBUG:teuthology.orchestra.run.smithi150:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-02T15:31:10.363 DEBUG:teuthology.orchestra.run.smithi150:> 2023-06-02T15:31:10.363 DEBUG:teuthology.orchestra.run.smithi150:> print(_find_admin_socket("client.0")) 2023-06-02T15:31:10.363 DEBUG:teuthology.orchestra.run.smithi150:> ' 2023-06-02T15:31:10.475 INFO:teuthology.orchestra.run.smithi150.stdout:/var/run/ceph/ceph-client.0.32469.asok 2023-06-02T15:31:10.658 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.32469.asok 2023-06-02T15:31:10.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:10.658 DEBUG:teuthology.orchestra.run.smithi150:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.32469.asok status 2023-06-02T15:31:10.812 INFO:teuthology.orchestra.run.smithi150.stdout:{ 2023-06-02T15:31:10.813 INFO:teuthology.orchestra.run.smithi150.stdout: "metadata": { 2023-06-02T15:31:10.813 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_sha1": "2870bf456d3115490c153abce9d47ac5c043b65e", 2023-06-02T15:31:10.813 INFO:teuthology.orchestra.run.smithi150.stdout: "ceph_version": "ceph version 18.0.0-3488-g2870bf45 (2870bf456d3115490c153abce9d47ac5c043b65e) reef (rc)", 2023-06-02T15:31:10.813 INFO:teuthology.orchestra.run.smithi150.stdout: "entity_id": "0", 2023-06-02T15:31:10.814 INFO:teuthology.orchestra.run.smithi150.stdout: "hostname": "smithi150", 2023-06-02T15:31:10.814 INFO:teuthology.orchestra.run.smithi150.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-06-02T15:31:10.814 INFO:teuthology.orchestra.run.smithi150.stdout: "pid": "32469", 2023-06-02T15:31:10.814 INFO:teuthology.orchestra.run.smithi150.stdout: "root": "/" 2023-06-02T15:31:10.814 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-06-02T15:31:10.814 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_count": 0, 2023-06-02T15:31:10.814 INFO:teuthology.orchestra.run.smithi150.stdout: "dentry_pinned_count": 0, 2023-06-02T15:31:10.815 INFO:teuthology.orchestra.run.smithi150.stdout: "id": 4872, 2023-06-02T15:31:10.815 INFO:teuthology.orchestra.run.smithi150.stdout: "inst": { 2023-06-02T15:31:10.815 INFO:teuthology.orchestra.run.smithi150.stdout: "name": { 2023-06-02T15:31:10.815 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "client", 2023-06-02T15:31:10.815 INFO:teuthology.orchestra.run.smithi150.stdout: "num": 4872 2023-06-02T15:31:10.815 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-06-02T15:31:10.815 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2023-06-02T15:31:10.815 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2023-06-02T15:31:10.816 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2023-06-02T15:31:10.816 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2320993391 2023-06-02T15:31:10.816 INFO:teuthology.orchestra.run.smithi150.stdout: } 2023-06-02T15:31:10.816 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-06-02T15:31:10.816 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": { 2023-06-02T15:31:10.816 INFO:teuthology.orchestra.run.smithi150.stdout: "type": "v1", 2023-06-02T15:31:10.816 INFO:teuthology.orchestra.run.smithi150.stdout: "addr": "172.21.15.150:0", 2023-06-02T15:31:10.816 INFO:teuthology.orchestra.run.smithi150.stdout: "nonce": 2320993391 2023-06-02T15:31:10.817 INFO:teuthology.orchestra.run.smithi150.stdout: }, 2023-06-02T15:31:10.817 INFO:teuthology.orchestra.run.smithi150.stdout: "inst_str": "client.4872 172.21.15.150:0/2320993391", 2023-06-02T15:31:10.817 INFO:teuthology.orchestra.run.smithi150.stdout: "addr_str": "172.21.15.150:0/2320993391", 2023-06-02T15:31:10.817 INFO:teuthology.orchestra.run.smithi150.stdout: "inode_count": 1, 2023-06-02T15:31:10.817 INFO:teuthology.orchestra.run.smithi150.stdout: "mds_epoch": 9, 2023-06-02T15:31:10.817 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch": 25, 2023-06-02T15:31:10.817 INFO:teuthology.orchestra.run.smithi150.stdout: "osd_epoch_barrier": 0, 2023-06-02T15:31:10.818 INFO:teuthology.orchestra.run.smithi150.stdout: "blocklisted": false, 2023-06-02T15:31:10.818 INFO:teuthology.orchestra.run.smithi150.stdout: "fs_name": "cephfs" 2023-06-02T15:31:10.818 INFO:teuthology.orchestra.run.smithi150.stdout:} 2023-06-02T15:31:10.828 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-06-02T15:31:10.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b4b767640 1 Processor -- start 2023-06-02T15:31:10.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b4b767640 1 -- start start 2023-06-02T15:31:10.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b4b767640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b440a5bd0 0x7f9b44150530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:10.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b4b767640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b44150a70 con 0x7f9b440ba880 2023-06-02T15:31:10.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b4b767640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b440bb0e0 con 0x7f9b44149e00 2023-06-02T15:31:10.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b4b767640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4414a1d0 con 0x7f9b440a5bd0 2023-06-02T15:31:10.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b49d04640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b440a5bd0 0x7f9b44150530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:10.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b48d02640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9b440ba880 0x7f9b4414fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44342/0 (socket says 172.21.15.78:44342) 2023-06-02T15:31:10.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b48d02640 1 -- 172.21.15.78:0/448577646 learned_addr learned my addr 172.21.15.78:0/448577646 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:10.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b49d04640 1 -- 172.21.15.78:0/448577646 >> v1:172.21.15.132:6789/0 conn(0x7f9b44149e00 legacy=0x7f9b440a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:10.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b49d04640 1 -- 172.21.15.78:0/448577646 >> v1:172.21.15.78:6789/0 conn(0x7f9b440ba880 legacy=0x7f9b4414fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:10.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b49d04640 1 -- 172.21.15.78:0/448577646 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b440a3810 con 0x7f9b440a5bd0 2023-06-02T15:31:10.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.950+0000 7f9b3bfff640 1 -- 172.21.15.78:0/448577646 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707370184 0 0) 0x7f9b44150a70 con 0x7f9b440ba880 2023-06-02T15:31:10.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49d04640 1 --2- 172.21.15.78:0/448577646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440a5bd0 0x7f9b44150530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009d90 tx=0x7f9b3c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cba83ab9f62fa2 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:10.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b3bfff640 1 -- 172.21.15.78:0/448577646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0a57d0 con 0x7f9b440a5bd0 2023-06-02T15:31:10.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b3bfff640 1 -- 172.21.15.78:0/448577646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c0a5930 con 0x7f9b440a5bd0 2023-06-02T15:31:10.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b3bfff640 1 -- 172.21.15.78:0/448577646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0a5cc0 con 0x7f9b440a5bd0 2023-06-02T15:31:10.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- 172.21.15.78:0/448577646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440a5bd0 msgr2=0x7f9b44150530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:10.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 --2- 172.21.15.78:0/448577646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440a5bd0 0x7f9b44150530 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c009d90 tx=0x7f9b3c01c910 comp rx=0 tx=0).stop 2023-06-02T15:31:10.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- 172.21.15.78:0/448577646 shutdown_connections 2023-06-02T15:31:10.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 --2- 172.21.15.78:0/448577646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b440a5bd0 0x7f9b44150530 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:10.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- 172.21.15.78:0/448577646 >> 172.21.15.78:0/448577646 conn(0x7f9b440bcf50 msgr2=0x7f9b440bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:10.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- 172.21.15.78:0/448577646 shutdown_connections 2023-06-02T15:31:10.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- 172.21.15.78:0/448577646 wait complete. 2023-06-02T15:31:10.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 Processor -- start 2023-06-02T15:31:10.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- start start 2023-06-02T15:31:10.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440a5bd0 0x7f9b441466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:10.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b440ba880 0x7f9b440bf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:10.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b44149e00 0x7f9b440bf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:10.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440a61d0 con 0x7f9b44149e00 2023-06-02T15:31:10.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b441e8470 con 0x7f9b440a5bd0 2023-06-02T15:31:10.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b440befb0 con 0x7f9b440ba880 2023-06-02T15:31:10.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49d04640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b44149e00 0x7f9b440bf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:10.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49d04640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b44149e00 0x7f9b440bf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42506/0 (socket says 172.21.15.78:42506) 2023-06-02T15:31:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49d04640 1 -- 172.21.15.78:0/2007621605 learned_addr learned my addr 172.21.15.78:0/2007621605 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b48d02640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b440ba880 0x7f9b440bf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49d04640 1 -- 172.21.15.78:0/2007621605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b440ba880 msgr2=0x7f9b440bf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49503640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440a5bd0 0x7f9b441466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49d04640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b440ba880 0x7f9b440bf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49d04640 1 -- 172.21.15.78:0/2007621605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440a5bd0 msgr2=0x7f9b441466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49d04640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440a5bd0 0x7f9b441466a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:10.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49d04640 1 -- 172.21.15.78:0/2007621605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3c009a70 con 0x7f9b44149e00 2023-06-02T15:31:10.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b49d04640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b44149e00 0x7f9b440bf9f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c01cdf0 tx=0x7f9b3c0196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:10.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b39ffb640 1 -- 172.21.15.78:0/2007621605 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0ad650 con 0x7f9b44149e00 2023-06-02T15:31:10.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b39ffb640 1 -- 172.21.15.78:0/2007621605 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c0ad7b0 con 0x7f9b44149e00 2023-06-02T15:31:10.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- 172.21.15.78:0/2007621605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4415a710 con 0x7f9b44149e00 2023-06-02T15:31:10.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b39ffb640 1 -- 172.21.15.78:0/2007621605 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0adb20 con 0x7f9b44149e00 2023-06-02T15:31:10.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.954+0000 7f9b4b767640 1 -- 172.21.15.78:0/2007621605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b440a2b00 con 0x7f9b44149e00 2023-06-02T15:31:10.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.958+0000 7f9b4b767640 1 -- 172.21.15.78:0/2007621605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4415a8a0 con 0x7f9b44149e00 2023-06-02T15:31:10.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.958+0000 7f9b39ffb640 1 -- 172.21.15.78:0/2007621605 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f9b3c0adc80 con 0x7f9b44149e00 2023-06-02T15:31:10.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.958+0000 7f9b39ffb640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b28065c30 0x7f9b280680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:10.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.958+0000 7f9b49503640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b28065c30 0x7f9b280680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:10.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.958+0000 7f9b39ffb640 1 -- 172.21.15.78:0/2007621605 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9b3c11e870 con 0x7f9b44149e00 2023-06-02T15:31:10.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.958+0000 7f9b49503640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b28065c30 0x7f9b280680e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400a750 tx=0x7f9b34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:10.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:10.962+0000 7f9b39ffb640 1 -- 172.21.15.78:0/2007621605 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f9b3c0ebcc0 con 0x7f9b44149e00 2023-06-02T15:31:11.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.146+0000 7f9b4b767640 1 -- 172.21.15.78:0/2007621605 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9b4414d170 con 0x7f9b44149e00 2023-06-02T15:31:11.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.146+0000 7f9b39ffb640 1 -- 172.21.15.78:0/2007621605 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9b3c0c6070 con 0x7f9b44149e00 2023-06-02T15:31:11.156 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-06-02T15:31:11.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 -- 172.21.15.78:0/2007621605 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b28065c30 msgr2=0x7f9b280680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:11.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b28065c30 0x7f9b280680e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400a750 tx=0x7f9b34008040 comp rx=0 tx=0).stop 2023-06-02T15:31:11.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 -- 172.21.15.78:0/2007621605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b44149e00 msgr2=0x7f9b440bf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:11.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b44149e00 0x7f9b440bf9f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c01cdf0 tx=0x7f9b3c0196b0 comp rx=0 tx=0).stop 2023-06-02T15:31:11.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 -- 172.21.15.78:0/2007621605 shutdown_connections 2023-06-02T15:31:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b28065c30 0x7f9b280680e0 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400a750 tx=0x7f9b34008040 comp rx=0 tx=0).stop 2023-06-02T15:31:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b44149e00 0x7f9b440bf9f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b440ba880 0x7f9b440bf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 --2- 172.21.15.78:0/2007621605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b440a5bd0 0x7f9b441466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 -- 172.21.15.78:0/2007621605 >> 172.21.15.78:0/2007621605 conn(0x7f9b440bcf50 msgr2=0x7f9b4414fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 -- 172.21.15.78:0/2007621605 shutdown_connections 2023-06-02T15:31:11.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:11.150+0000 7f9b4b767640 1 -- 172.21.15.78:0/2007621605 wait complete. 2023-06-02T15:31:11.175 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-06-02T15:31:11.175 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-06-02T15:31:11.175 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2023-06-02T15:31:11.175 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-06-02T15:31:11.176 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-06-02T15:31:11.176 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-06-02T15:31:11.176 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-06-02T15:31:11.176 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-06-02T15:31:11.176 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-06-02T15:31:11.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.177 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2023-06-02T15:31:11.183 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-06-02T15:31:11.183 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-06-02T15:31:11.184 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2023-06-02T15:31:11.184 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:31:11.184 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2023-06-02T15:31:11.184 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:31:11.184 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-02T15:31:11.184 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2023-06-02T15:31:11.185 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2023-06-02T15:31:11.185 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-02T15:31:11.185 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2023-06-02T15:31:11.185 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2023-06-02T15:31:11.185 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-06-02T15:31:11.185 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2023-06-02T15:31:11.185 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-06-02T15:31:11.185 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2023-06-02T15:31:11.186 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-06-02T15:31:11.186 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42350sec preferred_lft 42350sec 2023-06-02T15:31:11.186 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2023-06-02T15:31:11.186 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:31:11.186 INFO:teuthology.orchestra.run.smithi159.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-06-02T15:31:11.186 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 02:42:a1:3f:66:d9 brd ff:ff:ff:ff:ff:ff 2023-06-02T15:31:11.186 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-06-02T15:31:11.186 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2023-06-02T15:31:11.187 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-06-02T15:31:11.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.187 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-06-02T15:31:11.188 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-06-02T15:31:11.188 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add name ceph-brx type bridge 2023-06-02T15:31:11.188 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr flush dev ceph-brx 2023-06-02T15:31:11.188 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set ceph-brx up 2023-06-02T15:31:11.188 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-06-02T15:31:11.189 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-06-02T15:31:11.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.269 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-06-02T15:31:11.325 INFO:teuthology.orchestra.run.smithi159.stdout:1 2023-06-02T15:31:11.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.327 DEBUG:teuthology.orchestra.run.smithi159:> route 2023-06-02T15:31:11.398 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2023-06-02T15:31:11.398 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-06-02T15:31:11.398 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-06-02T15:31:11.398 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-06-02T15:31:11.398 INFO:teuthology.orchestra.run.smithi159.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-06-02T15:31:11.398 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-06-02T15:31:11.399 INFO:teuthology.orchestra.run.smithi159.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-02T15:31:11.399 INFO:teuthology.orchestra.run.smithi159.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-02T15:31:11.399 INFO:teuthology.orchestra.run.smithi159.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-06-02T15:31:11.399 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-06-02T15:31:11.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.400 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-06-02T15:31:11.400 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-06-02T15:31:11.400 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-06-02T15:31:11.400 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-06-02T15:31:11.401 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-06-02T15:31:11.401 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-06-02T15:31:11.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.472 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-06-02T15:31:11.521 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.521 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2023-06-02T15:31:11.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.570 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-06-02T15:31:11.570 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-06-02T15:31:11.571 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-02T15:31:11.571 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-06-02T15:31:11.572 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-06-02T15:31:11.637 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-06-02T15:31:11.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.638 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-06-02T15:31:11.638 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-06-02T15:31:11.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-06-02T15:31:11.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-06-02T15:31:11.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-06-02T15:31:11.639 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-06-02T15:31:11.640 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-06-02T15:31:11.640 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-06-02T15:31:11.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.745 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2023-06-02T15:31:11.745 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2023-06-02T15:31:11.746 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2023-06-02T15:31:11.746 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.0 master ceph-brx 2023-06-02T15:31:11.746 DEBUG:teuthology.orchestra.run.smithi159:> ') 2023-06-02T15:31:11.765 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-06-02T15:31:11.765 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-02T15:31:11.766 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-06-02T15:31:11.816 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-06-02T15:31:11.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-06-02T15:31:11.817 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-06-02T15:31:11.864 DEBUG:teuthology.orchestra.run.smithi159:> sudo modprobe fuse 2023-06-02T15:31:11.920 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-02T15:31:11.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-02T15:31:11.969 INFO:teuthology.orchestra.run.smithi159.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-02T15:31:11.970 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-02T15:31:11.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:11.971 DEBUG:teuthology.orchestra.run.smithi159:> ls /sys/fs/fuse/connections 2023-06-02T15:31:12.017 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-06-02T15:31:12.018 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-06-02T15:31:12.063 DEBUG:teuthology.orchestra.run.smithi159:> sudo modprobe fuse 2023-06-02T15:31:12.077 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-02T15:31:12.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-02T15:31:12.135 INFO:teuthology.orchestra.run.smithi159.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-02T15:31:12.136 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-02T15:31:12.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:12.138 DEBUG:teuthology.orchestra.run.smithi159:> ls /sys/fs/fuse/connections 2023-06-02T15:31:12.158 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi159.stderr:2023-06-02T15:31:12.154+0000 7feed3884580 -1 init, newargv = 0x557a6b7053b0 newargc=15 2023-06-02T15:31:12.159 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi159.stderr:ceph-fuse[32281]: starting ceph client 2023-06-02T15:31:12.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi159.stderr:ceph-fuse[32281]: starting fuse 2023-06-02T15:31:13.262 DEBUG:teuthology.orchestra.run.smithi159:> sudo modprobe fuse 2023-06-02T15:31:13.278 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-06-02T15:31:13.279 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-06-02T15:31:13.331 INFO:teuthology.orchestra.run.smithi159.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-06-02T15:31:13.332 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-06-02T15:31:13.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:13.334 DEBUG:teuthology.orchestra.run.smithi159:> ls /sys/fs/fuse/connections 2023-06-02T15:31:13.385 INFO:teuthology.orchestra.run.smithi159.stdout:45 2023-06-02T15:31:13.386 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2023-06-02T15:31:13.386 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-06-02T15:31:13.386 DEBUG:teuthology.orchestra.run.smithi159:> import glob 2023-06-02T15:31:13.387 DEBUG:teuthology.orchestra.run.smithi159:> import re 2023-06-02T15:31:13.387 DEBUG:teuthology.orchestra.run.smithi159:> import os 2023-06-02T15:31:13.387 DEBUG:teuthology.orchestra.run.smithi159:> import subprocess 2023-06-02T15:31:13.387 DEBUG:teuthology.orchestra.run.smithi159:> 2023-06-02T15:31:13.388 DEBUG:teuthology.orchestra.run.smithi159:> def _find_admin_socket(client_name): 2023-06-02T15:31:13.388 DEBUG:teuthology.orchestra.run.smithi159:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-06-02T15:31:13.388 DEBUG:teuthology.orchestra.run.smithi159:> files = glob.glob(asok_path) 2023-06-02T15:31:13.388 DEBUG:teuthology.orchestra.run.smithi159:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-06-02T15:31:13.388 DEBUG:teuthology.orchestra.run.smithi159:> 2023-06-02T15:31:13.389 DEBUG:teuthology.orchestra.run.smithi159:> # Given a non-glob path, it better be there 2023-06-02T15:31:13.389 DEBUG:teuthology.orchestra.run.smithi159:> if "*" not in asok_path: 2023-06-02T15:31:13.389 DEBUG:teuthology.orchestra.run.smithi159:> assert(len(files) == 1) 2023-06-02T15:31:13.389 DEBUG:teuthology.orchestra.run.smithi159:> return files[0] 2023-06-02T15:31:13.390 DEBUG:teuthology.orchestra.run.smithi159:> 2023-06-02T15:31:13.390 DEBUG:teuthology.orchestra.run.smithi159:> for f in files: 2023-06-02T15:31:13.390 DEBUG:teuthology.orchestra.run.smithi159:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-06-02T15:31:13.390 DEBUG:teuthology.orchestra.run.smithi159:> if os.path.exists("/proc/{0}".format(pid)): 2023-06-02T15:31:13.390 DEBUG:teuthology.orchestra.run.smithi159:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-06-02T15:31:13.391 DEBUG:teuthology.orchestra.run.smithi159:> contents = proc_f.read() 2023-06-02T15:31:13.391 DEBUG:teuthology.orchestra.run.smithi159:> if mountpoint in contents: 2023-06-02T15:31:13.391 DEBUG:teuthology.orchestra.run.smithi159:> return f 2023-06-02T15:31:13.391 DEBUG:teuthology.orchestra.run.smithi159:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-06-02T15:31:13.392 DEBUG:teuthology.orchestra.run.smithi159:> 2023-06-02T15:31:13.392 DEBUG:teuthology.orchestra.run.smithi159:> print(_find_admin_socket("client.1")) 2023-06-02T15:31:13.392 DEBUG:teuthology.orchestra.run.smithi159:> ' 2023-06-02T15:31:13.506 INFO:teuthology.orchestra.run.smithi159.stdout:/var/run/ceph/ceph-client.1.32281.asok 2023-06-02T15:31:13.688 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.32281.asok 2023-06-02T15:31:13.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:13.689 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.32281.asok status 2023-06-02T15:31:13.842 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2023-06-02T15:31:13.842 INFO:teuthology.orchestra.run.smithi159.stdout: "metadata": { 2023-06-02T15:31:13.842 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_sha1": "2870bf456d3115490c153abce9d47ac5c043b65e", 2023-06-02T15:31:13.843 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 18.0.0-3488-g2870bf45 (2870bf456d3115490c153abce9d47ac5c043b65e) reef (rc)", 2023-06-02T15:31:13.843 INFO:teuthology.orchestra.run.smithi159.stdout: "entity_id": "1", 2023-06-02T15:31:13.843 INFO:teuthology.orchestra.run.smithi159.stdout: "hostname": "smithi159", 2023-06-02T15:31:13.843 INFO:teuthology.orchestra.run.smithi159.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-06-02T15:31:13.843 INFO:teuthology.orchestra.run.smithi159.stdout: "pid": "32281", 2023-06-02T15:31:13.843 INFO:teuthology.orchestra.run.smithi159.stdout: "root": "/" 2023-06-02T15:31:13.843 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2023-06-02T15:31:13.843 INFO:teuthology.orchestra.run.smithi159.stdout: "dentry_count": 0, 2023-06-02T15:31:13.844 INFO:teuthology.orchestra.run.smithi159.stdout: "dentry_pinned_count": 0, 2023-06-02T15:31:13.844 INFO:teuthology.orchestra.run.smithi159.stdout: "id": 4887, 2023-06-02T15:31:13.844 INFO:teuthology.orchestra.run.smithi159.stdout: "inst": { 2023-06-02T15:31:13.844 INFO:teuthology.orchestra.run.smithi159.stdout: "name": { 2023-06-02T15:31:13.844 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "client", 2023-06-02T15:31:13.845 INFO:teuthology.orchestra.run.smithi159.stdout: "num": 4887 2023-06-02T15:31:13.845 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2023-06-02T15:31:13.845 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": { 2023-06-02T15:31:13.845 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v1", 2023-06-02T15:31:13.845 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "172.21.15.159:0", 2023-06-02T15:31:13.845 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 1701573555 2023-06-02T15:31:13.845 INFO:teuthology.orchestra.run.smithi159.stdout: } 2023-06-02T15:31:13.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2023-06-02T15:31:13.846 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": { 2023-06-02T15:31:13.846 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v1", 2023-06-02T15:31:13.846 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "172.21.15.159:0", 2023-06-02T15:31:13.846 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 1701573555 2023-06-02T15:31:13.846 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2023-06-02T15:31:13.846 INFO:teuthology.orchestra.run.smithi159.stdout: "inst_str": "client.4887 172.21.15.159:0/1701573555", 2023-06-02T15:31:13.847 INFO:teuthology.orchestra.run.smithi159.stdout: "addr_str": "172.21.15.159:0/1701573555", 2023-06-02T15:31:13.847 INFO:teuthology.orchestra.run.smithi159.stdout: "inode_count": 1, 2023-06-02T15:31:13.847 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_epoch": 9, 2023-06-02T15:31:13.847 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_epoch": 25, 2023-06-02T15:31:13.847 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_epoch_barrier": 0, 2023-06-02T15:31:13.847 INFO:teuthology.orchestra.run.smithi159.stdout: "blocklisted": false, 2023-06-02T15:31:13.847 INFO:teuthology.orchestra.run.smithi159.stdout: "fs_name": "cephfs" 2023-06-02T15:31:13.847 INFO:teuthology.orchestra.run.smithi159.stdout:} 2023-06-02T15:31:13.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:13.856 DEBUG:teuthology.orchestra.run.smithi150:> stat --file-system '--printf=%T 2023-06-02T15:31:13.856 DEBUG:teuthology.orchestra.run.smithi150:> ' -- /home/ubuntu/cephtest/mnt.0 2023-06-02T15:31:13.863 INFO:teuthology.orchestra.run.smithi150.stdout:fuseblk 2023-06-02T15:31:13.864 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-06-02T15:31:13.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:13.864 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-06-02T15:31:13.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:13.920 DEBUG:teuthology.orchestra.run.smithi159:> stat --file-system '--printf=%T 2023-06-02T15:31:13.920 DEBUG:teuthology.orchestra.run.smithi159:> ' -- /home/ubuntu/cephtest/mnt.1 2023-06-02T15:31:13.926 INFO:teuthology.orchestra.run.smithi159.stdout:fuseblk 2023-06-02T15:31:13.927 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-06-02T15:31:13.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:13.927 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-06-02T15:31:13.981 INFO:teuthology.run_tasks:Running task pexec... 2023-06-02T15:31:13.992 INFO:teuthology.task.pexec:Executing custom commands... 2023-06-02T15:31:13.993 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi150.front.sepia.ceph.com 2023-06-02T15:31:13.993 DEBUG:teuthology.orchestra.run.smithi150:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-06-02T15:31:13.994 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi159.front.sepia.ceph.com 2023-06-02T15:31:13.994 DEBUG:teuthology.orchestra.run.smithi159:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-06-02T15:31:14.250 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:31:14.253 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:31:14.254 INFO:teuthology.orchestra.run.smithi150.stderr:--2023-06-02 15:31:14-- http://download.ceph.com/qa/mdtest-1.9.3.tgz 2023-06-02T15:31:14.256 INFO:teuthology.orchestra.run.smithi150.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-06-02T15:31:14.256 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:31:14.258 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:31:14.276 INFO:teuthology.orchestra.run.smithi150.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-06-02T15:31:14.314 INFO:teuthology.orchestra.run.smithi150.stderr:HTTP request sent, awaiting response... 200 OK 2023-06-02T15:31:14.314 INFO:teuthology.orchestra.run.smithi150.stderr:Length: 36252 (35K) [application/octet-stream] 2023-06-02T15:31:14.314 INFO:teuthology.orchestra.run.smithi150.stderr:Saving to: 'mdtest-1.9.3.tgz' 2023-06-02T15:31:14.315 INFO:teuthology.orchestra.run.smithi150.stderr: 2023-06-02T15:31:14.349 INFO:teuthology.orchestra.run.smithi150.stderr: 0K .......... .......... .......... ..... 100% 997K=0.04s 2023-06-02T15:31:14.350 INFO:teuthology.orchestra.run.smithi150.stderr: 2023-06-02T15:31:14.350 INFO:teuthology.orchestra.run.smithi150.stderr:2023-06-02 15:31:14 (997 KB/s) - 'mdtest-1.9.3.tgz' saved [36252/36252] 2023-06-02T15:31:14.350 INFO:teuthology.orchestra.run.smithi150.stderr: 2023-06-02T15:31:14.356 INFO:teuthology.orchestra.run.smithi150.stdout:COPYRIGHT 2023-06-02T15:31:14.356 INFO:teuthology.orchestra.run.smithi150.stdout:Makefile 2023-06-02T15:31:14.356 INFO:teuthology.orchestra.run.smithi150.stdout:README 2023-06-02T15:31:14.356 INFO:teuthology.orchestra.run.smithi150.stdout:RELEASE_LOG 2023-06-02T15:31:14.356 INFO:teuthology.orchestra.run.smithi150.stdout:mdtest.1 2023-06-02T15:31:14.357 INFO:teuthology.orchestra.run.smithi150.stdout:mdtest.c 2023-06-02T15:31:14.357 INFO:teuthology.orchestra.run.smithi150.stdout:scripts/ 2023-06-02T15:31:14.357 INFO:teuthology.orchestra.run.smithi150.stdout:scripts/env_to_db.tcsh 2023-06-02T15:31:14.358 INFO:teuthology.orchestra.run.smithi150.stdout:scripts/mdtest_wrapper.py 2023-06-02T15:31:14.358 INFO:teuthology.orchestra.run.smithi150.stdout:scripts/paramCatch.py 2023-06-02T15:31:14.358 INFO:teuthology.orchestra.run.smithi150.stdout:scripts/tester.py 2023-06-02T15:31:14.358 INFO:teuthology.orchestra.run.smithi150.stdout:scripts/WRAPPER_README 2023-06-02T15:31:14.361 INFO:teuthology.orchestra.run.smithi150.stdout:mpicc -DLinux -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D__USE_LARGEFILE64=1 -g -o mdtest mdtest.c -lm 2023-06-02T15:31:14.435 INFO:teuthology.orchestra.run.smithi159.stderr:--2023-06-02 15:31:14-- http://download.ceph.com/qa/mdtest-1.9.3.tgz 2023-06-02T15:31:14.437 INFO:teuthology.orchestra.run.smithi159.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-06-02T15:31:14.473 INFO:teuthology.orchestra.run.smithi159.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-06-02T15:31:14.503 INFO:teuthology.orchestra.run.smithi159.stderr:HTTP request sent, awaiting response... 200 OK 2023-06-02T15:31:14.503 INFO:teuthology.orchestra.run.smithi159.stderr:Length: 36252 (35K) [application/octet-stream] 2023-06-02T15:31:14.503 INFO:teuthology.orchestra.run.smithi159.stderr:Saving to: 'mdtest-1.9.3.tgz' 2023-06-02T15:31:14.503 INFO:teuthology.orchestra.run.smithi159.stderr: 2023-06-02T15:31:14.545 INFO:teuthology.orchestra.run.smithi159.stderr: 0K .......... .......... .......... ..... 100% 834K=0.04s 2023-06-02T15:31:14.545 INFO:teuthology.orchestra.run.smithi159.stderr: 2023-06-02T15:31:14.546 INFO:teuthology.orchestra.run.smithi159.stderr:2023-06-02 15:31:14 (834 KB/s) - 'mdtest-1.9.3.tgz' saved [36252/36252] 2023-06-02T15:31:14.546 INFO:teuthology.orchestra.run.smithi159.stderr: 2023-06-02T15:31:14.552 INFO:teuthology.orchestra.run.smithi159.stdout:COPYRIGHT 2023-06-02T15:31:14.553 INFO:teuthology.orchestra.run.smithi159.stdout:Makefile 2023-06-02T15:31:14.553 INFO:teuthology.orchestra.run.smithi159.stdout:README 2023-06-02T15:31:14.553 INFO:teuthology.orchestra.run.smithi159.stdout:RELEASE_LOG 2023-06-02T15:31:14.553 INFO:teuthology.orchestra.run.smithi159.stdout:mdtest.1 2023-06-02T15:31:14.553 INFO:teuthology.orchestra.run.smithi159.stdout:mdtest.c 2023-06-02T15:31:14.554 INFO:teuthology.orchestra.run.smithi159.stdout:scripts/ 2023-06-02T15:31:14.554 INFO:teuthology.orchestra.run.smithi159.stdout:scripts/env_to_db.tcsh 2023-06-02T15:31:14.554 INFO:teuthology.orchestra.run.smithi159.stdout:scripts/mdtest_wrapper.py 2023-06-02T15:31:14.554 INFO:teuthology.orchestra.run.smithi159.stdout:scripts/paramCatch.py 2023-06-02T15:31:14.555 INFO:teuthology.orchestra.run.smithi159.stdout:scripts/tester.py 2023-06-02T15:31:14.555 INFO:teuthology.orchestra.run.smithi159.stdout:scripts/WRAPPER_README 2023-06-02T15:31:14.557 INFO:teuthology.orchestra.run.smithi159.stdout:mpicc -DLinux -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE=1 -D__USE_LARGEFILE64=1 -g -o mdtest mdtest.c -lm 2023-06-02T15:31:14.912 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c: In function 'main': 2023-06-02T15:31:14.924 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2492:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-06-02T15:31:14.924 INFO:teuthology.orchestra.run.smithi150.stderr: 2492 | fprintf( stdout, "read_bytes : %llu\n", read_bytes ); 2023-06-02T15:31:14.925 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~^ ~~~~~~~~~~ 2023-06-02T15:31:14.925 INFO:teuthology.orchestra.run.smithi150.stderr: | | | 2023-06-02T15:31:14.925 INFO:teuthology.orchestra.run.smithi150.stderr: | | size_t {aka long unsigned int} 2023-06-02T15:31:14.925 INFO:teuthology.orchestra.run.smithi150.stderr: | long long unsigned int 2023-06-02T15:31:14.925 INFO:teuthology.orchestra.run.smithi150.stderr: | %lu 2023-06-02T15:31:14.925 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2510:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-06-02T15:31:14.926 INFO:teuthology.orchestra.run.smithi150.stderr: 2510 | fprintf( stdout, "write_bytes : %llu\n", write_bytes ); 2023-06-02T15:31:14.926 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~^ ~~~~~~~~~~~ 2023-06-02T15:31:14.926 INFO:teuthology.orchestra.run.smithi150.stderr: | | | 2023-06-02T15:31:14.926 INFO:teuthology.orchestra.run.smithi150.stderr: | | size_t {aka long unsigned int} 2023-06-02T15:31:14.926 INFO:teuthology.orchestra.run.smithi150.stderr: | long long unsigned int 2023-06-02T15:31:14.926 INFO:teuthology.orchestra.run.smithi150.stderr: | %lu 2023-06-02T15:31:14.953 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c: In function 'create_remove_items_helper': 2023-06-02T15:31:14.953 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:670:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-02T15:31:14.953 INFO:teuthology.orchestra.run.smithi150.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:14.953 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:14.953 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:670:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-02T15:31:14.953 INFO:teuthology.orchestra.run.smithi150.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:14.953 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.954 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:414:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-02T15:31:14.954 INFO:teuthology.orchestra.run.smithi150.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:14.954 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:14.954 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:414:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-02T15:31:14.954 INFO:teuthology.orchestra.run.smithi150.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:14.954 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.954 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:376:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:14.955 INFO:teuthology.orchestra.run.smithi150.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:14.955 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:14.955 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:376:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-02T15:31:14.955 INFO:teuthology.orchestra.run.smithi150.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:14.955 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.955 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:341:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:14.955 INFO:teuthology.orchestra.run.smithi150.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:14.955 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:14.956 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:341:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-02T15:31:14.956 INFO:teuthology.orchestra.run.smithi150.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:14.956 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.957 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c: In function 'collective_helper': 2023-06-02T15:31:14.957 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:820:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-02T15:31:14.957 INFO:teuthology.orchestra.run.smithi150.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:14.957 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:14.957 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:820:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-02T15:31:14.957 INFO:teuthology.orchestra.run.smithi150.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:14.958 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.958 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:776:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-02T15:31:14.958 INFO:teuthology.orchestra.run.smithi150.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:14.958 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:14.958 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:776:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-02T15:31:14.958 INFO:teuthology.orchestra.run.smithi150.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:14.958 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.959 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:747:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:14.959 INFO:teuthology.orchestra.run.smithi150.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:14.959 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:14.959 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:747:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-02T15:31:14.959 INFO:teuthology.orchestra.run.smithi150.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:14.959 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.959 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:722:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:14.959 INFO:teuthology.orchestra.run.smithi150.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:14.960 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:14.960 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:722:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-02T15:31:14.960 INFO:teuthology.orchestra.run.smithi150.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:14.960 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.960 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c: In function 'create_remove_items': 2023-06-02T15:31:14.960 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:893:42: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.960 INFO:teuthology.orchestra.run.smithi150.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-06-02T15:31:14.961 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~ 2023-06-02T15:31:14.961 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:893:25: note: 'sprintf' output between 4 and 4118 bytes into a destination of size 4096 2023-06-02T15:31:14.961 INFO:teuthology.orchestra.run.smithi150.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-06-02T15:31:14.961 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.963 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c: In function 'mdtest_stat': 2023-06-02T15:31:14.964 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:990:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:14.964 INFO:teuthology.orchestra.run.smithi150.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-06-02T15:31:14.964 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~~~ 2023-06-02T15:31:14.964 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:990:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-06-02T15:31:14.964 INFO:teuthology.orchestra.run.smithi150.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-06-02T15:31:14.964 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.964 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:984:26: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2023-06-02T15:31:14.965 INFO:teuthology.orchestra.run.smithi150.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-06-02T15:31:14.965 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~~~ 2023-06-02T15:31:14.965 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:984:7: note: 'sprintf' output between 6 and 4120 bytes into a destination of size 4096 2023-06-02T15:31:14.965 INFO:teuthology.orchestra.run.smithi150.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-06-02T15:31:14.965 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.965 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:999:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.965 INFO:teuthology.orchestra.run.smithi150.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:14.966 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~ 2023-06-02T15:31:14.966 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:999:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-02T15:31:14.966 INFO:teuthology.orchestra.run.smithi150.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:14.966 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.966 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1005:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.966 INFO:teuthology.orchestra.run.smithi150.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:14.966 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~ 2023-06-02T15:31:14.966 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1005:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-02T15:31:14.967 INFO:teuthology.orchestra.run.smithi150.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:14.967 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.967 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1011:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-06-02T15:31:14.967 INFO:teuthology.orchestra.run.smithi150.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-06-02T15:31:14.967 INFO:teuthology.orchestra.run.smithi150.stderr: | ^ 2023-06-02T15:31:14.967 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1011:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-06-02T15:31:14.967 INFO:teuthology.orchestra.run.smithi150.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-06-02T15:31:14.967 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.968 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c: In function 'mdtest_read': 2023-06-02T15:31:14.968 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1148:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:14.968 INFO:teuthology.orchestra.run.smithi150.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-06-02T15:31:14.968 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~~~ 2023-06-02T15:31:14.968 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1148:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-06-02T15:31:14.968 INFO:teuthology.orchestra.run.smithi150.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-06-02T15:31:14.968 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.969 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1157:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.969 INFO:teuthology.orchestra.run.smithi150.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:14.969 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~ 2023-06-02T15:31:14.969 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1157:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-02T15:31:14.969 INFO:teuthology.orchestra.run.smithi150.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:14.969 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.969 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1163:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.969 INFO:teuthology.orchestra.run.smithi150.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:14.970 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~ 2023-06-02T15:31:14.970 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1163:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-02T15:31:14.970 INFO:teuthology.orchestra.run.smithi150.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:14.970 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.970 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1169:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-06-02T15:31:14.970 INFO:teuthology.orchestra.run.smithi150.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-06-02T15:31:14.970 INFO:teuthology.orchestra.run.smithi150.stderr: | ^ 2023-06-02T15:31:14.970 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1169:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-06-02T15:31:14.971 INFO:teuthology.orchestra.run.smithi150.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-06-02T15:31:14.971 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.971 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c: In function 'collective_create_remove': 2023-06-02T15:31:14.971 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1328:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.971 INFO:teuthology.orchestra.run.smithi150.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.971 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.971 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1328:9: note: 'sprintf' output between 17 and 4112 bytes into a destination of size 4096 2023-06-02T15:31:14.971 INFO:teuthology.orchestra.run.smithi150.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.972 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.972 INFO:teuthology.orchestra.run.smithi150.stderr: 1329 | (0+(0*nstride))%ntasks); 2023-06-02T15:31:14.972 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.972 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1330:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.972 INFO:teuthology.orchestra.run.smithi150.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.972 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.972 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1330:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.973 INFO:teuthology.orchestra.run.smithi150.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.973 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.973 INFO:teuthology.orchestra.run.smithi150.stderr: 1331 | (0+(1*nstride))%ntasks); 2023-06-02T15:31:14.973 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.973 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1332:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.973 INFO:teuthology.orchestra.run.smithi150.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.973 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.973 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1332:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.974 INFO:teuthology.orchestra.run.smithi150.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.974 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.974 INFO:teuthology.orchestra.run.smithi150.stderr: 1333 | (0+(2*nstride))%ntasks); 2023-06-02T15:31:14.974 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.974 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1334:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.974 INFO:teuthology.orchestra.run.smithi150.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.974 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.974 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1334:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.975 INFO:teuthology.orchestra.run.smithi150.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.975 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.975 INFO:teuthology.orchestra.run.smithi150.stderr: 1335 | (0+(3*nstride))%ntasks); 2023-06-02T15:31:14.975 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.975 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1336:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.975 INFO:teuthology.orchestra.run.smithi150.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.975 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.976 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1336:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.976 INFO:teuthology.orchestra.run.smithi150.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.976 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.976 INFO:teuthology.orchestra.run.smithi150.stderr: 1337 | (0+(4*nstride))%ntasks); 2023-06-02T15:31:14.976 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.976 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1293:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.976 INFO:teuthology.orchestra.run.smithi150.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.976 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.977 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1293:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.977 INFO:teuthology.orchestra.run.smithi150.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.977 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.977 INFO:teuthology.orchestra.run.smithi150.stderr: 1294 | (i+(0*nstride))%ntasks); 2023-06-02T15:31:14.977 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.977 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1295:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.977 INFO:teuthology.orchestra.run.smithi150.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.977 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.978 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1295:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.978 INFO:teuthology.orchestra.run.smithi150.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.978 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.978 INFO:teuthology.orchestra.run.smithi150.stderr: 1296 | (i+(1*nstride))%ntasks); 2023-06-02T15:31:14.978 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.978 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1297:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.978 INFO:teuthology.orchestra.run.smithi150.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.978 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.979 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1297:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.979 INFO:teuthology.orchestra.run.smithi150.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.979 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.979 INFO:teuthology.orchestra.run.smithi150.stderr: 1298 | (i+(2*nstride))%ntasks); 2023-06-02T15:31:14.979 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.979 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1299:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.979 INFO:teuthology.orchestra.run.smithi150.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.980 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.980 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1299:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.980 INFO:teuthology.orchestra.run.smithi150.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.980 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.980 INFO:teuthology.orchestra.run.smithi150.stderr: 1300 | (i+(3*nstride))%ntasks); 2023-06-02T15:31:14.980 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.980 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1301:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.980 INFO:teuthology.orchestra.run.smithi150.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.981 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.981 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:1301:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.981 INFO:teuthology.orchestra.run.smithi150.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.981 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.981 INFO:teuthology.orchestra.run.smithi150.stderr: 1302 | (i+(4*nstride))%ntasks); 2023-06-02T15:31:14.981 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.983 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c: In function 'create_remove_directory_tree': 2023-06-02T15:31:14.983 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2281:24: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.984 INFO:teuthology.orchestra.run.smithi150.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-06-02T15:31:14.984 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ 2023-06-02T15:31:14.984 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2281:7: note: 'sprintf' output between 4 and 4109 bytes into a destination of size 4096 2023-06-02T15:31:14.984 INFO:teuthology.orchestra.run.smithi150.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-06-02T15:31:14.984 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.984 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2225:24: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.984 INFO:teuthology.orchestra.run.smithi150.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-06-02T15:31:14.985 INFO:teuthology.orchestra.run.smithi150.stderr: | ^ 2023-06-02T15:31:14.985 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2225:5: note: 'sprintf' output 5 or more bytes (assuming 4100) into a destination of size 4096 2023-06-02T15:31:14.985 INFO:teuthology.orchestra.run.smithi150.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-06-02T15:31:14.985 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.985 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c: In function 'main': 2023-06-02T15:31:14.985 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2725:34: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.985 INFO:teuthology.orchestra.run.smithi150.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-06-02T15:31:14.985 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ 2023-06-02T15:31:14.986 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2725:13: note: 'sprintf' output between 3 and 4108 bytes into a destination of size 4096 2023-06-02T15:31:14.986 INFO:teuthology.orchestra.run.smithi150.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-06-02T15:31:14.986 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.986 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2826:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.986 INFO:teuthology.orchestra.run.smithi150.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:14.986 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-02T15:31:14.986 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2826:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-02T15:31:14.987 INFO:teuthology.orchestra.run.smithi150.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:14.987 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2827:43: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.987 INFO:teuthology.orchestra.run.smithi150.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:14.987 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-02T15:31:14.987 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2827:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-02T15:31:14.987 INFO:teuthology.orchestra.run.smithi150.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:14.987 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.988 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2828:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.988 INFO:teuthology.orchestra.run.smithi150.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:14.988 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-02T15:31:14.988 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2828:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-02T15:31:14.988 INFO:teuthology.orchestra.run.smithi150.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:14.988 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.988 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2829:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.988 INFO:teuthology.orchestra.run.smithi150.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:14.989 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-02T15:31:14.989 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2829:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-02T15:31:14.989 INFO:teuthology.orchestra.run.smithi150.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:14.989 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.989 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2830:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:14.989 INFO:teuthology.orchestra.run.smithi150.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:14.989 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-02T15:31:14.990 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2830:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-02T15:31:14.990 INFO:teuthology.orchestra.run.smithi150.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:14.990 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.990 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2848:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.990 INFO:teuthology.orchestra.run.smithi150.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.990 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.990 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2848:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.990 INFO:teuthology.orchestra.run.smithi150.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.991 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.991 INFO:teuthology.orchestra.run.smithi150.stderr: 2849 | (rank+(0*nstride))%i); 2023-06-02T15:31:14.991 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.991 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2850:50: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.991 INFO:teuthology.orchestra.run.smithi150.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.991 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.991 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2850:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.991 INFO:teuthology.orchestra.run.smithi150.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.992 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.992 INFO:teuthology.orchestra.run.smithi150.stderr: 2851 | (rank+(1*nstride))%i); 2023-06-02T15:31:14.992 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.992 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2852:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.992 INFO:teuthology.orchestra.run.smithi150.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.992 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.992 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2852:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.992 INFO:teuthology.orchestra.run.smithi150.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.993 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.993 INFO:teuthology.orchestra.run.smithi150.stderr: 2853 | (rank+(2*nstride))%i); 2023-06-02T15:31:14.993 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.993 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2854:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.993 INFO:teuthology.orchestra.run.smithi150.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.993 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.993 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2854:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.994 INFO:teuthology.orchestra.run.smithi150.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.994 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.994 INFO:teuthology.orchestra.run.smithi150.stderr: 2855 | (rank+(3*nstride))%i); 2023-06-02T15:31:14.994 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.994 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2856:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:14.994 INFO:teuthology.orchestra.run.smithi150.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.994 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:14.994 INFO:teuthology.orchestra.run.smithi150.stderr:mdtest.c:2856:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:14.995 INFO:teuthology.orchestra.run.smithi150.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:14.995 INFO:teuthology.orchestra.run.smithi150.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:14.995 INFO:teuthology.orchestra.run.smithi150.stderr: 2857 | (rank+(4*nstride))%i); 2023-06-02T15:31:14.995 INFO:teuthology.orchestra.run.smithi150.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.167 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c: In function 'main': 2023-06-02T15:31:15.181 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2492:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-06-02T15:31:15.181 INFO:teuthology.orchestra.run.smithi159.stderr: 2492 | fprintf( stdout, "read_bytes : %llu\n", read_bytes ); 2023-06-02T15:31:15.181 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~^ ~~~~~~~~~~ 2023-06-02T15:31:15.181 INFO:teuthology.orchestra.run.smithi159.stderr: | | | 2023-06-02T15:31:15.181 INFO:teuthology.orchestra.run.smithi159.stderr: | | size_t {aka long unsigned int} 2023-06-02T15:31:15.182 INFO:teuthology.orchestra.run.smithi159.stderr: | long long unsigned int 2023-06-02T15:31:15.182 INFO:teuthology.orchestra.run.smithi159.stderr: | %lu 2023-06-02T15:31:15.182 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2510:54: warning: format '%llu' expects argument of type 'long long unsigned int', but argument 3 has type 'size_t' {aka 'long unsigned int'} [-Wformat=] 2023-06-02T15:31:15.182 INFO:teuthology.orchestra.run.smithi159.stderr: 2510 | fprintf( stdout, "write_bytes : %llu\n", write_bytes ); 2023-06-02T15:31:15.182 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~^ ~~~~~~~~~~~ 2023-06-02T15:31:15.183 INFO:teuthology.orchestra.run.smithi159.stderr: | | | 2023-06-02T15:31:15.183 INFO:teuthology.orchestra.run.smithi159.stderr: | | size_t {aka long unsigned int} 2023-06-02T15:31:15.183 INFO:teuthology.orchestra.run.smithi159.stderr: | long long unsigned int 2023-06-02T15:31:15.183 INFO:teuthology.orchestra.run.smithi159.stderr: | %lu 2023-06-02T15:31:15.204 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c: In function 'create_remove_items_helper': 2023-06-02T15:31:15.204 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:670:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-02T15:31:15.204 INFO:teuthology.orchestra.run.smithi159.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:15.204 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:15.204 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:670:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-02T15:31:15.204 INFO:teuthology.orchestra.run.smithi159.stderr: 670 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:15.205 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.205 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:414:37: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-02T15:31:15.205 INFO:teuthology.orchestra.run.smithi159.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:15.205 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:15.205 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:414:9: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-02T15:31:15.205 INFO:teuthology.orchestra.run.smithi159.stderr: 414 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:15.205 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.206 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:376:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:15.206 INFO:teuthology.orchestra.run.smithi159.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:15.206 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:15.206 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:376:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-02T15:31:15.206 INFO:teuthology.orchestra.run.smithi159.stderr: 376 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:15.206 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.206 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:341:36: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:15.206 INFO:teuthology.orchestra.run.smithi159.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:15.207 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:15.207 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:341:9: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-02T15:31:15.207 INFO:teuthology.orchestra.run.smithi159.stderr: 341 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:15.207 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.208 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c: In function 'collective_helper': 2023-06-02T15:31:15.208 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:820:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-02T15:31:15.208 INFO:teuthology.orchestra.run.smithi159.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:15.208 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:15.209 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:820:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-02T15:31:15.209 INFO:teuthology.orchestra.run.smithi159.stderr: 820 | sprintf(curr_item, "%s/file.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:15.209 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.209 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:776:45: warning: '%s' directive writing up to 4095 bytes into a region of size 4090 [-Wformat-overflow=] 2023-06-02T15:31:15.209 INFO:teuthology.orchestra.run.smithi159.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:15.209 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:15.209 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:776:17: note: 'sprintf' output 8 or more bytes (assuming 4103) into a destination of size 4096 2023-06-02T15:31:15.209 INFO:teuthology.orchestra.run.smithi159.stderr: 776 | sprintf(curr_item, "%s/file.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:15.210 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.210 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:747:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:15.210 INFO:teuthology.orchestra.run.smithi159.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:15.210 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:15.210 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:747:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-02T15:31:15.210 INFO:teuthology.orchestra.run.smithi159.stderr: 747 | sprintf(curr_item, "%s/dir.%s%llu", path, rm_name, itemNum+i); 2023-06-02T15:31:15.210 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.210 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:722:44: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:15.211 INFO:teuthology.orchestra.run.smithi159.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:15.211 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~ 2023-06-02T15:31:15.211 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:722:17: note: 'sprintf' output 7 or more bytes (assuming 4102) into a destination of size 4096 2023-06-02T15:31:15.211 INFO:teuthology.orchestra.run.smithi159.stderr: 722 | sprintf(curr_item, "%s/dir.%s%llu", path, mk_name, itemNum+i); 2023-06-02T15:31:15.211 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.211 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c: In function 'create_remove_items': 2023-06-02T15:31:15.211 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:893:42: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.211 INFO:teuthology.orchestra.run.smithi159.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-06-02T15:31:15.212 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~ 2023-06-02T15:31:15.212 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:893:25: note: 'sprintf' output between 4 and 4118 bytes into a destination of size 4096 2023-06-02T15:31:15.212 INFO:teuthology.orchestra.run.smithi159.stderr: 893 | sprintf(dir, "%s.%llu/", base_tree_name, currDir); 2023-06-02T15:31:15.212 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.215 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c: In function 'mdtest_stat': 2023-06-02T15:31:15.215 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:990:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:15.215 INFO:teuthology.orchestra.run.smithi159.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-06-02T15:31:15.215 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~~~ 2023-06-02T15:31:15.215 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:990:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-06-02T15:31:15.215 INFO:teuthology.orchestra.run.smithi159.stderr: 990 | sprintf(item, "file.%s%llu", stat_name, item_num); 2023-06-02T15:31:15.216 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.216 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:984:26: warning: '%s' directive writing up to 4095 bytes into a region of size 4092 [-Wformat-overflow=] 2023-06-02T15:31:15.216 INFO:teuthology.orchestra.run.smithi159.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-06-02T15:31:15.216 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~~~ 2023-06-02T15:31:15.216 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:984:7: note: 'sprintf' output between 6 and 4120 bytes into a destination of size 4096 2023-06-02T15:31:15.216 INFO:teuthology.orchestra.run.smithi159.stderr: 984 | sprintf(item, "dir.%s%llu", stat_name, item_num); 2023-06-02T15:31:15.216 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.217 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:999:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.217 INFO:teuthology.orchestra.run.smithi159.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:15.217 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~ 2023-06-02T15:31:15.217 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:999:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-02T15:31:15.217 INFO:teuthology.orchestra.run.smithi159.stderr: 999 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:15.217 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.217 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1005:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.217 INFO:teuthology.orchestra.run.smithi159.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:15.218 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~ 2023-06-02T15:31:15.218 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1005:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-02T15:31:15.218 INFO:teuthology.orchestra.run.smithi159.stderr: 1005 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:15.218 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.218 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1011:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-06-02T15:31:15.218 INFO:teuthology.orchestra.run.smithi159.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-06-02T15:31:15.218 INFO:teuthology.orchestra.run.smithi159.stderr: | ^ 2023-06-02T15:31:15.218 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1011:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-06-02T15:31:15.219 INFO:teuthology.orchestra.run.smithi159.stderr: 1011 | sprintf( temp, "%s/%s", path, item ); 2023-06-02T15:31:15.219 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.219 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c: In function 'mdtest_read': 2023-06-02T15:31:15.219 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1148:27: warning: '%s' directive writing up to 4095 bytes into a region of size 4091 [-Wformat-overflow=] 2023-06-02T15:31:15.219 INFO:teuthology.orchestra.run.smithi159.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-06-02T15:31:15.219 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~~~ 2023-06-02T15:31:15.219 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1148:7: note: 'sprintf' output between 7 and 4121 bytes into a destination of size 4096 2023-06-02T15:31:15.219 INFO:teuthology.orchestra.run.smithi159.stderr: 1148 | sprintf(item, "file.%s%llu", read_name, item_num); 2023-06-02T15:31:15.220 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.220 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1157:25: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.220 INFO:teuthology.orchestra.run.smithi159.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:15.220 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~ 2023-06-02T15:31:15.220 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1157:7: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-02T15:31:15.220 INFO:teuthology.orchestra.run.smithi159.stderr: 1157 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:15.220 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.221 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1163:27: warning: '%llu' directive writing between 1 and 20 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.221 INFO:teuthology.orchestra.run.smithi159.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:15.221 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~ 2023-06-02T15:31:15.221 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1163:9: note: 'sprintf' output between 4 and 8213 bytes into a destination of size 4096 2023-06-02T15:31:15.221 INFO:teuthology.orchestra.run.smithi159.stderr: 1163 | sprintf(temp, "%s.%llu/%s", base_tree_name, parent_dir, item); 2023-06-02T15:31:15.221 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.221 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1169:26: warning: 'sprintf' may write a terminating nul past the end of the destination [-Wformat-overflow=] 2023-06-02T15:31:15.221 INFO:teuthology.orchestra.run.smithi159.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-06-02T15:31:15.222 INFO:teuthology.orchestra.run.smithi159.stderr: | ^ 2023-06-02T15:31:15.222 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1169:5: note: 'sprintf' output 2 or more bytes (assuming 4097) into a destination of size 4096 2023-06-02T15:31:15.222 INFO:teuthology.orchestra.run.smithi159.stderr: 1169 | sprintf( temp, "%s/%s", path, item ); 2023-06-02T15:31:15.222 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.222 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c: In function 'collective_create_remove': 2023-06-02T15:31:15.222 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1328:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.222 INFO:teuthology.orchestra.run.smithi159.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.222 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.223 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1328:9: note: 'sprintf' output between 17 and 4112 bytes into a destination of size 4096 2023-06-02T15:31:15.223 INFO:teuthology.orchestra.run.smithi159.stderr: 1328 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.223 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.223 INFO:teuthology.orchestra.run.smithi159.stderr: 1329 | (0+(0*nstride))%ntasks); 2023-06-02T15:31:15.223 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.223 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1330:38: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.223 INFO:teuthology.orchestra.run.smithi159.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.224 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.224 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1330:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.224 INFO:teuthology.orchestra.run.smithi159.stderr: 1330 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.224 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.224 INFO:teuthology.orchestra.run.smithi159.stderr: 1331 | (0+(1*nstride))%ntasks); 2023-06-02T15:31:15.224 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.224 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1332:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.224 INFO:teuthology.orchestra.run.smithi159.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.225 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.225 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1332:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.225 INFO:teuthology.orchestra.run.smithi159.stderr: 1332 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.225 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.225 INFO:teuthology.orchestra.run.smithi159.stderr: 1333 | (0+(2*nstride))%ntasks); 2023-06-02T15:31:15.225 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.225 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1334:37: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.225 INFO:teuthology.orchestra.run.smithi159.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.226 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.226 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1334:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.226 INFO:teuthology.orchestra.run.smithi159.stderr: 1334 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.226 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.226 INFO:teuthology.orchestra.run.smithi159.stderr: 1335 | (0+(3*nstride))%ntasks); 2023-06-02T15:31:15.226 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.226 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1336:35: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.226 INFO:teuthology.orchestra.run.smithi159.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.227 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.227 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1336:9: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.227 INFO:teuthology.orchestra.run.smithi159.stderr: 1336 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.227 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.227 INFO:teuthology.orchestra.run.smithi159.stderr: 1337 | (0+(4*nstride))%ntasks); 2023-06-02T15:31:15.227 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.228 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1293:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.228 INFO:teuthology.orchestra.run.smithi159.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.228 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.228 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1293:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.228 INFO:teuthology.orchestra.run.smithi159.stderr: 1293 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.228 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.229 INFO:teuthology.orchestra.run.smithi159.stderr: 1294 | (i+(0*nstride))%ntasks); 2023-06-02T15:31:15.229 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.229 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1295:42: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.229 INFO:teuthology.orchestra.run.smithi159.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.229 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.229 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1295:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.229 INFO:teuthology.orchestra.run.smithi159.stderr: 1295 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.230 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.230 INFO:teuthology.orchestra.run.smithi159.stderr: 1296 | (i+(1*nstride))%ntasks); 2023-06-02T15:31:15.230 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.230 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1297:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.230 INFO:teuthology.orchestra.run.smithi159.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.230 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.230 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1297:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.231 INFO:teuthology.orchestra.run.smithi159.stderr: 1297 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.231 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.231 INFO:teuthology.orchestra.run.smithi159.stderr: 1298 | (i+(2*nstride))%ntasks); 2023-06-02T15:31:15.231 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.231 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1299:41: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.231 INFO:teuthology.orchestra.run.smithi159.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.231 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.231 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1299:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.232 INFO:teuthology.orchestra.run.smithi159.stderr: 1299 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.232 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.232 INFO:teuthology.orchestra.run.smithi159.stderr: 1300 | (i+(3*nstride))%ntasks); 2023-06-02T15:31:15.232 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.232 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1301:39: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.232 INFO:teuthology.orchestra.run.smithi159.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.232 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.232 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:1301:13: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.233 INFO:teuthology.orchestra.run.smithi159.stderr: 1301 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.233 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.233 INFO:teuthology.orchestra.run.smithi159.stderr: 1302 | (i+(4*nstride))%ntasks); 2023-06-02T15:31:15.233 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.235 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c: In function 'create_remove_directory_tree': 2023-06-02T15:31:15.235 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2281:24: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.236 INFO:teuthology.orchestra.run.smithi159.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-06-02T15:31:15.236 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ 2023-06-02T15:31:15.236 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2281:7: note: 'sprintf' output between 4 and 4109 bytes into a destination of size 4096 2023-06-02T15:31:15.236 INFO:teuthology.orchestra.run.smithi159.stderr: 2281 | sprintf(dir, "%s.%d/", base_tree_name, currDir); 2023-06-02T15:31:15.236 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.236 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2225:24: warning: '.' directive writing 1 byte into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.236 INFO:teuthology.orchestra.run.smithi159.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-06-02T15:31:15.237 INFO:teuthology.orchestra.run.smithi159.stderr: | ^ 2023-06-02T15:31:15.237 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2225:5: note: 'sprintf' output 5 or more bytes (assuming 4100) into a destination of size 4096 2023-06-02T15:31:15.237 INFO:teuthology.orchestra.run.smithi159.stderr: 2225 | sprintf(dir, "%s/%s.%d/", path, base_tree_name, dirNum); 2023-06-02T15:31:15.237 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.237 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c: In function 'main': 2023-06-02T15:31:15.237 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2725:34: warning: '%d' directive writing between 1 and 11 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.237 INFO:teuthology.orchestra.run.smithi159.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-06-02T15:31:15.238 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ 2023-06-02T15:31:15.238 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2725:13: note: 'sprintf' output between 3 and 4108 bytes into a destination of size 4096 2023-06-02T15:31:15.238 INFO:teuthology.orchestra.run.smithi159.stderr: 2725 | sprintf(testdir, "%s.%d", testdir, j); 2023-06-02T15:31:15.238 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.238 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2826:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.238 INFO:teuthology.orchestra.run.smithi159.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:15.238 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-02T15:31:15.238 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2826:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-02T15:31:15.239 INFO:teuthology.orchestra.run.smithi159.stderr: 2826 | sprintf(unique_mk_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:15.239 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.239 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2827:43: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.239 INFO:teuthology.orchestra.run.smithi159.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:15.239 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-02T15:31:15.239 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2827:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-02T15:31:15.239 INFO:teuthology.orchestra.run.smithi159.stderr: 2827 | sprintf(unique_chdir_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:15.239 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.240 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2828:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.240 INFO:teuthology.orchestra.run.smithi159.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:15.240 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-02T15:31:15.240 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2828:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-02T15:31:15.240 INFO:teuthology.orchestra.run.smithi159.stderr: 2828 | sprintf(unique_stat_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:15.240 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.240 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2829:42: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.241 INFO:teuthology.orchestra.run.smithi159.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:15.241 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-02T15:31:15.241 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2829:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-02T15:31:15.241 INFO:teuthology.orchestra.run.smithi159.stderr: 2829 | sprintf(unique_read_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:15.241 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.241 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2830:40: warning: '%s' directive writing up to 4095 bytes into a region of size between 0 and 4095 [-Wformat-overflow=] 2023-06-02T15:31:15.241 INFO:teuthology.orchestra.run.smithi159.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:15.241 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~ ~~~~~~~~~~~~~~ 2023-06-02T15:31:15.242 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2830:13: note: 'sprintf' output between 4 and 8194 bytes into a destination of size 4096 2023-06-02T15:31:15.242 INFO:teuthology.orchestra.run.smithi159.stderr: 2830 | sprintf(unique_rm_dir, "%s/%s.0", testdir, base_tree_name); 2023-06-02T15:31:15.242 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.242 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2848:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.242 INFO:teuthology.orchestra.run.smithi159.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.242 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.242 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2848:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.242 INFO:teuthology.orchestra.run.smithi159.stderr: 2848 | sprintf(unique_mk_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.243 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.243 INFO:teuthology.orchestra.run.smithi159.stderr: 2849 | (rank+(0*nstride))%i); 2023-06-02T15:31:15.243 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.243 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2850:50: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.243 INFO:teuthology.orchestra.run.smithi159.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.243 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.243 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2850:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.243 INFO:teuthology.orchestra.run.smithi159.stderr: 2850 | sprintf(unique_chdir_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.244 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.244 INFO:teuthology.orchestra.run.smithi159.stderr: 2851 | (rank+(1*nstride))%i); 2023-06-02T15:31:15.244 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.244 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2852:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.244 INFO:teuthology.orchestra.run.smithi159.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.244 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.244 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2852:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.245 INFO:teuthology.orchestra.run.smithi159.stderr: 2852 | sprintf(unique_stat_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.245 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.245 INFO:teuthology.orchestra.run.smithi159.stderr: 2853 | (rank+(2*nstride))%i); 2023-06-02T15:31:15.245 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.245 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2854:49: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.245 INFO:teuthology.orchestra.run.smithi159.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.245 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.245 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2854:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.246 INFO:teuthology.orchestra.run.smithi159.stderr: 2854 | sprintf(unique_read_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.246 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.246 INFO:teuthology.orchestra.run.smithi159.stderr: 2855 | (rank+(3*nstride))%i); 2023-06-02T15:31:15.246 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.246 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2856:47: warning: '/mdtest_tree.' directive writing 13 bytes into a region of size between 1 and 4096 [-Wformat-overflow=] 2023-06-02T15:31:15.246 INFO:teuthology.orchestra.run.smithi159.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.246 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~ 2023-06-02T15:31:15.246 INFO:teuthology.orchestra.run.smithi159.stderr:mdtest.c:2856:21: note: 'sprintf' output between 17 and 4122 bytes into a destination of size 4096 2023-06-02T15:31:15.247 INFO:teuthology.orchestra.run.smithi159.stderr: 2856 | sprintf(unique_rm_dir, "%s/mdtest_tree.%d.0", testdir, 2023-06-02T15:31:15.247 INFO:teuthology.orchestra.run.smithi159.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:15.247 INFO:teuthology.orchestra.run.smithi159.stderr: 2857 | (rank+(4*nstride))%i); 2023-06-02T15:31:15.247 INFO:teuthology.orchestra.run.smithi159.stderr: | ~~~~~~~~~~~~~~~~~~~~~ 2023-06-02T15:31:16.803 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDI_OFI_do_irecv.constprop.0': 2023-06-02T15:31:16.803 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x1803): undefined reference to `fi_strerror' 2023-06-02T15:31:16.803 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x1878): undefined reference to `fi_strerror' 2023-06-02T15:31:16.803 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDIG_do_irecv.constprop.0': 2023-06-02T15:31:16.804 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x33e3): undefined reference to `fi_strerror' 2023-06-02T15:31:16.804 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x3509): undefined reference to `fi_strerror' 2023-06-02T15:31:16.804 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-06-02T15:31:16.804 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x15ed): undefined reference to `fi_strerror' 2023-06-02T15:31:16.804 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o):(.text+0x1aad): more undefined references to `fi_strerror' follow 2023-06-02T15:31:16.808 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `get_first_non_io_obj_by_pci': 2023-06-02T15:31:16.808 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x191): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:16.808 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x226): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.808 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_init': 2023-06-02T15:31:16.809 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x291): undefined reference to `hwloc_bitmap_alloc' 2023-06-02T15:31:16.809 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x2a4): undefined reference to `hwloc_topology_init' 2023-06-02T15:31:16.809 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x2b2): undefined reference to `hwloc_topology_set_io_types_filter' 2023-06-02T15:31:16.809 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x2be): undefined reference to `hwloc_topology_load' 2023-06-02T15:31:16.809 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x2ee): undefined reference to `hwloc_get_proc_cpubind' 2023-06-02T15:31:16.809 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_finalize': 2023-06-02T15:31:16.809 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x320): undefined reference to `hwloc_topology_destroy' 2023-06-02T15:31:16.809 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x32c): undefined reference to `hwloc_bitmap_free' 2023-06-02T15:31:16.810 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_leaf': 2023-06-02T15:31:16.810 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x389): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.810 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x394): undefined reference to `hwloc_bitmap_iszero' 2023-06-02T15:31:16.810 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x3ac): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:16.810 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x3d0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:16.810 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_depth': 2023-06-02T15:31:16.810 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x469): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_ancestor': 2023-06-02T15:31:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x4b2): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_type': 2023-06-02T15:31:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x60f): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x655): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x664): undefined reference to `hwloc_bitmap_isequal' 2023-06-02T15:31:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x6de): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.811 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_name.part.0': 2023-06-02T15:31:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x777): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x782): undefined reference to `hwloc_bitmap_iszero' 2023-06-02T15:31:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x799): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x7c0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x8d0): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x9e9): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xa46): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.812 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xb8f): undefined reference to `hwloc_obj_type_is_normal' 2023-06-02T15:31:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xba8): undefined reference to `hwloc_obj_type_is_normal' 2023-06-02T15:31:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xbd9): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xbf6): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xc6b): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xc87): undefined reference to `hwloc_get_nbobjs_by_depth' 2023-06-02T15:31:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xcb0): undefined reference to `hwloc_bitmap_isset' 2023-06-02T15:31:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_mem_bind': 2023-06-02T15:31:16.813 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0xf7c): undefined reference to `hwloc_topology_get_support' 2023-06-02T15:31:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xfbb): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xfc3): undefined reference to `hwloc_bitmap_alloc' 2023-06-02T15:31:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xfd8): undefined reference to `hwloc_bitmap_or' 2023-06-02T15:31:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x1016): undefined reference to `hwloc_bitmap_free' 2023-06-02T15:31:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x104d): undefined reference to `hwloc_set_area_membind' 2023-06-02T15:31:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x1058): undefined reference to `hwloc_bitmap_free' 2023-06-02T15:31:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_node_mem': 2023-06-02T15:31:16.814 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x10ed): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x1116): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_name': 2023-06-02T15:31:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x116f): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x1188): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x11a0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_pci': 2023-06-02T15:31:16.815 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x11f9): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:16.816 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x1211): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:16.817 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-06-02T15:31:16.817 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x1dad): undefined reference to `fi_strerror' 2023-06-02T15:31:16.817 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x2245): undefined reference to `fi_strerror' 2023-06-02T15:31:16.817 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_anysrc_try_cancel_partner': 2023-06-02T15:31:16.818 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x28b5): undefined reference to `fi_strerror' 2023-06-02T15:31:16.818 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_eager.constprop.0': 2023-06-02T15:31:16.818 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x33fd): undefined reference to `fi_strerror' 2023-06-02T15:31:16.818 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_pipeline.constprop.0': 2023-06-02T15:31:16.818 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x409b): undefined reference to `fi_strerror' 2023-06-02T15:31:16.818 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o):(.text+0x4be3): more undefined references to `fi_strerror' follow 2023-06-02T15:31:16.818 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_init_local': 2023-06-02T15:31:16.818 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x49b2): undefined reference to `fi_fabric' 2023-06-02T15:31:16.819 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x5215): undefined reference to `fi_strerror' 2023-06-02T15:31:16.819 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_mpi_finalize_hook': 2023-06-02T15:31:16.819 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x5ffb): undefined reference to `fi_freeinfo' 2023-06-02T15:31:16.819 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x66d0): undefined reference to `fi_strerror' 2023-06-02T15:31:16.819 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x67fd): undefined reference to `fi_strerror' 2023-06-02T15:31:16.819 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x6875): undefined reference to `fi_strerror' 2023-06-02T15:31:16.819 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x6a35): undefined reference to `fi_strerror' 2023-06-02T15:31:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x6aad): undefined reference to `fi_strerror' 2023-06-02T15:31:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o):(.text+0x6b25): more undefined references to `fi_strerror' follow 2023-06-02T15:31:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `win_init': 2023-06-02T15:31:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0xa58): undefined reference to `fi_dupinfo' 2023-06-02T15:31:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xb68): undefined reference to `fi_freeinfo' 2023-06-02T15:31:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xb80): undefined reference to `fi_dupinfo' 2023-06-02T15:31:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xcb6): undefined reference to `fi_freeinfo' 2023-06-02T15:31:16.820 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xe52): undefined reference to `fi_strerror' 2023-06-02T15:31:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xfb8): undefined reference to `fi_strerror' 2023-06-02T15:31:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x1095): undefined reference to `fi_strerror' 2023-06-02T15:31:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x1106): undefined reference to `fi_freeinfo' 2023-06-02T15:31:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x120b): undefined reference to `fi_freeinfo' 2023-06-02T15:31:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x12f3): undefined reference to `fi_strerror' 2023-06-02T15:31:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_attach_hook': 2023-06-02T15:31:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x1cdd): undefined reference to `fi_strerror' 2023-06-02T15:31:16.821 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_free_hook': 2023-06-02T15:31:16.822 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x2595): undefined reference to `fi_strerror' 2023-06-02T15:31:16.822 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x260d): undefined reference to `fi_strerror' 2023-06-02T15:31:16.822 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x2685): undefined reference to `fi_strerror' 2023-06-02T15:31:16.822 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_events.o):(.text+0x1bf1): more undefined references to `fi_strerror' follow 2023-06-02T15:31:16.824 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_nic.o): in function `MPIDI_OFI_init_multi_nic': 2023-06-02T15:31:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x44a): undefined reference to `fi_dupinfo' 2023-06-02T15:31:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x491): undefined reference to `fi_freeinfo' 2023-06-02T15:31:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x4fc): undefined reference to `fi_dupinfo' 2023-06-02T15:31:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `find_provider': 2023-06-02T15:31:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x94): undefined reference to `fi_dupinfo' 2023-06-02T15:31:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0xb8): undefined reference to `fi_getinfo' 2023-06-02T15:31:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x278): undefined reference to `fi_getinfo' 2023-06-02T15:31:16.825 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x296): undefined reference to `fi_freeinfo' 2023-06-02T15:31:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x30d): undefined reference to `fi_freeinfo' 2023-06-02T15:31:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x341): undefined reference to `fi_version' 2023-06-02T15:31:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x355): undefined reference to `fi_strerror' 2023-06-02T15:31:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x415): undefined reference to `fi_getinfo' 2023-06-02T15:31:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x444): undefined reference to `fi_getinfo' 2023-06-02T15:31:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x451): undefined reference to `fi_version' 2023-06-02T15:31:16.826 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x461): undefined reference to `fi_version' 2023-06-02T15:31:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x480): undefined reference to `fi_dupinfo' 2023-06-02T15:31:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x4c9): undefined reference to `fi_version' 2023-06-02T15:31:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_find_provider_cleanup': 2023-06-02T15:31:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x781): undefined reference to `fi_freeinfo' 2023-06-02T15:31:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_get_required_version': 2023-06-02T15:31:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x841): undefined reference to `fi_version' 2023-06-02T15:31:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_root_ctx': 2023-06-02T15:31:16.827 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0x31c): undefined reference to `fi_strerror' 2023-06-02T15:31:16.828 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x3b5): undefined reference to `fi_strerror' 2023-06-02T15:31:16.828 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x45d): undefined reference to `fi_strerror' 2023-06-02T15:31:16.828 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: (.text+0x555): undefined reference to `fi_strerror' 2023-06-02T15:31:16.828 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_all_ctx': 2023-06-02T15:31:16.828 INFO:teuthology.orchestra.run.smithi150.stderr:(.text+0xb35): undefined reference to `fi_strerror' 2023-06-02T15:31:16.828 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o):(.text+0xdf6): more undefined references to `fi_strerror' follow 2023-06-02T15:31:16.926 INFO:teuthology.orchestra.run.smithi150.stderr:collect2: error: ld returned 1 exit status 2023-06-02T15:31:16.927 INFO:teuthology.orchestra.run.smithi150.stderr:make: *** [Makefile:59: mdtest] Error 1 2023-06-02T15:31:16.927 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-06-02T15:31:16.928 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/task/pexec.py", line 149, in task p.spawn(_exec_host, barrier, barrier_queue, remote[0], sudo, testdir, remote[1]) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/task/pexec.py", line 60, in _exec_host tor.wait([r]) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi150 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-06-02T15:31:16.991 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=08d3f33250bd43efb2d97b32984398d9 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/run_tasks.py", line 84, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/task/pexec.py", line 149, in task p.spawn(_exec_host, barrier, barrier_queue, remote[0], sudo, testdir, remote[1]) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/task/pexec.py", line 60, in _exec_host tor.wait([r]) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi150 with status 2: 'TESTDIR=/home/ubuntu/cephtest bash -s' 2023-06-02T15:31:16.994 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-06-02T15:31:17.009 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-06-02T15:31:17.010 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:31:17.010 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-02T15:31:17.023 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:31:17.024 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-02T15:31:17.071 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:31:17.167 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDI_OFI_do_irecv.constprop.0': 2023-06-02T15:31:17.168 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x1803): undefined reference to `fi_strerror' 2023-06-02T15:31:17.168 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x1878): undefined reference to `fi_strerror' 2023-06-02T15:31:17.168 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-recv.o): in function `MPIDIG_do_irecv.constprop.0': 2023-06-02T15:31:17.168 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x33e3): undefined reference to `fi_strerror' 2023-06-02T15:31:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x3509): undefined reference to `fi_strerror' 2023-06-02T15:31:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-06-02T15:31:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x15ed): undefined reference to `fi_strerror' 2023-06-02T15:31:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-send.o):(.text+0x1aad): more undefined references to `fi_strerror' follow 2023-06-02T15:31:17.173 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `get_first_non_io_obj_by_pci': 2023-06-02T15:31:17.173 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x191): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:17.173 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x226): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.173 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_init': 2023-06-02T15:31:17.174 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x291): undefined reference to `hwloc_bitmap_alloc' 2023-06-02T15:31:17.174 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x2a4): undefined reference to `hwloc_topology_init' 2023-06-02T15:31:17.174 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x2b2): undefined reference to `hwloc_topology_set_io_types_filter' 2023-06-02T15:31:17.174 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x2be): undefined reference to `hwloc_topology_load' 2023-06-02T15:31:17.175 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x2ee): undefined reference to `hwloc_get_proc_cpubind' 2023-06-02T15:31:17.175 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPII_hwtopo_finalize': 2023-06-02T15:31:17.176 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x320): undefined reference to `hwloc_topology_destroy' 2023-06-02T15:31:17.176 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x32c): undefined reference to `hwloc_bitmap_free' 2023-06-02T15:31:17.177 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_leaf': 2023-06-02T15:31:17.177 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x389): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.177 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x394): undefined reference to `hwloc_bitmap_iszero' 2023-06-02T15:31:17.178 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x3ac): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:17.178 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x3d0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:17.178 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_depth': 2023-06-02T15:31:17.179 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x469): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.179 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_ancestor': 2023-06-02T15:31:17.180 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x4b2): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.180 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_type': 2023-06-02T15:31:17.181 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x60f): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:17.181 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x655): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:17.181 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x664): undefined reference to `hwloc_bitmap_isequal' 2023-06-02T15:31:17.181 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x6de): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.182 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_obj_by_name.part.0': 2023-06-02T15:31:17.182 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x777): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.182 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x782): undefined reference to `hwloc_bitmap_iszero' 2023-06-02T15:31:17.183 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x799): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:17.183 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x7c0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:17.183 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x8d0): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:17.183 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x9e9): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:17.184 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xa46): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.184 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xb8f): undefined reference to `hwloc_obj_type_is_normal' 2023-06-02T15:31:17.184 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xba8): undefined reference to `hwloc_obj_type_is_normal' 2023-06-02T15:31:17.184 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xbd9): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:17.184 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xbf6): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.185 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xc6b): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:17.185 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xc87): undefined reference to `hwloc_get_nbobjs_by_depth' 2023-06-02T15:31:17.185 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xcb0): undefined reference to `hwloc_bitmap_isset' 2023-06-02T15:31:17.185 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_mem_bind': 2023-06-02T15:31:17.185 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0xf7c): undefined reference to `hwloc_topology_get_support' 2023-06-02T15:31:17.186 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xfbb): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.186 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xfc3): undefined reference to `hwloc_bitmap_alloc' 2023-06-02T15:31:17.186 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xfd8): undefined reference to `hwloc_bitmap_or' 2023-06-02T15:31:17.186 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x1016): undefined reference to `hwloc_bitmap_free' 2023-06-02T15:31:17.186 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x104d): undefined reference to `hwloc_set_area_membind' 2023-06-02T15:31:17.187 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x1058): undefined reference to `hwloc_bitmap_free' 2023-06-02T15:31:17.187 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_get_node_mem': 2023-06-02T15:31:17.187 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x10ed): undefined reference to `hwloc_get_type_depth' 2023-06-02T15:31:17.188 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x1116): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.188 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_name': 2023-06-02T15:31:17.189 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x116f): undefined reference to `hwloc_get_obj_by_depth' 2023-06-02T15:31:17.189 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x1188): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:17.189 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x11a0): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:17.190 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpir_hwtopo.o): in function `MPIR_hwtopo_is_dev_close_by_pci': 2023-06-02T15:31:17.190 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x11f9): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:17.191 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x1211): undefined reference to `hwloc_bitmap_isincluded' 2023-06-02T15:31:17.191 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_rdma_read.constprop.0': 2023-06-02T15:31:17.192 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x1dad): undefined reference to `fi_strerror' 2023-06-02T15:31:17.192 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x2245): undefined reference to `fi_strerror' 2023-06-02T15:31:17.192 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_anysrc_try_cancel_partner': 2023-06-02T15:31:17.193 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x28b5): undefined reference to `fi_strerror' 2023-06-02T15:31:17.193 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_eager.constprop.0': 2023-06-02T15:31:17.193 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x33fd): undefined reference to `fi_strerror' 2023-06-02T15:31:17.193 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o): in function `MPIDI_OFI_do_am_isend_pipeline.constprop.0': 2023-06-02T15:31:17.194 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x409b): undefined reference to `fi_strerror' 2023-06-02T15:31:17.194 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-mpidig_pt2pt_callbacks.o):(.text+0x4be3): more undefined references to `fi_strerror' follow 2023-06-02T15:31:17.196 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_init_local': 2023-06-02T15:31:17.196 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x49b2): undefined reference to `fi_fabric' 2023-06-02T15:31:17.196 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x5215): undefined reference to `fi_strerror' 2023-06-02T15:31:17.197 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o): in function `MPIDI_OFI_mpi_finalize_hook': 2023-06-02T15:31:17.197 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x5ffb): undefined reference to `fi_freeinfo' 2023-06-02T15:31:17.197 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x66d0): undefined reference to `fi_strerror' 2023-06-02T15:31:17.197 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x67fd): undefined reference to `fi_strerror' 2023-06-02T15:31:17.197 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x6875): undefined reference to `fi_strerror' 2023-06-02T15:31:17.198 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x6a35): undefined reference to `fi_strerror' 2023-06-02T15:31:17.198 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x6aad): undefined reference to `fi_strerror' 2023-06-02T15:31:17.198 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_init.o):(.text+0x6b25): more undefined references to `fi_strerror' follow 2023-06-02T15:31:17.198 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `win_init': 2023-06-02T15:31:17.198 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0xa58): undefined reference to `fi_dupinfo' 2023-06-02T15:31:17.199 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xb68): undefined reference to `fi_freeinfo' 2023-06-02T15:31:17.199 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xb80): undefined reference to `fi_dupinfo' 2023-06-02T15:31:17.199 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xcb6): undefined reference to `fi_freeinfo' 2023-06-02T15:31:17.199 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xe52): undefined reference to `fi_strerror' 2023-06-02T15:31:17.199 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xfb8): undefined reference to `fi_strerror' 2023-06-02T15:31:17.200 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x1095): undefined reference to `fi_strerror' 2023-06-02T15:31:17.200 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x1106): undefined reference to `fi_freeinfo' 2023-06-02T15:31:17.200 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x120b): undefined reference to `fi_freeinfo' 2023-06-02T15:31:17.200 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x12f3): undefined reference to `fi_strerror' 2023-06-02T15:31:17.200 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_attach_hook': 2023-06-02T15:31:17.201 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x1cdd): undefined reference to `fi_strerror' 2023-06-02T15:31:17.201 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_win.o): in function `MPIDI_OFI_mpi_win_free_hook': 2023-06-02T15:31:17.201 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x2595): undefined reference to `fi_strerror' 2023-06-02T15:31:17.201 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x260d): undefined reference to `fi_strerror' 2023-06-02T15:31:17.201 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x2685): undefined reference to `fi_strerror' 2023-06-02T15:31:17.202 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_events.o):(.text+0x1bf1): more undefined references to `fi_strerror' follow 2023-06-02T15:31:17.202 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-ofi_nic.o): in function `MPIDI_OFI_init_multi_nic': 2023-06-02T15:31:17.202 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x44a): undefined reference to `fi_dupinfo' 2023-06-02T15:31:17.202 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x491): undefined reference to `fi_freeinfo' 2023-06-02T15:31:17.202 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x4fc): undefined reference to `fi_dupinfo' 2023-06-02T15:31:17.203 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `find_provider': 2023-06-02T15:31:17.203 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x94): undefined reference to `fi_dupinfo' 2023-06-02T15:31:17.203 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0xb8): undefined reference to `fi_getinfo' 2023-06-02T15:31:17.203 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x278): undefined reference to `fi_getinfo' 2023-06-02T15:31:17.203 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x296): undefined reference to `fi_freeinfo' 2023-06-02T15:31:17.204 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x30d): undefined reference to `fi_freeinfo' 2023-06-02T15:31:17.204 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x341): undefined reference to `fi_version' 2023-06-02T15:31:17.204 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x355): undefined reference to `fi_strerror' 2023-06-02T15:31:17.204 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x415): undefined reference to `fi_getinfo' 2023-06-02T15:31:17.204 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x444): undefined reference to `fi_getinfo' 2023-06-02T15:31:17.205 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x451): undefined reference to `fi_version' 2023-06-02T15:31:17.205 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x461): undefined reference to `fi_version' 2023-06-02T15:31:17.205 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x480): undefined reference to `fi_dupinfo' 2023-06-02T15:31:17.205 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x4c9): undefined reference to `fi_version' 2023-06-02T15:31:17.205 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_find_provider_cleanup': 2023-06-02T15:31:17.205 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x781): undefined reference to `fi_freeinfo' 2023-06-02T15:31:17.206 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_provider.o): in function `MPIDI_OFI_get_required_version': 2023-06-02T15:31:17.206 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x841): undefined reference to `fi_version' 2023-06-02T15:31:17.206 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_root_ctx': 2023-06-02T15:31:17.206 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0x31c): undefined reference to `fi_strerror' 2023-06-02T15:31:17.206 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x3b5): undefined reference to `fi_strerror' 2023-06-02T15:31:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x45d): undefined reference to `fi_strerror' 2023-06-02T15:31:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: (.text+0x555): undefined reference to `fi_strerror' 2023-06-02T15:31:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o): in function `MPIDI_OFI_addr_exchange_all_ctx': 2023-06-02T15:31:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:(.text+0xb35): undefined reference to `fi_strerror' 2023-06-02T15:31:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:/usr/bin/ld: /usr/lib/x86_64-linux-gnu/libmpich.a(lib_libmpich_la-init_addrxchg.o):(.text+0xdf6): more undefined references to `fi_strerror' follow 2023-06-02T15:31:17.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba9a63640 1 Processor -- start 2023-06-02T15:31:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba9a63640 1 -- start start 2023-06-02T15:31:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba9a63640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ba40b8f50 0x7f3ba414ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba9a63640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b75a0 0x7f3ba414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba9a63640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ba414c580 con 0x7f3ba4149720 2023-06-02T15:31:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba9a63640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ba406f100 con 0x7f3ba40b8f50 2023-06-02T15:31:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba9a63640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4071fa0 con 0x7f3ba40b75a0 2023-06-02T15:31:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba2ffd640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b75a0 0x7f3ba414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ba40b8f50 0x7f3ba414ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3ba4149720 0x7f3ba4149b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.78:36746/0 (socket says 172.21.15.78:36746) 2023-06-02T15:31:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba3fff640 1 -- 172.21.15.78:0/589111959 learned_addr learned my addr 172.21.15.78:0/589111959 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba27fc640 1 -- 172.21.15.78:0/589111959 <== mon.1 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568133331 0 0) 0x7f3ba414c580 con 0x7f3ba4149720 2023-06-02T15:31:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba27fc640 1 -- 172.21.15.78:0/589111959 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b8c003530 con 0x7f3ba4149720 2023-06-02T15:31:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba37fe640 1 -- 172.21.15.78:0/589111959 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b75a0 msgr2=0x7f3ba414cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:17.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba37fe640 1 --2- 172.21.15.78:0/589111959 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b75a0 0x7f3ba414cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba37fe640 1 -- 172.21.15.78:0/589111959 >> v1:172.21.15.132:6789/0 conn(0x7f3ba4149720 legacy=0x7f3ba4149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba37fe640 1 -- 172.21.15.78:0/589111959 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba40a8340 con 0x7f3ba40b8f50 2023-06-02T15:31:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.194+0000 7f3ba2ffd640 1 --2- 172.21.15.78:0/589111959 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b75a0 0x7f3ba414cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:31:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba37fe640 1 --2- 172.21.15.78:0/589111959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ba40b8f50 0x7f3ba414ca10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b940097c0 tx=0x7f3b9401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2c2284fe6c3099e server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba27fc640 1 -- 172.21.15.78:0/589111959 <== mon.1 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b940ab650 con 0x7f3ba40b8f50 2023-06-02T15:31:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba27fc640 1 -- 172.21.15.78:0/589111959 <== mon.1 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b940ab7b0 con 0x7f3ba40b8f50 2023-06-02T15:31:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba27fc640 1 -- 172.21.15.78:0/589111959 <== mon.1 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b940abb40 con 0x7f3ba40b8f50 2023-06-02T15:31:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba9a63640 1 -- 172.21.15.78:0/589111959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ba40b8f50 msgr2=0x7f3ba414ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba9a63640 1 --2- 172.21.15.78:0/589111959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ba40b8f50 0x7f3ba414ca10 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b940097c0 tx=0x7f3b9401c450 comp rx=0 tx=0).stop 2023-06-02T15:31:17.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba9a63640 1 -- 172.21.15.78:0/589111959 shutdown_connections 2023-06-02T15:31:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba9a63640 1 --2- 172.21.15.78:0/589111959 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b75a0 0x7f3ba414cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba9a63640 1 --2- 172.21.15.78:0/589111959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ba40b8f50 0x7f3ba414ca10 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba9a63640 1 -- 172.21.15.78:0/589111959 >> 172.21.15.78:0/589111959 conn(0x7f3ba40c26c0 msgr2=0x7f3ba40c2ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:17.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba9a63640 1 -- 172.21.15.78:0/589111959 shutdown_connections 2023-06-02T15:31:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba9a63640 1 -- 172.21.15.78:0/589111959 wait complete. 2023-06-02T15:31:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba9a63640 1 Processor -- start 2023-06-02T15:31:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.198+0000 7f3ba9a63640 1 -- start start 2023-06-02T15:31:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba9a63640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ba40b75a0 0x7f3ba413dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba9a63640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b8f50 0x7f3ba413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba9a63640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ba4149720 0x7f3ba413be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba9a63640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba4141ca0 con 0x7f3ba4149720 2023-06-02T15:31:17.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba9a63640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba41e7860 con 0x7f3ba40b75a0 2023-06-02T15:31:17.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba9a63640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba413e4f0 con 0x7f3ba40b8f50 2023-06-02T15:31:17.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ba4149720 0x7f3ba413be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ba4149720 0x7f3ba413be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39150/0 (socket says 172.21.15.78:39150) 2023-06-02T15:31:17.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba3fff640 1 -- 172.21.15.78:0/3841191773 learned_addr learned my addr 172.21.15.78:0/3841191773 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:17.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba2ffd640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b8f50 0x7f3ba413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba37fe640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ba40b75a0 0x7f3ba413dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba3fff640 1 -- 172.21.15.78:0/3841191773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b8f50 msgr2=0x7f3ba413b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba3fff640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b8f50 0x7f3ba413b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba3fff640 1 -- 172.21.15.78:0/3841191773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ba40b75a0 msgr2=0x7f3ba413dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba3fff640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ba40b75a0 0x7f3ba413dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba3fff640 1 -- 172.21.15.78:0/3841191773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b98009420 con 0x7f3ba4149720 2023-06-02T15:31:17.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba3fff640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ba4149720 0x7f3ba413be30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00cad0 tx=0x7f3b9c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:17.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3b8bfff640 1 -- 172.21.15.78:0/3841191773 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00abd0 con 0x7f3ba4149720 2023-06-02T15:31:17.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3b8bfff640 1 -- 172.21.15.78:0/3841191773 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9c00ad30 con 0x7f3ba4149720 2023-06-02T15:31:17.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba9a63640 1 -- 172.21.15.78:0/3841191773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b94009420 con 0x7f3ba4149720 2023-06-02T15:31:17.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3b8bfff640 1 -- 172.21.15.78:0/3841191773 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b9c00aea0 con 0x7f3ba4149720 2023-06-02T15:31:17.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba9a63640 1 -- 172.21.15.78:0/3841191773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ba40beca0 con 0x7f3ba4149720 2023-06-02T15:31:17.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba9a63640 1 -- 172.21.15.78:0/3841191773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ba40a5040 con 0x7f3ba4149720 2023-06-02T15:31:17.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3b8bfff640 1 -- 172.21.15.78:0/3841191773 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f3b9c007070 con 0x7f3ba4149720 2023-06-02T15:31:17.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3b8bfff640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b90065c00 0x7f3b900680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3ba37fe640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b90065c00 0x7f3b900680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.202+0000 7f3b8bfff640 1 -- 172.21.15.78:0/3841191773 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b9c083520 con 0x7f3ba4149720 2023-06-02T15:31:17.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.206+0000 7f3ba37fe640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b90065c00 0x7f3b900680b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3b940af000 tx=0x7f3b940a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:17.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.206+0000 7f3b8bfff640 1 -- 172.21.15.78:0/3841191773 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f3b9c054520 con 0x7f3ba4149720 2023-06-02T15:31:17.292 INFO:teuthology.orchestra.run.smithi159.stderr:collect2: error: ld returned 1 exit status 2023-06-02T15:31:17.293 INFO:teuthology.orchestra.run.smithi159.stderr:make: *** [Makefile:59: mdtest] Error 1 2023-06-02T15:31:17.294 DEBUG:teuthology.orchestra.run:got remote process result: 2 2023-06-02T15:31:17.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.358+0000 7f3ba9a63640 1 -- 172.21.15.78:0/3841191773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ba4071950 con 0x7f3ba4149720 2023-06-02T15:31:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.358+0000 7f3b8bfff640 1 -- 172.21.15.78:0/3841191773 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f3b9c0540b0 con 0x7f3ba4149720 2023-06-02T15:31:17.368 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:17.368 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:31:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 -- 172.21.15.78:0/3841191773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b90065c00 msgr2=0x7f3b900680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b90065c00 0x7f3b900680b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f3b940af000 tx=0x7f3b940a7000 comp rx=0 tx=0).stop 2023-06-02T15:31:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 -- 172.21.15.78:0/3841191773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ba4149720 msgr2=0x7f3ba413be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ba4149720 0x7f3ba413be30 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c00cad0 tx=0x7f3b9c00cf90 comp rx=0 tx=0).stop 2023-06-02T15:31:17.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 -- 172.21.15.78:0/3841191773 shutdown_connections 2023-06-02T15:31:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b90065c00 0x7f3b900680b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ba4149720 0x7f3ba413be30 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ba40b8f50 0x7f3ba413b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 --2- 172.21.15.78:0/3841191773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ba40b75a0 0x7f3ba413dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 -- 172.21.15.78:0/3841191773 >> 172.21.15.78:0/3841191773 conn(0x7f3ba40c26c0 msgr2=0x7f3ba40bee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 -- 172.21.15.78:0/3841191773 shutdown_connections 2023-06-02T15:31:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.362+0000 7f3ba9a63640 1 -- 172.21.15.78:0/3841191773 wait complete. 2023-06-02T15:31:17.385 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-02T15:30:31.844882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-02T15:30:33.293644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-02T15:30:36.277798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-02T15:30:37.599884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-02T15:30:40.680165+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-02T15:31:17.386 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-02T15:31:17.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.490+0000 7f4a5c256640 1 Processor -- start 2023-06-02T15:31:17.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.490+0000 7f4a5c256640 1 -- start start 2023-06-02T15:31:17.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a5c256640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4a5414bc10 0x7f4a540c26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a5c256640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5414bfe0 con 0x7f4a540c2c20 2023-06-02T15:31:17.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a5c256640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a5406e820 con 0x7f4a5406f0e0 2023-06-02T15:31:17.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a5c256640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a54071a10 con 0x7f4a5414bc10 2023-06-02T15:31:17.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a59ff2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4a5414bc10 0x7f4a540c26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a597f1640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4a540c2c20 0x7f4a540a6ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57000/0 (socket says 172.21.15.78:57000) 2023-06-02T15:31:17.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a597f1640 1 -- 172.21.15.78:0/3749656893 learned_addr learned my addr 172.21.15.78:0/3749656893 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:17.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a59ff2640 1 -- 172.21.15.78:0/3749656893 >> v1:172.21.15.132:6789/0 conn(0x7f4a5406f0e0 legacy=0x7f4a54158ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:17.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a59ff2640 1 -- 172.21.15.78:0/3749656893 >> v1:172.21.15.78:6789/0 conn(0x7f4a540c2c20 legacy=0x7f4a540a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a59ff2640 1 -- 172.21.15.78:0/3749656893 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5406e640 con 0x7f4a5414bc10 2023-06-02T15:31:17.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a58ff0640 1 -- 172.21.15.78:0/3749656893 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2645957753 0 0) 0x7f4a480014a0 con 0x7f4a540c2c20 2023-06-02T15:31:17.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a59ff2640 1 --2- 172.21.15.78:0/3749656893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a5414bc10 0x7f4a540c26e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0097c0 tx=0x7f4a4c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c674582fe6c569ee server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:17.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a58ff0640 1 -- 172.21.15.78:0/3749656893 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0ab600 con 0x7f4a5414bc10 2023-06-02T15:31:17.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a58ff0640 1 -- 172.21.15.78:0/3749656893 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4c0a7050 con 0x7f4a5414bc10 2023-06-02T15:31:17.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a58ff0640 1 -- 172.21.15.78:0/3749656893 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4c0ab980 con 0x7f4a5414bc10 2023-06-02T15:31:17.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a5c256640 1 -- 172.21.15.78:0/3749656893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a5414bc10 msgr2=0x7f4a540c26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a5c256640 1 --2- 172.21.15.78:0/3749656893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a5414bc10 0x7f4a540c26e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0097c0 tx=0x7f4a4c01c440 comp rx=0 tx=0).stop 2023-06-02T15:31:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a5c256640 1 -- 172.21.15.78:0/3749656893 shutdown_connections 2023-06-02T15:31:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a5c256640 1 --2- 172.21.15.78:0/3749656893 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a5414bc10 0x7f4a540c26e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a5c256640 1 -- 172.21.15.78:0/3749656893 >> 172.21.15.78:0/3749656893 conn(0x7f4a540a5730 msgr2=0x7f4a540a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.494+0000 7f4a5c256640 1 -- 172.21.15.78:0/3749656893 shutdown_connections 2023-06-02T15:31:17.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 -- 172.21.15.78:0/3749656893 wait complete. 2023-06-02T15:31:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 Processor -- start 2023-06-02T15:31:17.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 -- start start 2023-06-02T15:31:17.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a5406f0e0 0x7f4a540c1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a540c2c20 0x7f4a541ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a5414bc10 0x7f4a541eaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54145060 con 0x7f4a540c2c20 2023-06-02T15:31:17.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a5414c4b0 con 0x7f4a5414bc10 2023-06-02T15:31:17.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a541377d0 con 0x7f4a5406f0e0 2023-06-02T15:31:17.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a597f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a540c2c20 0x7f4a541ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a597f1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a540c2c20 0x7f4a541ea4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39166/0 (socket says 172.21.15.78:39166) 2023-06-02T15:31:17.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a597f1640 1 -- 172.21.15.78:0/1050712786 learned_addr learned my addr 172.21.15.78:0/1050712786 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:17.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a59ff2640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a5406f0e0 0x7f4a540c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5a7f3640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a5414bc10 0x7f4a541eaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a597f1640 1 -- 172.21.15.78:0/1050712786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a5406f0e0 msgr2=0x7f4a540c1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a597f1640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a5406f0e0 0x7f4a540c1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a597f1640 1 -- 172.21.15.78:0/1050712786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a5414bc10 msgr2=0x7f4a541eaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a597f1640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a5414bc10 0x7f4a541eaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a597f1640 1 -- 172.21.15.78:0/1050712786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a4c009420 con 0x7f4a540c2c20 2023-06-02T15:31:17.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a59ff2640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a5406f0e0 0x7f4a540c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:17.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5a7f3640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a5414bc10 0x7f4a541eaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:17.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a597f1640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a540c2c20 0x7f4a541ea4c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c8f0 tx=0x7f4a4800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:17.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a527fc640 1 -- 172.21.15.78:0/1050712786 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800a5e0 con 0x7f4a540c2c20 2023-06-02T15:31:17.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a527fc640 1 -- 172.21.15.78:0/1050712786 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a4800a760 con 0x7f4a540c2c20 2023-06-02T15:31:17.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 -- 172.21.15.78:0/1050712786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a5406ee20 con 0x7f4a540c2c20 2023-06-02T15:31:17.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a527fc640 1 -- 172.21.15.78:0/1050712786 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a4800ab10 con 0x7f4a540c2c20 2023-06-02T15:31:17.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 -- 172.21.15.78:0/1050712786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a540a7a20 con 0x7f4a540c2c20 2023-06-02T15:31:17.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a5c256640 1 -- 172.21.15.78:0/1050712786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5406ea70 con 0x7f4a540c2c20 2023-06-02T15:31:17.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.498+0000 7f4a527fc640 1 -- 172.21.15.78:0/1050712786 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f4a4800ac70 con 0x7f4a540c2c20 2023-06-02T15:31:17.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.502+0000 7f4a527fc640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4a40065c00 0x7f4a400680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.502+0000 7f4a527fc640 1 -- 172.21.15.78:0/1050712786 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4a48082dc0 con 0x7f4a540c2c20 2023-06-02T15:31:17.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.502+0000 7f4a59ff2640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4a40065c00 0x7f4a400680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.502+0000 7f4a59ff2640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4a40065c00 0x7f4a400680b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0ad000 tx=0x7f4a4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:17.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.506+0000 7f4a527fc640 1 -- 172.21.15.78:0/1050712786 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f4a480502a0 con 0x7f4a540c2c20 2023-06-02T15:31:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.658+0000 7f4a5c256640 1 -- 172.21.15.78:0/1050712786 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f4a5414bfe0 con 0x7f4a540c2c20 2023-06-02T15:31:17.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.658+0000 7f4a527fc640 1 -- 172.21.15.78:0/1050712786 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f4a5414bfe0 con 0x7f4a540c2c20 2023-06-02T15:31:17.668 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-02T15:31:17.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 -- 172.21.15.78:0/1050712786 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4a40065c00 msgr2=0x7f4a400680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4a40065c00 0x7f4a400680b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c0ad000 tx=0x7f4a4c008040 comp rx=0 tx=0).stop 2023-06-02T15:31:17.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 -- 172.21.15.78:0/1050712786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a540c2c20 msgr2=0x7f4a541ea4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a540c2c20 0x7f4a541ea4c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4a4800c8f0 tx=0x7f4a4800cdb0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 -- 172.21.15.78:0/1050712786 shutdown_connections 2023-06-02T15:31:17.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a5414bc10 0x7f4a541eaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4a40065c00 0x7f4a400680b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4a540c2c20 0x7f4a541ea4c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 --2- 172.21.15.78:0/1050712786 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4a5406f0e0 0x7f4a540c1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 -- 172.21.15.78:0/1050712786 >> 172.21.15.78:0/1050712786 conn(0x7f4a540a5730 msgr2=0x7f4a540bba20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:17.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 -- 172.21.15.78:0/1050712786 shutdown_connections 2023-06-02T15:31:17.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.662+0000 7f4a5c256640 1 -- 172.21.15.78:0/1050712786 wait complete. 2023-06-02T15:31:17.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-02T15:31:17.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff9d8aa640 1 Processor -- start 2023-06-02T15:31:17.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff9d8aa640 1 -- start start 2023-06-02T15:31:17.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff9d8aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff981481b0 0x7eff9814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff9d8aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9806bf70 con 0x7eff980ba640 2023-06-02T15:31:17.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff9d8aa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff980bcc80 con 0x7eff980bc8b0 2023-06-02T15:31:17.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff9d8aa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff980a4b60 con 0x7eff981481b0 2023-06-02T15:31:17.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff96ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff981481b0 0x7eff9814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff8ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7eff980ba640 0x7eff980bc1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57008/0 (socket says 172.21.15.78:57008) 2023-06-02T15:31:17.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff96ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff981481b0 0x7eff9814dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39168/0 (socket says 172.21.15.78:39168) 2023-06-02T15:31:17.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff8ffff640 1 -- 172.21.15.78:0/77982680 learned_addr learned my addr 172.21.15.78:0/77982680 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:17.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff96ffd640 1 -- 172.21.15.78:0/77982680 >> v1:172.21.15.132:6789/0 conn(0x7eff980bc8b0 legacy=0x7eff98155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:17.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff96ffd640 1 -- 172.21.15.78:0/77982680 >> v1:172.21.15.78:6789/0 conn(0x7eff980ba640 legacy=0x7eff980bc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff96ffd640 1 -- 172.21.15.78:0/77982680 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff980a41a0 con 0x7eff981481b0 2023-06-02T15:31:17.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.814+0000 7eff967fc640 1 -- 172.21.15.78:0/77982680 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2759773292 0 0) 0x7eff9806bf70 con 0x7eff980ba640 2023-06-02T15:31:17.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff96ffd640 1 --2- 172.21.15.78:0/77982680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981481b0 0x7eff9814dfd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff8800a960 tx=0x7eff8801d7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f6c3ba957fca39 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:17.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff967fc640 1 -- 172.21.15.78:0/77982680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff880a6810 con 0x7eff981481b0 2023-06-02T15:31:17.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff967fc640 1 -- 172.21.15.78:0/77982680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff880a6970 con 0x7eff981481b0 2023-06-02T15:31:17.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff967fc640 1 -- 172.21.15.78:0/77982680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff880a6d00 con 0x7eff981481b0 2023-06-02T15:31:17.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 -- 172.21.15.78:0/77982680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981481b0 msgr2=0x7eff9814dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 --2- 172.21.15.78:0/77982680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981481b0 0x7eff9814dfd0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7eff8800a960 tx=0x7eff8801d7e0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 -- 172.21.15.78:0/77982680 shutdown_connections 2023-06-02T15:31:17.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 --2- 172.21.15.78:0/77982680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff981481b0 0x7eff9814dfd0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 -- 172.21.15.78:0/77982680 >> 172.21.15.78:0/77982680 conn(0x7eff980a2170 msgr2=0x7eff980a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:17.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 -- 172.21.15.78:0/77982680 shutdown_connections 2023-06-02T15:31:17.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 -- 172.21.15.78:0/77982680 wait complete. 2023-06-02T15:31:17.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 Processor -- start 2023-06-02T15:31:17.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 -- start start 2023-06-02T15:31:17.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff980ba640 0x7eff9813daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff980bc8b0 0x7eff980b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff981481b0 0x7eff981441b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9813dfe0 con 0x7eff980bc8b0 2023-06-02T15:31:17.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff981e9b40 con 0x7eff980ba640 2023-06-02T15:31:17.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff981eaa10 con 0x7eff981481b0 2023-06-02T15:31:17.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff980bc8b0 0x7eff980b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff8ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff980bc8b0 0x7eff980b97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39172/0 (socket says 172.21.15.78:39172) 2023-06-02T15:31:17.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff8ffff640 1 -- 172.21.15.78:0/625834400 learned_addr learned my addr 172.21.15.78:0/625834400 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:17.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff8ffff640 1 -- 172.21.15.78:0/625834400 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff981481b0 msgr2=0x7eff981441b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff8ffff640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff981481b0 0x7eff981441b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff8ffff640 1 -- 172.21.15.78:0/625834400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff980ba640 msgr2=0x7eff9813daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff8ffff640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff980ba640 0x7eff9813daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff8ffff640 1 -- 172.21.15.78:0/625834400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8800a5c0 con 0x7eff980bc8b0 2023-06-02T15:31:17.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff8ffff640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff980bc8b0 0x7eff980b97f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7eff8000c450 tx=0x7eff8000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:17.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff94ff9640 1 -- 172.21.15.78:0/625834400 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff800074e0 con 0x7eff980bc8b0 2023-06-02T15:31:17.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff94ff9640 1 -- 172.21.15.78:0/625834400 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff80007640 con 0x7eff980bc8b0 2023-06-02T15:31:17.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff94ff9640 1 -- 172.21.15.78:0/625834400 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff800049f0 con 0x7eff980bc8b0 2023-06-02T15:31:17.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.818+0000 7eff9d8aa640 1 -- 172.21.15.78:0/625834400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9806cca0 con 0x7eff980bc8b0 2023-06-02T15:31:17.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.822+0000 7eff9d8aa640 1 -- 172.21.15.78:0/625834400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9806c780 con 0x7eff980bc8b0 2023-06-02T15:31:17.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.822+0000 7eff9d8aa640 1 -- 172.21.15.78:0/625834400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9814e920 con 0x7eff980bc8b0 2023-06-02T15:31:17.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.822+0000 7eff94ff9640 1 -- 172.21.15.78:0/625834400 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7eff80004b50 con 0x7eff980bc8b0 2023-06-02T15:31:17.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.822+0000 7eff94ff9640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff78065c30 0x7eff780680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:17.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.822+0000 7eff96ffd640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff78065c30 0x7eff780680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:17.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.822+0000 7eff94ff9640 1 -- 172.21.15.78:0/625834400 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7eff800827c0 con 0x7eff980bc8b0 2023-06-02T15:31:17.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.822+0000 7eff96ffd640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff78065c30 0x7eff780680e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff880b0000 tx=0x7eff88004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:17.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.826+0000 7eff94ff9640 1 -- 172.21.15.78:0/625834400 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7eff8004fca0 con 0x7eff980bc8b0 2023-06-02T15:31:17.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 -- 172.21.15.78:0/625834400 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7eff98073bc0 con 0x7eff980bc8b0 2023-06-02T15:31:17.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff94ff9640 1 -- 172.21.15.78:0/625834400 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7eff800532c0 con 0x7eff980bc8b0 2023-06-02T15:31:17.986 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-02T15:31:17.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 -- 172.21.15.78:0/625834400 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff78065c30 msgr2=0x7eff780680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff78065c30 0x7eff780680e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7eff880b0000 tx=0x7eff88004740 comp rx=0 tx=0).stop 2023-06-02T15:31:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 -- 172.21.15.78:0/625834400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff980bc8b0 msgr2=0x7eff980b97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:17.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff980bc8b0 0x7eff980b97f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7eff8000c450 tx=0x7eff8000c910 comp rx=0 tx=0).stop 2023-06-02T15:31:17.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 -- 172.21.15.78:0/625834400 shutdown_connections 2023-06-02T15:31:17.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7eff981481b0 0x7eff981441b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7eff78065c30 0x7eff780680e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff980bc8b0 0x7eff980b97f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 --2- 172.21.15.78:0/625834400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff980ba640 0x7eff9813daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:17.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 -- 172.21.15.78:0/625834400 >> 172.21.15.78:0/625834400 conn(0x7eff980a2170 msgr2=0x7eff981416c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:17.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 -- 172.21.15.78:0/625834400 shutdown_connections 2023-06-02T15:31:17.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:17.978+0000 7eff9d8aa640 1 -- 172.21.15.78:0/625834400 wait complete. 2023-06-02T15:31:18.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-02T15:31:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f3177c73640 1 Processor -- start 2023-06-02T15:31:18.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f3177c73640 1 -- start start 2023-06-02T15:31:18.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f3177c73640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f317014bbb0 0x7f317014f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f3177c73640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31700bd7f0 0x7f31700be7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f3177c73640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317014ebf0 con 0x7f317006cb50 2023-06-02T15:31:18.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f3177c73640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31700bf9d0 con 0x7f31700bd7f0 2023-06-02T15:31:18.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f3177c73640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317014e600 con 0x7f317014bbb0 2023-06-02T15:31:18.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f317520e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31700bd7f0 0x7f31700be7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f317520e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f31700bd7f0 0x7f31700be7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39178/0 (socket says 172.21.15.78:39178) 2023-06-02T15:31:18.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f317520e640 1 -- 172.21.15.78:0/3791576069 learned_addr learned my addr 172.21.15.78:0/3791576069 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:18.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f3175a0f640 1 --2- 172.21.15.78:0/3791576069 >> v2:172.21.15.132:3300/0 conn(0x7f317014bbb0 0x7f317014f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f317520e640 1 -- 172.21.15.78:0/3791576069 >> v2:172.21.15.132:3300/0 conn(0x7f317014bbb0 msgr2=0x7f317014f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:18.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f317520e640 1 --2- 172.21.15.78:0/3791576069 >> v2:172.21.15.132:3300/0 conn(0x7f317014bbb0 0x7f317014f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f317520e640 1 -- 172.21.15.78:0/3791576069 >> v1:172.21.15.132:6789/0 conn(0x7f317006cb50 legacy=0x7f317006cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:18.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.126+0000 7f317520e640 1 -- 172.21.15.78:0/3791576069 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317014f5c0 con 0x7f31700bd7f0 2023-06-02T15:31:18.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f317520e640 1 --2- 172.21.15.78:0/3791576069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 0x7f31700be7b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f31700669e0 tx=0x7f316001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48df64136102e5d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:18.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3174a0d640 1 -- 172.21.15.78:0/3791576069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600a89b0 con 0x7f31700bd7f0 2023-06-02T15:31:18.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3174a0d640 1 -- 172.21.15.78:0/3791576069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31600a8b10 con 0x7f31700bd7f0 2023-06-02T15:31:18.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3174a0d640 1 -- 172.21.15.78:0/3791576069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600a8ea0 con 0x7f31700bd7f0 2023-06-02T15:31:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- 172.21.15.78:0/3791576069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 msgr2=0x7f31700be7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 --2- 172.21.15.78:0/3791576069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 0x7f31700be7b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f31700669e0 tx=0x7f316001ecb0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- 172.21.15.78:0/3791576069 shutdown_connections 2023-06-02T15:31:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 --2- 172.21.15.78:0/3791576069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 0x7f31700be7b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 --2- 172.21.15.78:0/3791576069 >> v2:172.21.15.132:3300/0 conn(0x7f317014bbb0 0x7f317014f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- 172.21.15.78:0/3791576069 >> 172.21.15.78:0/3791576069 conn(0x7f31700a2560 msgr2=0x7f31700a2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- 172.21.15.78:0/3791576069 shutdown_connections 2023-06-02T15:31:18.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- 172.21.15.78:0/3791576069 wait complete. 2023-06-02T15:31:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 Processor -- start 2023-06-02T15:31:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- start start 2023-06-02T15:31:18.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f317006cb50 0x7f317009eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 0x7f31700a6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f317014bbb0 0x7f31701486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31700a3ae0 con 0x7f31700bd7f0 2023-06-02T15:31:18.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31701e4590 con 0x7f317014bbb0 2023-06-02T15:31:18.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31701e4870 con 0x7f317006cb50 2023-06-02T15:31:18.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f317520e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 0x7f31700a6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f317520e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 0x7f31700a6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39186/0 (socket says 172.21.15.78:39186) 2023-06-02T15:31:18.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f317520e640 1 -- 172.21.15.78:0/427091469 learned_addr learned my addr 172.21.15.78:0/427091469 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:18.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3176210640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f317014bbb0 0x7f31701486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3175a0f640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f317006cb50 0x7f317009eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f317520e640 1 -- 172.21.15.78:0/427091469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f317006cb50 msgr2=0x7f317009eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f317520e640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f317006cb50 0x7f317009eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f317520e640 1 -- 172.21.15.78:0/427091469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f317014bbb0 msgr2=0x7f31701486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f317520e640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f317014bbb0 0x7f31701486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f317520e640 1 -- 172.21.15.78:0/427091469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31600094d0 con 0x7f31700bd7f0 2023-06-02T15:31:18.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3176210640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f317014bbb0 0x7f31701486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:18.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f317520e640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 0x7f31700a6000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31600b3040 tx=0x7f316001ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:18.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f31667fc640 1 -- 172.21.15.78:0/427091469 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600b0e80 con 0x7f31700bd7f0 2023-06-02T15:31:18.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f31667fc640 1 -- 172.21.15.78:0/427091469 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31600bb480 con 0x7f31700bd7f0 2023-06-02T15:31:18.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- 172.21.15.78:0/427091469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f317014e880 con 0x7f31700bd7f0 2023-06-02T15:31:18.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f31667fc640 1 -- 172.21.15.78:0/427091469 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31600bb830 con 0x7f31700bd7f0 2023-06-02T15:31:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.130+0000 7f3177c73640 1 -- 172.21.15.78:0/427091469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31700c0140 con 0x7f31700bd7f0 2023-06-02T15:31:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.134+0000 7f3177c73640 1 -- 172.21.15.78:0/427091469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31700becf0 con 0x7f31700bd7f0 2023-06-02T15:31:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.134+0000 7f31667fc640 1 -- 172.21.15.78:0/427091469 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f31600bb990 con 0x7f31700bd7f0 2023-06-02T15:31:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.134+0000 7f31667fc640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3154065c00 0x7f31540680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.134+0000 7f31667fc640 1 -- 172.21.15.78:0/427091469 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3160121d10 con 0x7f31700bd7f0 2023-06-02T15:31:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.134+0000 7f3175a0f640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3154065c00 0x7f31540680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.134+0000 7f3175a0f640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3154065c00 0x7f31540680b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f316c00b7c0 tx=0x7f316c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:18.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.138+0000 7f31667fc640 1 -- 172.21.15.78:0/427091469 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f31600ef280 con 0x7f31700bd7f0 2023-06-02T15:31:18.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 -- 172.21.15.78:0/427091469 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f31700becf0 con 0x7f31700bd7f0 2023-06-02T15:31:18.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f31667fc640 1 -- 172.21.15.78:0/427091469 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f31600f28a0 con 0x7f31700bd7f0 2023-06-02T15:31:18.298 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 -- 172.21.15.78:0/427091469 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3154065c00 msgr2=0x7f31540680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3154065c00 0x7f31540680b0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f316c00b7c0 tx=0x7f316c008040 comp rx=0 tx=0).stop 2023-06-02T15:31:18.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 -- 172.21.15.78:0/427091469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 msgr2=0x7f31700a6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 0x7f31700a6000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31600b3040 tx=0x7f316001ba50 comp rx=0 tx=0).stop 2023-06-02T15:31:18.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 -- 172.21.15.78:0/427091469 shutdown_connections 2023-06-02T15:31:18.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f317014bbb0 0x7f31701486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3154065c00 0x7f31540680b0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f31700bd7f0 0x7f31700a6000 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 --2- 172.21.15.78:0/427091469 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f317006cb50 0x7f317009eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 -- 172.21.15.78:0/427091469 >> 172.21.15.78:0/427091469 conn(0x7f31700a2560 msgr2=0x7f3170070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:18.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 -- 172.21.15.78:0/427091469 shutdown_connections 2023-06-02T15:31:18.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.290+0000 7f3177c73640 1 -- 172.21.15.78:0/427091469 wait complete. 2023-06-02T15:31:18.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-02T15:31:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17d03db640 1 Processor -- start 2023-06-02T15:31:18.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17d03db640 1 -- start start 2023-06-02T15:31:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17d03db640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f17c80baf80 0x7f17c80bbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17d03db640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c814d260 con 0x7f17c8149a80 2023-06-02T15:31:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17d03db640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c80bb7a0 con 0x7f17c814fb50 2023-06-02T15:31:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17d03db640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c8149e50 con 0x7f17c80baf80 2023-06-02T15:31:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17ce177640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f17c8149a80 0x7f17c806a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57022/0 (socket says 172.21.15.78:57022) 2023-06-02T15:31:18.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17ce177640 1 -- 172.21.15.78:0/2950371538 learned_addr learned my addr 172.21.15.78:0/2950371538 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:18.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1661419973 0 0) 0x7f17c814d260 con 0x7f17c8149a80 2023-06-02T15:31:18.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17b4003530 con 0x7f17c8149a80 2023-06-02T15:31:18.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd976640 1 --2- 172.21.15.78:0/2950371538 >> v2:172.21.15.132:3300/0 conn(0x7f17c80baf80 0x7f17c80bbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2230569460 0 0) 0x7f17b4003530 con 0x7f17c8149a80 2023-06-02T15:31:18.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 >> v2:172.21.15.132:3300/0 conn(0x7f17c80baf80 msgr2=0x7f17c80bbcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:18.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 --2- 172.21.15.78:0/2950371538 >> v2:172.21.15.132:3300/0 conn(0x7f17c80baf80 0x7f17c80bbcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 >> v1:172.21.15.132:6789/0 conn(0x7f17c814fb50 legacy=0x7f17c814ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80bba40 con 0x7f17c8149a80 2023-06-02T15:31:18.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f17c4001680 con 0x7f17c8149a80 2023-06-02T15:31:18.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 >> v1:172.21.15.78:6789/0 conn(0x7f17c8149a80 legacy=0x7f17c806a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17b40039f0 0x7f17b4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40047d0 0x7f17b4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b40051f0 0x7f17b400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b400c100 con 0x7f17b40051f0 2023-06-02T15:31:18.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b400c270 con 0x7f17b40047d0 2023-06-02T15:31:18.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b400c430 con 0x7f17b40039f0 2023-06-02T15:31:18.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17ce978640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b40051f0 0x7f17b400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17ce177640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17b40039f0 0x7f17b4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17cd976640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40047d0 0x7f17b4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17ce978640 1 -- 172.21.15.78:0/2950371538 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17b40039f0 msgr2=0x7f17b4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:18.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17ce978640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17b40039f0 0x7f17b4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17ce978640 1 -- 172.21.15.78:0/2950371538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40047d0 msgr2=0x7f17b4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:18.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17ce978640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40047d0 0x7f17b4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.422+0000 7f17ce978640 1 -- 172.21.15.78:0/2950371538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4003530 con 0x7f17b40051f0 2023-06-02T15:31:18.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17ce978640 1 -- 172.21.15.78:0/2950371538 reap_dead start 2023-06-02T15:31:18.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17ce978640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b40051f0 0x7f17b400b990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f17c0001e70 tx=0x7f17c001c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9667bff2913a001 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:18.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0003b80 con 0x7f17b40051f0 2023-06-02T15:31:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c0003d00 con 0x7f17b40051f0 2023-06-02T15:31:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd175640 1 -- 172.21.15.78:0/2950371538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0005310 con 0x7f17b40051f0 2023-06-02T15:31:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- 172.21.15.78:0/2950371538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b40051f0 msgr2=0x7f17b400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b40051f0 0x7f17b400b990 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f17c0001e70 tx=0x7f17c001c6c0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- 172.21.15.78:0/2950371538 shutdown_connections 2023-06-02T15:31:18.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 --2- 172.21.15.78:0/2950371538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17b40051f0 0x7f17b400b990 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- 172.21.15.78:0/2950371538 >> 172.21.15.78:0/2950371538 conn(0x7f17c80bd800 msgr2=0x7f17c80bdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:18.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- 172.21.15.78:0/2950371538 shutdown_connections 2023-06-02T15:31:18.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- 172.21.15.78:0/2950371538 wait complete. 2023-06-02T15:31:18.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 Processor -- start 2023-06-02T15:31:18.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- start start 2023-06-02T15:31:18.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17b40051f0 0x7f17c81e1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c80be950 0x7f17c80bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17c80c02b0 0x7f17c8140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c814f0e0 con 0x7f17c80be950 2023-06-02T15:31:18.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81e1110 con 0x7f17c80c02b0 2023-06-02T15:31:18.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c81e1690 con 0x7f17b40051f0 2023-06-02T15:31:18.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd976640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c80be950 0x7f17c80bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd976640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c80be950 0x7f17c80bfd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39196/0 (socket says 172.21.15.78:39196) 2023-06-02T15:31:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd976640 1 -- 172.21.15.78:0/2119719292 learned_addr learned my addr 172.21.15.78:0/2119719292 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17ce177640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17b40051f0 0x7f17c81e1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd976640 1 -- 172.21.15.78:0/2119719292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17b40051f0 msgr2=0x7f17c81e1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd976640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17b40051f0 0x7f17c81e1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd976640 1 -- 172.21.15.78:0/2119719292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17c80c02b0 msgr2=0x7f17c8140b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17ce978640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17c80c02b0 0x7f17c8140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd976640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17c80c02b0 0x7f17c8140b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd976640 1 -- 172.21.15.78:0/2119719292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80b64e0 con 0x7f17c80be950 2023-06-02T15:31:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17ce177640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17b40051f0 0x7f17c81e1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17cd976640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c80be950 0x7f17c80bfd70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f17b800f4f0 tx=0x7f17b800f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:18.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17beffd640 1 -- 172.21.15.78:0/2119719292 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8014870 con 0x7f17c80be950 2023-06-02T15:31:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17beffd640 1 -- 172.21.15.78:0/2119719292 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b80149d0 con 0x7f17c80be950 2023-06-02T15:31:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17beffd640 1 -- 172.21.15.78:0/2119719292 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8014d60 con 0x7f17c80be950 2023-06-02T15:31:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- 172.21.15.78:0/2119719292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c814cef0 con 0x7f17c80be950 2023-06-02T15:31:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.426+0000 7f17d03db640 1 -- 172.21.15.78:0/2119719292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c80bbcc0 con 0x7f17c80be950 2023-06-02T15:31:18.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.430+0000 7f17d03db640 1 -- 172.21.15.78:0/2119719292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c8073bc0 con 0x7f17c80be950 2023-06-02T15:31:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.430+0000 7f17beffd640 1 -- 172.21.15.78:0/2119719292 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f17b8015410 con 0x7f17c80be950 2023-06-02T15:31:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.430+0000 7f17beffd640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f17ac065c00 0x7f17ac0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.430+0000 7f17ce177640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f17ac065c00 0x7f17ac0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.430+0000 7f17beffd640 1 -- 172.21.15.78:0/2119719292 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f17b8084070 con 0x7f17c80be950 2023-06-02T15:31:18.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.430+0000 7f17ce177640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f17ac065c00 0x7f17ac0680b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17c4001210 tx=0x7f17c4001160 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:18.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.434+0000 7f17beffd640 1 -- 172.21.15.78:0/2119719292 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f17b80514c0 con 0x7f17c80be950 2023-06-02T15:31:18.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 -- 172.21.15.78:0/2119719292 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17c81e17d0 con 0x7f17c80be950 2023-06-02T15:31:18.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17beffd640 1 -- 172.21.15.78:0/2119719292 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17b8054ae0 con 0x7f17c80be950 2023-06-02T15:31:18.583 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-02T15:31:18.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 -- 172.21.15.78:0/2119719292 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f17ac065c00 msgr2=0x7f17ac0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f17ac065c00 0x7f17ac0680b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f17c4001210 tx=0x7f17c4001160 comp rx=0 tx=0).stop 2023-06-02T15:31:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 -- 172.21.15.78:0/2119719292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c80be950 msgr2=0x7f17c80bfd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c80be950 0x7f17c80bfd70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f17b800f4f0 tx=0x7f17b800f9b0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 -- 172.21.15.78:0/2119719292 shutdown_connections 2023-06-02T15:31:18.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17c80c02b0 0x7f17c8140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f17ac065c00 0x7f17ac0680b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17c80be950 0x7f17c80bfd70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 --2- 172.21.15.78:0/2119719292 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f17b40051f0 0x7f17c81e1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.574+0000 7f17d03db640 1 -- 172.21.15.78:0/2119719292 >> 172.21.15.78:0/2119719292 conn(0x7f17c80bd800 msgr2=0x7f17c81502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:18.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.578+0000 7f17d03db640 1 -- 172.21.15.78:0/2119719292 shutdown_connections 2023-06-02T15:31:18.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.578+0000 7f17d03db640 1 -- 172.21.15.78:0/2119719292 wait complete. 2023-06-02T15:31:18.600 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-02T15:31:18.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b499ac640 1 Processor -- start 2023-06-02T15:31:18.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b499ac640 1 -- start start 2023-06-02T15:31:18.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b499ac640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3b44071780 0x7f3b440ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b499ac640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b441485c0 0x7f3b44148a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b499ac640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b440a5f30 con 0x7f3b440c0570 2023-06-02T15:31:18.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b499ac640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b440c1100 con 0x7f3b441485c0 2023-06-02T15:31:18.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b499ac640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4414bcc0 con 0x7f3b44071780 2023-06-02T15:31:18.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b437fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b441485c0 0x7f3b44148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b437fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b441485c0 0x7f3b44148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39202/0 (socket says 172.21.15.78:39202) 2023-06-02T15:31:18.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b437fe640 1 -- 172.21.15.78:0/2824926778 learned_addr learned my addr 172.21.15.78:0/2824926778 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:18.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b427fc640 1 --2- 172.21.15.78:0/2824926778 >> v2:172.21.15.132:3300/0 conn(0x7f3b44071780 0x7f3b440ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b437fe640 1 -- 172.21.15.78:0/2824926778 >> v2:172.21.15.132:3300/0 conn(0x7f3b44071780 msgr2=0x7f3b440ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:18.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b437fe640 1 --2- 172.21.15.78:0/2824926778 >> v2:172.21.15.132:3300/0 conn(0x7f3b44071780 0x7f3b440ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b437fe640 1 -- 172.21.15.78:0/2824926778 >> v1:172.21.15.132:6789/0 conn(0x7f3b440c0570 legacy=0x7f3b440bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:18.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b437fe640 1 -- 172.21.15.78:0/2824926778 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4414bfa0 con 0x7f3b441485c0 2023-06-02T15:31:18.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.706+0000 7f3b427fc640 1 --2- 172.21.15.78:0/2824926778 >> v2:172.21.15.132:3300/0 conn(0x7f3b44071780 0x7f3b440ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:18.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b437fe640 1 --2- 172.21.15.78:0/2824926778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b441485c0 0x7f3b44148a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3b4406b130 tx=0x7f3b3c01c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47e1dc055b1338a server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:18.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b41ffb640 1 -- 172.21.15.78:0/2824926778 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0a5650 con 0x7f3b441485c0 2023-06-02T15:31:18.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b41ffb640 1 -- 172.21.15.78:0/2824926778 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c0a57b0 con 0x7f3b441485c0 2023-06-02T15:31:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b41ffb640 1 -- 172.21.15.78:0/2824926778 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0a5b40 con 0x7f3b441485c0 2023-06-02T15:31:18.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b499ac640 1 -- 172.21.15.78:0/2824926778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b441485c0 msgr2=0x7f3b44148a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b499ac640 1 --2- 172.21.15.78:0/2824926778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b441485c0 0x7f3b44148a00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3b4406b130 tx=0x7f3b3c01c990 comp rx=0 tx=0).stop 2023-06-02T15:31:18.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b499ac640 1 -- 172.21.15.78:0/2824926778 shutdown_connections 2023-06-02T15:31:18.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b499ac640 1 --2- 172.21.15.78:0/2824926778 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b441485c0 0x7f3b44148a00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b499ac640 1 --2- 172.21.15.78:0/2824926778 >> v2:172.21.15.132:3300/0 conn(0x7f3b44071780 0x7f3b440ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b499ac640 1 -- 172.21.15.78:0/2824926778 >> 172.21.15.78:0/2824926778 conn(0x7f3b440a2170 msgr2=0x7f3b440a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b499ac640 1 -- 172.21.15.78:0/2824926778 shutdown_connections 2023-06-02T15:31:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.710+0000 7f3b499ac640 1 -- 172.21.15.78:0/2824926778 wait complete. 2023-06-02T15:31:18.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 Processor -- start 2023-06-02T15:31:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 -- start start 2023-06-02T15:31:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b44071780 0x7f3b4413eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b440c0570 0x7f3b4413f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b441485c0 0x7f3b441401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4413bbd0 con 0x7f3b440c0570 2023-06-02T15:31:18.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b440be5e0 con 0x7f3b441485c0 2023-06-02T15:31:18.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b441e4630 con 0x7f3b44071780 2023-06-02T15:31:18.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b427fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b440c0570 0x7f3b4413f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b427fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b440c0570 0x7f3b4413f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39208/0 (socket says 172.21.15.78:39208) 2023-06-02T15:31:18.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b427fc640 1 -- 172.21.15.78:0/2102021104 learned_addr learned my addr 172.21.15.78:0/2102021104 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:18.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b437fe640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b441485c0 0x7f3b441401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b42ffd640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b44071780 0x7f3b4413eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b427fc640 1 -- 172.21.15.78:0/2102021104 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b44071780 msgr2=0x7f3b4413eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b427fc640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b44071780 0x7f3b4413eae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b427fc640 1 -- 172.21.15.78:0/2102021104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b441485c0 msgr2=0x7f3b441401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b427fc640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b441485c0 0x7f3b441401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b427fc640 1 -- 172.21.15.78:0/2102021104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c009b30 con 0x7f3b440c0570 2023-06-02T15:31:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b437fe640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b441485c0 0x7f3b441401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b427fc640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b440c0570 0x7f3b4413f2c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800c7c0 tx=0x7f3b3800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:18.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b2bfff640 1 -- 172.21.15.78:0/2102021104 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38007a30 con 0x7f3b440c0570 2023-06-02T15:31:18.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b2bfff640 1 -- 172.21.15.78:0/2102021104 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b38007b90 con 0x7f3b440c0570 2023-06-02T15:31:18.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 -- 172.21.15.78:0/2102021104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b440bb760 con 0x7f3b440c0570 2023-06-02T15:31:18.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b2bfff640 1 -- 172.21.15.78:0/2102021104 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3800ce70 con 0x7f3b440c0570 2023-06-02T15:31:18.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 -- 172.21.15.78:0/2102021104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b440bb5d0 con 0x7f3b440c0570 2023-06-02T15:31:18.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b499ac640 1 -- 172.21.15.78:0/2102021104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b440bb8f0 con 0x7f3b440c0570 2023-06-02T15:31:18.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b2bfff640 1 -- 172.21.15.78:0/2102021104 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f3b380113f0 con 0x7f3b440c0570 2023-06-02T15:31:18.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.714+0000 7f3b2bfff640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b30065c30 0x7f3b300680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.718+0000 7f3b42ffd640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b30065c30 0x7f3b300680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.718+0000 7f3b2bfff640 1 -- 172.21.15.78:0/2102021104 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3b38083a50 con 0x7f3b440c0570 2023-06-02T15:31:18.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.718+0000 7f3b42ffd640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b30065c30 0x7f3b300680e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b34003d60 tx=0x7f3b34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:18.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.722+0000 7f3b2bfff640 1 -- 172.21.15.78:0/2102021104 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f3b38050fc0 con 0x7f3b440c0570 2023-06-02T15:31:18.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.858+0000 7f3b499ac640 1 -- 172.21.15.78:0/2102021104 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3b44073bc0 con 0x7f3b440c0570 2023-06-02T15:31:18.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.858+0000 7f3b2bfff640 1 -- 172.21.15.78:0/2102021104 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3b380545e0 con 0x7f3b440c0570 2023-06-02T15:31:18.868 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:18.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 -- 172.21.15.78:0/2102021104 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b30065c30 msgr2=0x7f3b300680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b30065c30 0x7f3b300680e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b34003d60 tx=0x7f3b34009040 comp rx=0 tx=0).stop 2023-06-02T15:31:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 -- 172.21.15.78:0/2102021104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b440c0570 msgr2=0x7f3b4413f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:18.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b440c0570 0x7f3b4413f2c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f3b3800c7c0 tx=0x7f3b3800cc80 comp rx=0 tx=0).stop 2023-06-02T15:31:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 -- 172.21.15.78:0/2102021104 shutdown_connections 2023-06-02T15:31:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b441485c0 0x7f3b441401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3b30065c30 0x7f3b300680e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b440c0570 0x7f3b4413f2c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 --2- 172.21.15.78:0/2102021104 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3b44071780 0x7f3b4413eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 -- 172.21.15.78:0/2102021104 >> 172.21.15.78:0/2102021104 conn(0x7f3b440a2170 msgr2=0x7f3b440bc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 -- 172.21.15.78:0/2102021104 shutdown_connections 2023-06-02T15:31:18.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.862+0000 7f3b499ac640 1 -- 172.21.15.78:0/2102021104 wait complete. 2023-06-02T15:31:18.885 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-02T15:31:18.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe212dbf640 1 Processor -- start 2023-06-02T15:31:18.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe212dbf640 1 -- start start 2023-06-02T15:31:18.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe212dbf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c0c0570 0x7fe20c0ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:18.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe212dbf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c0a5f30 con 0x7fe20c071780 2023-06-02T15:31:18.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe212dbf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c14bcc0 con 0x7fe20c1485c0 2023-06-02T15:31:18.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe212dbf640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0c1100 con 0x7fe20c0c0570 2023-06-02T15:31:18.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe20c071780 0x7fe20c0bc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57032/0 (socket says 172.21.15.78:57032) 2023-06-02T15:31:18.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20bfff640 1 -- 172.21.15.78:0/1369524533 learned_addr learned my addr 172.21.15.78:0/1369524533 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:18.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511189686 0 0) 0x7fe20c0a5f30 con 0x7fe20c071780 2023-06-02T15:31:18.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1f4003530 con 0x7fe20c071780 2023-06-02T15:31:18.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe210b5b640 1 --2- 172.21.15.78:0/1369524533 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c0c0570 0x7fe20c0ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:18.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3660674666 0 0) 0x7fe1f4003530 con 0x7fe20c071780 2023-06-02T15:31:18.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c0c0570 msgr2=0x7fe20c0ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 --2- 172.21.15.78:0/1369524533 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c0c0570 0x7fe20c0ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 >> v1:172.21.15.132:6789/0 conn(0x7fe20c1485c0 legacy=0x7fe20c0badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c14bfa0 con 0x7fe20c071780 2023-06-02T15:31:19.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fe200001680 con 0x7fe20c071780 2023-06-02T15:31:19.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 >> v1:172.21.15.78:6789/0 conn(0x7fe20c071780 legacy=0x7fe20c0bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 --2- 172.21.15.78:0/1369524533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 0x7fe1f4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 --2- 172.21.15.78:0/1369524533 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c0c0570 0x7fe1f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 --2- 172.21.15.78:0/1369524533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f4004d10 0x7fe1f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f400bb20 con 0x7fe1f4003a20 2023-06-02T15:31:19.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f400bc60 con 0x7fe1f4004d10 2023-06-02T15:31:19.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f400be20 con 0x7fe20c0c0570 2023-06-02T15:31:19.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe210b5b640 1 --2- 172.21.15.78:0/1369524533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 0x7fe1f4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe210b5b640 1 -- 172.21.15.78:0/1369524533 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c0c0570 msgr2=0x7fe1f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe210b5b640 1 --2- 172.21.15.78:0/1369524533 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c0c0570 0x7fe1f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe210b5b640 1 -- 172.21.15.78:0/1369524533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f4004d10 msgr2=0x7fe1f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe210b5b640 1 --2- 172.21.15.78:0/1369524533 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f4004d10 0x7fe1f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.986+0000 7fe210b5b640 1 -- 172.21.15.78:0/1369524533 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f4003530 con 0x7fe1f4003a20 2023-06-02T15:31:19.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe210b5b640 1 --2- 172.21.15.78:0/1369524533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 0x7fe1f4003e30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00ba30 tx=0x7fe1fc01c6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=344945f89bfd1c43 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0ae650 con 0x7fe1f4003a20 2023-06-02T15:31:19.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1fc0ae7b0 con 0x7fe1f4003a20 2023-06-02T15:31:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe20b7fe640 1 -- 172.21.15.78:0/1369524533 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc0aeb60 con 0x7fe1f4003a20 2023-06-02T15:31:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- 172.21.15.78:0/1369524533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 msgr2=0x7fe1f4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 --2- 172.21.15.78:0/1369524533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 0x7fe1f4003e30 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00ba30 tx=0x7fe1fc01c6c0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe21135c640 1 -- 172.21.15.78:0/1369524533 reap_dead start 2023-06-02T15:31:19.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- 172.21.15.78:0/1369524533 shutdown_connections 2023-06-02T15:31:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- 172.21.15.78:0/1369524533 >> 172.21.15.78:0/1369524533 conn(0x7fe20c0a2170 msgr2=0x7fe20c0a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- 172.21.15.78:0/1369524533 shutdown_connections 2023-06-02T15:31:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- 172.21.15.78:0/1369524533 wait complete. 2023-06-02T15:31:19.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 Processor -- start 2023-06-02T15:31:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- start start 2023-06-02T15:31:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 0x7fe20c1412a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe20c1417e0 0x7fe20c1e86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c14ab90 0x7fe20c1371f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c13bd50 con 0x7fe1f4003a20 2023-06-02T15:31:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c1e8260 con 0x7fe20c1417e0 2023-06-02T15:31:19.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c13dec0 con 0x7fe20c14ab90 2023-06-02T15:31:19.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe210b5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 0x7fe20c1412a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe210b5b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 0x7fe20c1412a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39226/0 (socket says 172.21.15.78:39226) 2023-06-02T15:31:19.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe210b5b640 1 -- 172.21.15.78:0/3077328836 learned_addr learned my addr 172.21.15.78:0/3077328836 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:19.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe21135c640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c14ab90 0x7fe20c1371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe210b5b640 1 -- 172.21.15.78:0/3077328836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c14ab90 msgr2=0x7fe20c1371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe210b5b640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c14ab90 0x7fe20c1371f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe210b5b640 1 -- 172.21.15.78:0/3077328836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe20c1417e0 msgr2=0x7fe20c1e86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe210b5b640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe20c1417e0 0x7fe20c1e86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe210b5b640 1 -- 172.21.15.78:0/3077328836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c0c0940 con 0x7fe1f4003a20 2023-06-02T15:31:19.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe210b5b640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 0x7fe20c1412a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc01c4f0 tx=0x7fe1f4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe2097fa640 1 -- 172.21.15.78:0/3077328836 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc004020 con 0x7fe1f4003a20 2023-06-02T15:31:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe2097fa640 1 -- 172.21.15.78:0/3077328836 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1fc004180 con 0x7fe1f4003a20 2023-06-02T15:31:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- 172.21.15.78:0/3077328836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20c148dd0 con 0x7fe1f4003a20 2023-06-02T15:31:19.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe2097fa640 1 -- 172.21.15.78:0/3077328836 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc004510 con 0x7fe1f4003a20 2023-06-02T15:31:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.990+0000 7fe212dbf640 1 -- 172.21.15.78:0/3077328836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c0c0ad0 con 0x7fe1f4003a20 2023-06-02T15:31:19.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.994+0000 7fe212dbf640 1 -- 172.21.15.78:0/3077328836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c073bc0 con 0x7fe1f4003a20 2023-06-02T15:31:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.994+0000 7fe2097fa640 1 -- 172.21.15.78:0/3077328836 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fe1fc0b5040 con 0x7fe1f4003a20 2023-06-02T15:31:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.994+0000 7fe2097fa640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1f8065c00 0x7fe1f80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.994+0000 7fe2097fa640 1 -- 172.21.15.78:0/3077328836 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe1fc0aa050 con 0x7fe1f4003a20 2023-06-02T15:31:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.994+0000 7fe20bfff640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1f8065c00 0x7fe1f80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.994+0000 7fe20bfff640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1f8065c00 0x7fe1f80680b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe200000f70 tx=0x7fe200001550 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:18.998+0000 7fe2097fa640 1 -- 172.21.15.78:0/3077328836 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fe1fc0eafb0 con 0x7fe1f4003a20 2023-06-02T15:31:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.158+0000 7fe212dbf640 1 -- 172.21.15.78:0/3077328836 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe20c13e140 con 0x7fe1f4003a20 2023-06-02T15:31:19.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe2097fa640 1 -- 172.21.15.78:0/3077328836 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe1fc0ee5d0 con 0x7fe1f4003a20 2023-06-02T15:31:19.170 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-02T15:31:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 -- 172.21.15.78:0/3077328836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1f8065c00 msgr2=0x7fe1f80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1f8065c00 0x7fe1f80680b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe200000f70 tx=0x7fe200001550 comp rx=0 tx=0).stop 2023-06-02T15:31:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 -- 172.21.15.78:0/3077328836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 msgr2=0x7fe20c1412a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 0x7fe20c1412a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc01c4f0 tx=0x7fe1f4005800 comp rx=0 tx=0).stop 2023-06-02T15:31:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 -- 172.21.15.78:0/3077328836 shutdown_connections 2023-06-02T15:31:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe20c14ab90 0x7fe20c1371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe20c1417e0 0x7fe20c1e86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe1f8065c00 0x7fe1f80680b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 --2- 172.21.15.78:0/3077328836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1f4003a20 0x7fe20c1412a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 -- 172.21.15.78:0/3077328836 >> 172.21.15.78:0/3077328836 conn(0x7fe20c0a2170 msgr2=0x7fe20c142630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:19.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 -- 172.21.15.78:0/3077328836 shutdown_connections 2023-06-02T15:31:19.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.162+0000 7fe212dbf640 1 -- 172.21.15.78:0/3077328836 wait complete. 2023-06-02T15:31:19.187 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2023-06-02T15:31:19.188 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-02T15:31:19.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:31:19.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e7855640 1 Processor -- start 2023-06-02T15:31:19.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e7855640 1 -- start start 2023-06-02T15:31:19.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e7855640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00a0020 0x7f56e014bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e7855640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e014ba90 con 0x7f56e014f330 2023-06-02T15:31:19.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e7855640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e00a47b0 con 0x7f56e00bc1c0 2023-06-02T15:31:19.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e7855640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e014f7c0 con 0x7f56e00a0020 2023-06-02T15:31:19.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e4df0640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f56e014f330 0x7f56e01487d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57040/0 (socket says 172.21.15.78:57040) 2023-06-02T15:31:19.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e4df0640 1 -- 172.21.15.78:0/1070765253 learned_addr learned my addr 172.21.15.78:0/1070765253 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:19.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e5df2640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00a0020 0x7f56e014bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359020425 0 0) 0x7f56e014ba90 con 0x7f56e014f330 2023-06-02T15:31:19.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56cc003530 con 0x7f56e014f330 2023-06-02T15:31:19.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2279436113 0 0) 0x7f56cc003530 con 0x7f56e014f330 2023-06-02T15:31:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00a0020 msgr2=0x7f56e014bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00a0020 0x7f56e014bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 >> v1:172.21.15.132:6789/0 conn(0x7f56e00bc1c0 legacy=0x7f56e00a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e014b440 con 0x7f56e014f330 2023-06-02T15:31:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f56d0001680 con 0x7f56e014f330 2023-06-02T15:31:19.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 >> v1:172.21.15.78:6789/0 conn(0x7f56e014f330 legacy=0x7f56e01487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56cc0039b0 0x7f56cc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00a0020 0x7f56cc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc004d10 0x7f56cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e014f7c0 con 0x7f56cc004d10 2023-06-02T15:31:19.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc00bad0 con 0x7f56cc0039b0 2023-06-02T15:31:19.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc00bc90 con 0x7f56e00a0020 2023-06-02T15:31:19.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e5df2640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc004d10 0x7f56cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e55f1640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56cc0039b0 0x7f56cc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e4df0640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00a0020 0x7f56cc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e5df2640 1 -- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00a0020 msgr2=0x7f56cc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e5df2640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00a0020 0x7f56cc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e5df2640 1 -- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56cc0039b0 msgr2=0x7f56cc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e5df2640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56cc0039b0 0x7f56cc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.294+0000 7f56e5df2640 1 -- 172.21.15.78:0/1070765253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56cc003530 con 0x7f56cc004d10 2023-06-02T15:31:19.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e5df2640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc004d10 0x7f56cc005180 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009fc0 tx=0x7f56d801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2790d4f8903d72 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80a5b60 con 0x7f56cc004d10 2023-06-02T15:31:19.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d800f040 con 0x7f56cc004d10 2023-06-02T15:31:19.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56d7fff640 1 -- 172.21.15.78:0/1070765253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d80ad440 con 0x7f56cc004d10 2023-06-02T15:31:19.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 -- 172.21.15.78:0/1070765253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc004d10 msgr2=0x7f56cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 --2- 172.21.15.78:0/1070765253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56cc004d10 0x7f56cc005180 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f56d8009fc0 tx=0x7f56d801cc60 comp rx=0 tx=0).stop 2023-06-02T15:31:19.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e5df2640 1 -- 172.21.15.78:0/1070765253 reap_dead start 2023-06-02T15:31:19.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 -- 172.21.15.78:0/1070765253 shutdown_connections 2023-06-02T15:31:19.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 -- 172.21.15.78:0/1070765253 >> 172.21.15.78:0/1070765253 conn(0x7f56e00bcf50 msgr2=0x7f56e00bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:19.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 -- 172.21.15.78:0/1070765253 shutdown_connections 2023-06-02T15:31:19.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 -- 172.21.15.78:0/1070765253 wait complete. 2023-06-02T15:31:19.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 Processor -- start 2023-06-02T15:31:19.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 -- start start 2023-06-02T15:31:19.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e014dac0 0x7f56e0145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e006ecb0 0x7f56e0145cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00c0cb0 0x7f56e006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e0071410 con 0x7f56e006ecb0 2023-06-02T15:31:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e009fe90 con 0x7f56e014dac0 2023-06-02T15:31:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e7855640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e00bfae0 con 0x7f56e00c0cb0 2023-06-02T15:31:19.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e4df0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e006ecb0 0x7f56e0145cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e4df0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e006ecb0 0x7f56e0145cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39240/0 (socket says 172.21.15.78:39240) 2023-06-02T15:31:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e4df0640 1 -- 172.21.15.78:0/880117742 learned_addr learned my addr 172.21.15.78:0/880117742 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e55f1640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e014dac0 0x7f56e0145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e4df0640 1 -- 172.21.15.78:0/880117742 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00c0cb0 msgr2=0x7f56e006fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e5df2640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00c0cb0 0x7f56e006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e4df0640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00c0cb0 0x7f56e006fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e4df0640 1 -- 172.21.15.78:0/880117742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e014dac0 msgr2=0x7f56e0145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e4df0640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e014dac0 0x7f56e0145780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e4df0640 1 -- 172.21.15.78:0/880117742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0148ee0 con 0x7f56e006ecb0 2023-06-02T15:31:19.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.298+0000 7f56e55f1640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e014dac0 0x7f56e0145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56e4df0640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e006ecb0 0x7f56e0145cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f56d0011840 tx=0x7f56d0011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56d5ffb640 1 -- 172.21.15.78:0/880117742 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000fb00 con 0x7f56e006ecb0 2023-06-02T15:31:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56d5ffb640 1 -- 172.21.15.78:0/880117742 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000fc60 con 0x7f56e006ecb0 2023-06-02T15:31:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56e7855640 1 -- 172.21.15.78:0/880117742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e014b720 con 0x7f56e006ecb0 2023-06-02T15:31:19.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56d5ffb640 1 -- 172.21.15.78:0/880117742 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0015410 con 0x7f56e006ecb0 2023-06-02T15:31:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56e7855640 1 -- 172.21.15.78:0/880117742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e00bc590 con 0x7f56e006ecb0 2023-06-02T15:31:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56e7855640 1 -- 172.21.15.78:0/880117742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e0073bc0 con 0x7f56e006ecb0 2023-06-02T15:31:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56d5ffb640 1 -- 172.21.15.78:0/880117742 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f56d0015590 con 0x7f56e006ecb0 2023-06-02T15:31:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56d5ffb640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f56c4065c00 0x7f56c40680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56d5ffb640 1 -- 172.21.15.78:0/880117742 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f56d0086960 con 0x7f56e006ecb0 2023-06-02T15:31:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56e55f1640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f56c4065c00 0x7f56c40680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.302+0000 7f56e55f1640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f56c4065c00 0x7f56c40680b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0016e0 tx=0x7f56dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.306+0000 7f56d5ffb640 1 -- 172.21.15.78:0/880117742 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f56d0053e40 con 0x7f56e006ecb0 2023-06-02T15:31:19.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.458+0000 7f56e7855640 1 -- 172.21.15.78:0/880117742 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56e00a4b30 con 0x7f56e006ecb0 2023-06-02T15:31:19.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56d5ffb640 1 -- 172.21.15.78:0/880117742 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f56d0084e60 con 0x7f56e006ecb0 2023-06-02T15:31:19.469 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:19.469 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:31:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 -- 172.21.15.78:0/880117742 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f56c4065c00 msgr2=0x7f56c40680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f56c4065c00 0x7f56c40680b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0016e0 tx=0x7f56dc009040 comp rx=0 tx=0).stop 2023-06-02T15:31:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 -- 172.21.15.78:0/880117742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e006ecb0 msgr2=0x7f56e0145cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e006ecb0 0x7f56e0145cc0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f56d0011840 tx=0x7f56d0011d00 comp rx=0 tx=0).stop 2023-06-02T15:31:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 -- 172.21.15.78:0/880117742 shutdown_connections 2023-06-02T15:31:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f56e00c0cb0 0x7f56e006fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f56c4065c00 0x7f56c40680b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f56e006ecb0 0x7f56e0145cc0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 --2- 172.21.15.78:0/880117742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56e014dac0 0x7f56e0145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 -- 172.21.15.78:0/880117742 >> 172.21.15.78:0/880117742 conn(0x7f56e00bcf50 msgr2=0x7f56e0146de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 -- 172.21.15.78:0/880117742 shutdown_connections 2023-06-02T15:31:19.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.462+0000 7f56e7855640 1 -- 172.21.15.78:0/880117742 wait complete. 2023-06-02T15:31:19.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-02T15:30:31.844882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-02T15:30:33.293644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-02T15:30:36.277798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-02T15:30:37.599884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-02T15:30:40.680165+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-02T15:31:19.489 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-02T15:31:19.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.606+0000 7fa7d7cab640 1 Processor -- start 2023-06-02T15:31:19.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.606+0000 7fa7d7cab640 1 -- start start 2023-06-02T15:31:19.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d7cab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00a59e0 0x7fa7d00718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d7cab640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa7d006c250 0x7fa7d0149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d7cab640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d014d220 con 0x7fa7d006cfc0 2023-06-02T15:31:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d7cab640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00ba640 con 0x7fa7d006c250 2023-06-02T15:31:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d7cab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d014cd30 con 0x7fa7d00a59e0 2023-06-02T15:31:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d6248640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa7d006c250 0x7fa7d0149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d5246640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa7d006cfc0 0x7fa7d014f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57044/0 (socket says 172.21.15.78:57044) 2023-06-02T15:31:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d5246640 1 -- 172.21.15.78:0/4089555776 learned_addr learned my addr 172.21.15.78:0/4089555776 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d6248640 1 -- 172.21.15.78:0/4089555776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00a59e0 msgr2=0x7fa7d00718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d5a47640 1 --2- 172.21.15.78:0/4089555776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00a59e0 0x7fa7d00718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d4a45640 1 -- 172.21.15.78:0/4089555776 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474943437 0 0) 0x7fa7d014d220 con 0x7fa7d006cfc0 2023-06-02T15:31:19.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d6248640 1 --2- 172.21.15.78:0/4089555776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00a59e0 0x7fa7d00718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d6248640 1 -- 172.21.15.78:0/4089555776 >> v1:172.21.15.78:6789/0 conn(0x7fa7d006cfc0 legacy=0x7fa7d014f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d6248640 1 -- 172.21.15.78:0/4089555776 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d00ba850 con 0x7fa7d006c250 2023-06-02T15:31:19.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d5a47640 1 --2- 172.21.15.78:0/4089555776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00a59e0 0x7fa7d00718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:19.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d6248640 1 --2- 172.21.15.78:0/4089555776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d006c250 0x7fa7d0149660 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009d90 tx=0x7fa7c801c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98e023e8e361136 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d4a45640 1 -- 172.21.15.78:0/4089555776 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80a5860 con 0x7fa7d006c250 2023-06-02T15:31:19.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d4a45640 1 -- 172.21.15.78:0/4089555776 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80a59c0 con 0x7fa7d006c250 2023-06-02T15:31:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.610+0000 7fa7d4a45640 1 -- 172.21.15.78:0/4089555776 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80a5d50 con 0x7fa7d006c250 2023-06-02T15:31:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- 172.21.15.78:0/4089555776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d006c250 msgr2=0x7fa7d0149660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 --2- 172.21.15.78:0/4089555776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d006c250 0x7fa7d0149660 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009d90 tx=0x7fa7c801c890 comp rx=0 tx=0).stop 2023-06-02T15:31:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- 172.21.15.78:0/4089555776 shutdown_connections 2023-06-02T15:31:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 --2- 172.21.15.78:0/4089555776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d006c250 0x7fa7d0149660 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 --2- 172.21.15.78:0/4089555776 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d00a59e0 0x7fa7d00718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- 172.21.15.78:0/4089555776 >> 172.21.15.78:0/4089555776 conn(0x7fa7d00a2170 msgr2=0x7fa7d00a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- 172.21.15.78:0/4089555776 shutdown_connections 2023-06-02T15:31:19.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- 172.21.15.78:0/4089555776 wait complete. 2023-06-02T15:31:19.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 Processor -- start 2023-06-02T15:31:19.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- start start 2023-06-02T15:31:19.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7d006c250 0x7fa7d01ea240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006cfc0 0x7fa7d014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d00a59e0 0x7fa7d00a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00bff80 con 0x7fa7d00a59e0 2023-06-02T15:31:19.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00c0fa0 con 0x7fa7d006c250 2023-06-02T15:31:19.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00bfa00 con 0x7fa7d006cfc0 2023-06-02T15:31:19.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d6248640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d00a59e0 0x7fa7d00a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d6248640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d00a59e0 0x7fa7d00a4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39250/0 (socket says 172.21.15.78:39250) 2023-06-02T15:31:19.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d6248640 1 -- 172.21.15.78:0/3108226152 learned_addr learned my addr 172.21.15.78:0/3108226152 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:19.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d5246640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006cfc0 0x7fa7d014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d5a47640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7d006c250 0x7fa7d01ea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d6248640 1 -- 172.21.15.78:0/3108226152 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006cfc0 msgr2=0x7fa7d014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d6248640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006cfc0 0x7fa7d014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d6248640 1 -- 172.21.15.78:0/3108226152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7d006c250 msgr2=0x7fa7d01ea240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d6248640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7d006c250 0x7fa7d01ea240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d6248640 1 -- 172.21.15.78:0/3108226152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c8009a70 con 0x7fa7d00a59e0 2023-06-02T15:31:19.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d6248640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d00a59e0 0x7fa7d00a4ac0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009d90 tx=0x7fa7c8019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7c67fc640 1 -- 172.21.15.78:0/3108226152 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80ad650 con 0x7fa7d00a59e0 2023-06-02T15:31:19.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7c67fc640 1 -- 172.21.15.78:0/3108226152 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c80ad7b0 con 0x7fa7d00a59e0 2023-06-02T15:31:19.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- 172.21.15.78:0/3108226152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d00a5f40 con 0x7fa7d00a59e0 2023-06-02T15:31:19.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7c67fc640 1 -- 172.21.15.78:0/3108226152 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c80adb60 con 0x7fa7d00a59e0 2023-06-02T15:31:19.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- 172.21.15.78:0/3108226152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d00a5db0 con 0x7fa7d00a59e0 2023-06-02T15:31:19.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.614+0000 7fa7d7cab640 1 -- 172.21.15.78:0/3108226152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d01593f0 con 0x7fa7d00a59e0 2023-06-02T15:31:19.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.618+0000 7fa7c67fc640 1 -- 172.21.15.78:0/3108226152 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fa7c80adcc0 con 0x7fa7d00a59e0 2023-06-02T15:31:19.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.618+0000 7fa7c67fc640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa7b4065c30 0x7fa7b40680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.618+0000 7fa7d5a47640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa7b4065c30 0x7fa7b40680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.618+0000 7fa7c67fc640 1 -- 172.21.15.78:0/3108226152 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa7c811e790 con 0x7fa7d00a59e0 2023-06-02T15:31:19.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.618+0000 7fa7d5a47640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa7b4065c30 0x7fa7b40680e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000a9a0 tx=0x7fa7c0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.622+0000 7fa7c67fc640 1 -- 172.21.15.78:0/3108226152 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fa7c80ebd00 con 0x7fa7d00a59e0 2023-06-02T15:31:19.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.762+0000 7fa7d7cab640 1 -- 172.21.15.78:0/3108226152 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fa7d0145120 con 0x7fa7d00a59e0 2023-06-02T15:31:19.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.762+0000 7fa7c67fc640 1 -- 172.21.15.78:0/3108226152 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7fa7d0145120 con 0x7fa7d00a59e0 2023-06-02T15:31:19.773 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-02T15:31:19.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 -- 172.21.15.78:0/3108226152 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa7b4065c30 msgr2=0x7fa7b40680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa7b4065c30 0x7fa7b40680e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000a9a0 tx=0x7fa7c0008040 comp rx=0 tx=0).stop 2023-06-02T15:31:19.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 -- 172.21.15.78:0/3108226152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d00a59e0 msgr2=0x7fa7d00a4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d00a59e0 0x7fa7d00a4ac0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa7c8009d90 tx=0x7fa7c8019630 comp rx=0 tx=0).stop 2023-06-02T15:31:19.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 -- 172.21.15.78:0/3108226152 shutdown_connections 2023-06-02T15:31:19.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa7b4065c30 0x7fa7b40680e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7d00a59e0 0x7fa7d00a4ac0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa7d006cfc0 0x7fa7d014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 --2- 172.21.15.78:0/3108226152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7d006c250 0x7fa7d01ea240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 -- 172.21.15.78:0/3108226152 >> 172.21.15.78:0/3108226152 conn(0x7fa7d00a2170 msgr2=0x7fa7d00bc030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:19.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 -- 172.21.15.78:0/3108226152 shutdown_connections 2023-06-02T15:31:19.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.766+0000 7fa7d7cab640 1 -- 172.21.15.78:0/3108226152 wait complete. 2023-06-02T15:31:19.789 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-02T15:31:19.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0c2205640 1 Processor -- start 2023-06-02T15:31:19.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0c2205640 1 -- start start 2023-06-02T15:31:19.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0c2205640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0bc06cfc0 0x7fe0bc0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0c2205640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc06c250 0x7fe0bc149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0c2205640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0bc14d220 con 0x7fe0bc0a59e0 2023-06-02T15:31:19.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0c2205640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0bc0ba640 con 0x7fe0bc06cfc0 2023-06-02T15:31:19.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0c2205640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc14cd30 con 0x7fe0bc06c250 2023-06-02T15:31:19.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0bb7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe0bc0a59e0 0x7fe0bc14f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57060/0 (socket says 172.21.15.78:57060) 2023-06-02T15:31:19.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0bb7fe640 1 -- 172.21.15.78:0/3661531189 learned_addr learned my addr 172.21.15.78:0/3661531189 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:19.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2122666983 0 0) 0x7fe0bc14d220 con 0x7fe0bc0a59e0 2023-06-02T15:31:19.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0a4003530 con 0x7fe0bc0a59e0 2023-06-02T15:31:19.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0bbfff640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc06c250 0x7fe0bc149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0baffd640 1 --2- 172.21.15.78:0/3661531189 >> v2:172.21.15.132:3300/0 conn(0x7fe0bc06cfc0 0x7fe0bc0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2717274141 0 0) 0x7fe0a4003530 con 0x7fe0bc0a59e0 2023-06-02T15:31:19.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc06c250 msgr2=0x7fe0bc149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc06c250 0x7fe0bc149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 >> v2:172.21.15.132:3300/0 conn(0x7fe0bc06cfc0 msgr2=0x7fe0bc0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 --2- 172.21.15.78:0/3661531189 >> v2:172.21.15.132:3300/0 conn(0x7fe0bc06cfc0 0x7fe0bc0718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0ba850 con 0x7fe0bc0a59e0 2023-06-02T15:31:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fe0b0001680 con 0x7fe0bc0a59e0 2023-06-02T15:31:19.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0baffd640 1 --2- 172.21.15.78:0/3661531189 >> v2:172.21.15.132:3300/0 conn(0x7fe0bc06cfc0 0x7fe0bc0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 >> v1:172.21.15.78:6789/0 conn(0x7fe0bc0a59e0 legacy=0x7fe0bc14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a40039f0 0x7fe0a4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 0x7fe0a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc06c250 0x7fe0a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc0ba640 con 0x7fe0a40047d0 2023-06-02T15:31:19.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc14cd30 con 0x7fe0a40039f0 2023-06-02T15:31:19.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a400bb40 con 0x7fe0bc06c250 2023-06-02T15:31:19.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0baffd640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 0x7fe0a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0bb7fe640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a40039f0 0x7fe0a4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0bbfff640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc06c250 0x7fe0a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0baffd640 1 -- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc06c250 msgr2=0x7fe0a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0baffd640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc06c250 0x7fe0a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0baffd640 1 -- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a40039f0 msgr2=0x7fe0a4003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:19.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0baffd640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a40039f0 0x7fe0a4003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0baffd640 1 -- 172.21.15.78:0/3661531189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a4003530 con 0x7fe0a40047d0 2023-06-02T15:31:19.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.890+0000 7fe0bbfff640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc06c250 0x7fe0a40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:19.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0baffd640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 0x7fe0a4004c40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0098a0 tx=0x7fe0ac01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c21fa7ec50226c server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0ab650 con 0x7fe0a40047d0 2023-06-02T15:31:19.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0ac0ab7b0 con 0x7fe0a40047d0 2023-06-02T15:31:19.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0ba7fc640 1 -- 172.21.15.78:0/3661531189 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0abb40 con 0x7fe0a40047d0 2023-06-02T15:31:19.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 -- 172.21.15.78:0/3661531189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 msgr2=0x7fe0a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 --2- 172.21.15.78:0/3661531189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 0x7fe0a4004c40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0098a0 tx=0x7fe0ac01c500 comp rx=0 tx=0).stop 2023-06-02T15:31:19.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0bbfff640 1 -- 172.21.15.78:0/3661531189 reap_dead start 2023-06-02T15:31:19.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 -- 172.21.15.78:0/3661531189 shutdown_connections 2023-06-02T15:31:19.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 -- 172.21.15.78:0/3661531189 >> 172.21.15.78:0/3661531189 conn(0x7fe0bc0a2170 msgr2=0x7fe0bc0a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:19.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 -- 172.21.15.78:0/3661531189 shutdown_connections 2023-06-02T15:31:19.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 -- 172.21.15.78:0/3661531189 wait complete. 2023-06-02T15:31:19.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 Processor -- start 2023-06-02T15:31:19.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 -- start start 2023-06-02T15:31:19.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 0x7fe0bc14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc150580 0x7fe0bc14b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc14b6b0 0x7fe0bc1441c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc1e5040 con 0x7fe0a40047d0 2023-06-02T15:31:19.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc145060 con 0x7fe0bc150580 2023-06-02T15:31:19.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0c2205640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0bc1517a0 con 0x7fe0bc14b6b0 2023-06-02T15:31:19.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 0x7fe0bc14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0bb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 0x7fe0bc14e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39270/0 (socket says 172.21.15.78:39270) 2023-06-02T15:31:19.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0bb7fe640 1 -- 172.21.15.78:0/3702786303 learned_addr learned my addr 172.21.15.78:0/3702786303 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:19.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0baffd640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc150580 0x7fe0bc14b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0bbfff640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc14b6b0 0x7fe0bc1441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0bb7fe640 1 -- 172.21.15.78:0/3702786303 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc14b6b0 msgr2=0x7fe0bc1441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0bb7fe640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc14b6b0 0x7fe0bc1441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0bb7fe640 1 -- 172.21.15.78:0/3702786303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc150580 msgr2=0x7fe0bc14b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:19.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0bb7fe640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc150580 0x7fe0bc14b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:19.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0bb7fe640 1 -- 172.21.15.78:0/3702786303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0bc0a5f40 con 0x7fe0a40047d0 2023-06-02T15:31:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.894+0000 7fe0baffd640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc150580 0x7fe0bc14b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0bb7fe640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 0x7fe0bc14e7b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0005fd0 tx=0x7fe0b000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0a3fff640 1 -- 172.21.15.78:0/3702786303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000c870 con 0x7fe0a40047d0 2023-06-02T15:31:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0a3fff640 1 -- 172.21.15.78:0/3702786303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b000c9f0 con 0x7fe0a40047d0 2023-06-02T15:31:19.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0c2205640 1 -- 172.21.15.78:0/3702786303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0bc0a5db0 con 0x7fe0a40047d0 2023-06-02T15:31:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0a3fff640 1 -- 172.21.15.78:0/3702786303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000cda0 con 0x7fe0a40047d0 2023-06-02T15:31:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0c2205640 1 -- 172.21.15.78:0/3702786303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0bc156bd0 con 0x7fe0a40047d0 2023-06-02T15:31:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0c2205640 1 -- 172.21.15.78:0/3702786303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0bc073bc0 con 0x7fe0a40047d0 2023-06-02T15:31:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0a3fff640 1 -- 172.21.15.78:0/3702786303 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fe0b001d460 con 0x7fe0a40047d0 2023-06-02T15:31:19.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0a3fff640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe0a8065c00 0x7fe0a80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:19.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0baffd640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe0a8065c00 0x7fe0a80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:19.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0a3fff640 1 -- 172.21.15.78:0/3702786303 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe0b0083750 con 0x7fe0a40047d0 2023-06-02T15:31:19.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.898+0000 7fe0baffd640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe0a8065c00 0x7fe0a80680b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0af000 tx=0x7fe0ac0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:19.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:19.902+0000 7fe0a3fff640 1 -- 172.21.15.78:0/3702786303 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fe0b0050ba0 con 0x7fe0a40047d0 2023-06-02T15:31:20.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 -- 172.21.15.78:0/3702786303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0bc14f590 con 0x7fe0a40047d0 2023-06-02T15:31:20.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0a3fff640 1 -- 172.21.15.78:0/3702786303 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe0b00541c0 con 0x7fe0a40047d0 2023-06-02T15:31:20.050 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-02T15:31:20.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 -- 172.21.15.78:0/3702786303 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe0a8065c00 msgr2=0x7fe0a80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe0a8065c00 0x7fe0a80680b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac0af000 tx=0x7fe0ac0046d0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 -- 172.21.15.78:0/3702786303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 msgr2=0x7fe0bc14e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 0x7fe0bc14e7b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe0b0005fd0 tx=0x7fe0b000ec90 comp rx=0 tx=0).stop 2023-06-02T15:31:20.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 -- 172.21.15.78:0/3702786303 shutdown_connections 2023-06-02T15:31:20.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe0bc14b6b0 0x7fe0bc1441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0bc150580 0x7fe0bc14b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe0a8065c00 0x7fe0a80680b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 --2- 172.21.15.78:0/3702786303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe0a40047d0 0x7fe0bc14e7b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 -- 172.21.15.78:0/3702786303 >> 172.21.15.78:0/3702786303 conn(0x7fe0bc0a2170 msgr2=0x7fe0bc0bcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:20.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 -- 172.21.15.78:0/3702786303 shutdown_connections 2023-06-02T15:31:20.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.042+0000 7fe0c2205640 1 -- 172.21.15.78:0/3702786303 wait complete. 2023-06-02T15:31:20.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-02T15:31:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.166+0000 7f71021a0640 1 Processor -- start 2023-06-02T15:31:20.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.166+0000 7f71021a0640 1 -- start start 2023-06-02T15:31:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f71021a0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f70fc0a59e0 0x7f70fc0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f71021a0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70fc06c250 0x7f70fc149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f71021a0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70fc14d220 con 0x7f70fc06cfc0 2023-06-02T15:31:20.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f71021a0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0ba640 con 0x7f70fc0a59e0 2023-06-02T15:31:20.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f71021a0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc14cd30 con 0x7f70fc06c250 2023-06-02T15:31:20.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70faffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f70fc06cfc0 0x7f70fc14f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57064/0 (socket says 172.21.15.78:57064) 2023-06-02T15:31:20.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70faffd640 1 -- 172.21.15.78:0/2388218025 learned_addr learned my addr 172.21.15.78:0/2388218025 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865472014 0 0) 0x7f70fc14d220 con 0x7f70fc06cfc0 2023-06-02T15:31:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fb7fe640 1 --2- 172.21.15.78:0/2388218025 >> v2:172.21.15.132:3300/0 conn(0x7f70fc0a59e0 0x7f70fc0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fbfff640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70fc06c250 0x7f70fc149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70e8003530 con 0x7f70fc06cfc0 2023-06-02T15:31:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2781206759 0 0) 0x7f70e8003530 con 0x7f70fc06cfc0 2023-06-02T15:31:20.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70fc06c250 msgr2=0x7f70fc149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70fc06c250 0x7f70fc149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 >> v2:172.21.15.132:3300/0 conn(0x7f70fc0a59e0 msgr2=0x7f70fc0718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 --2- 172.21.15.78:0/2388218025 >> v2:172.21.15.132:3300/0 conn(0x7f70fc0a59e0 0x7f70fc0718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc0ba850 con 0x7f70fc06cfc0 2023-06-02T15:31:20.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f70ec001680 con 0x7f70fc06cfc0 2023-06-02T15:31:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 >> v1:172.21.15.78:6789/0 conn(0x7f70fc06cfc0 legacy=0x7f70fc14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70e80039f0 0x7f70e8003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70e80047d0 0x7f70e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8005180 0x7f70e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc0ba640 con 0x7f70e8005180 2023-06-02T15:31:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc14cd30 con 0x7f70e80047d0 2023-06-02T15:31:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e800c090 con 0x7f70e80039f0 2023-06-02T15:31:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fb7fe640 1 --2- 172.21.15.78:0/2388218025 >> v2:172.21.15.132:3300/0 conn(0x7f70fc0a59e0 0x7f70fc0718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fbfff640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70fc06c250 0x7f70fc149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:20.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fbfff640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8005180 0x7f70e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70faffd640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70e80047d0 0x7f70e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fb7fe640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70e80039f0 0x7f70e8003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fbfff640 1 -- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70e80039f0 msgr2=0x7f70e8003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fbfff640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70e80039f0 0x7f70e8003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fbfff640 1 -- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70e80047d0 msgr2=0x7f70e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:20.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fbfff640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70e80047d0 0x7f70e8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fbfff640 1 -- 172.21.15.78:0/2388218025 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e8003530 con 0x7f70e8005180 2023-06-02T15:31:20.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fbfff640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8005180 0x7f70e800b990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f70fc06c620 tx=0x7f70e401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b0c18a9621f3113 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:20.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40ab600 con 0x7f70e8005180 2023-06-02T15:31:20.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e40a7050 con 0x7f70e8005180 2023-06-02T15:31:20.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.170+0000 7f70fa7fc640 1 -- 172.21.15.78:0/2388218025 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40ab980 con 0x7f70e8005180 2023-06-02T15:31:20.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- 172.21.15.78:0/2388218025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8005180 msgr2=0x7f70e800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 --2- 172.21.15.78:0/2388218025 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70e8005180 0x7f70e800b990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f70fc06c620 tx=0x7f70e401c3f0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fbfff640 1 -- 172.21.15.78:0/2388218025 reap_dead start 2023-06-02T15:31:20.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- 172.21.15.78:0/2388218025 shutdown_connections 2023-06-02T15:31:20.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- 172.21.15.78:0/2388218025 >> 172.21.15.78:0/2388218025 conn(0x7f70fc0a2170 msgr2=0x7f70fc0a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:20.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- 172.21.15.78:0/2388218025 shutdown_connections 2023-06-02T15:31:20.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- 172.21.15.78:0/2388218025 wait complete. 2023-06-02T15:31:20.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 Processor -- start 2023-06-02T15:31:20.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- start start 2023-06-02T15:31:20.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70e8005180 0x7f70fc14bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70fc0a1d90 0x7f70fc1e15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70fc14a100 0x7f70fc0b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc14c1e0 con 0x7f70fc14a100 2023-06-02T15:31:20.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc14b9c0 con 0x7f70e8005180 2023-06-02T15:31:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc14a5a0 con 0x7f70fc0a1d90 2023-06-02T15:31:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70fc14a100 0x7f70fc0b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70fc14a100 0x7f70fc0b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39290/0 (socket says 172.21.15.78:39290) 2023-06-02T15:31:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fbfff640 1 -- 172.21.15.78:0/4120796012 learned_addr learned my addr 172.21.15.78:0/4120796012 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fbfff640 1 -- 172.21.15.78:0/4120796012 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70fc0a1d90 msgr2=0x7f70fc1e15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fbfff640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70fc0a1d90 0x7f70fc1e15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fb7fe640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70e8005180 0x7f70fc14bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fbfff640 1 -- 172.21.15.78:0/4120796012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70e8005180 msgr2=0x7f70fc14bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fbfff640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70e8005180 0x7f70fc14bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fbfff640 1 -- 172.21.15.78:0/4120796012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc14ff50 con 0x7f70fc14a100 2023-06-02T15:31:20.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70fbfff640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70fc14a100 0x7f70fc0b55b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f70e401c220 tx=0x7f70e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70f3fff640 1 -- 172.21.15.78:0/4120796012 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40abdb0 con 0x7f70fc14a100 2023-06-02T15:31:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70f3fff640 1 -- 172.21.15.78:0/4120796012 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e40b5410 con 0x7f70fc14a100 2023-06-02T15:31:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- 172.21.15.78:0/4120796012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc14cf40 con 0x7f70fc14a100 2023-06-02T15:31:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f70f3fff640 1 -- 172.21.15.78:0/4120796012 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e40b57a0 con 0x7f70fc14a100 2023-06-02T15:31:20.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.174+0000 7f71021a0640 1 -- 172.21.15.78:0/4120796012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc0a5db0 con 0x7f70fc14a100 2023-06-02T15:31:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.178+0000 7f71021a0640 1 -- 172.21.15.78:0/4120796012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc073bc0 con 0x7f70fc14a100 2023-06-02T15:31:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.178+0000 7f70f3fff640 1 -- 172.21.15.78:0/4120796012 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f70e40b2050 con 0x7f70fc14a100 2023-06-02T15:31:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.178+0000 7f70f3fff640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f70dc065c30 0x7f70dc0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.178+0000 7f70f3fff640 1 -- 172.21.15.78:0/4120796012 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f70e411d490 con 0x7f70fc14a100 2023-06-02T15:31:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.178+0000 7f70fb7fe640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f70dc065c30 0x7f70dc0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.178+0000 7f70fb7fe640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f70dc065c30 0x7f70dc0680e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f70f40098c0 tx=0x7f70f400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:20.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.182+0000 7f70f3fff640 1 -- 172.21.15.78:0/4120796012 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f70e40ea970 con 0x7f70fc14a100 2023-06-02T15:31:20.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 -- 172.21.15.78:0/4120796012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70fc0b5af0 con 0x7f70fc14a100 2023-06-02T15:31:20.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f70f3fff640 1 -- 172.21.15.78:0/4120796012 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70e40edf90 con 0x7f70fc14a100 2023-06-02T15:31:20.342 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 -- 172.21.15.78:0/4120796012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f70dc065c30 msgr2=0x7f70dc0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f70dc065c30 0x7f70dc0680e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f70f40098c0 tx=0x7f70f400b040 comp rx=0 tx=0).stop 2023-06-02T15:31:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 -- 172.21.15.78:0/4120796012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70fc14a100 msgr2=0x7f70fc0b55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70fc14a100 0x7f70fc0b55b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f70e401c220 tx=0x7f70e8005800 comp rx=0 tx=0).stop 2023-06-02T15:31:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 -- 172.21.15.78:0/4120796012 shutdown_connections 2023-06-02T15:31:20.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f70dc065c30 0x7f70dc0680e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f70fc14a100 0x7f70fc0b55b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f70fc0a1d90 0x7f70fc1e15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 --2- 172.21.15.78:0/4120796012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70e8005180 0x7f70fc14bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 -- 172.21.15.78:0/4120796012 >> 172.21.15.78:0/4120796012 conn(0x7f70fc0a2170 msgr2=0x7f70fc1d4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:20.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 -- 172.21.15.78:0/4120796012 shutdown_connections 2023-06-02T15:31:20.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.334+0000 7f71021a0640 1 -- 172.21.15.78:0/4120796012 wait complete. 2023-06-02T15:31:20.360 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-02T15:31:20.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.474+0000 7f7613768640 1 Processor -- start 2023-06-02T15:31:20.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.474+0000 7f7613768640 1 -- start start 2023-06-02T15:31:20.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7613768640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f760c0a2ca0 0x7f760c14be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7613768640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f760c1482e0 0x7f760c148720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7613768640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f760c06d620 con 0x7f760c0a3370 2023-06-02T15:31:20.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7613768640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0a71b0 con 0x7f760c1482e0 2023-06-02T15:31:20.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7613768640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f760c0a6ed0 con 0x7f760c0a2ca0 2023-06-02T15:31:20.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7611d05640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f760c1482e0 0x7f760c148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7611504640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f760c0a3370 0x7f760c06cf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57078/0 (socket says 172.21.15.78:57078) 2023-06-02T15:31:20.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7611504640 1 -- 172.21.15.78:0/619151833 learned_addr learned my addr 172.21.15.78:0/619151833 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:20.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7610d03640 1 --2- 172.21.15.78:0/619151833 >> v2:172.21.15.132:3300/0 conn(0x7f760c0a2ca0 0x7f760c14be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7611d05640 1 -- 172.21.15.78:0/619151833 >> v2:172.21.15.132:3300/0 conn(0x7f760c0a2ca0 msgr2=0x7f760c14be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:20.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7611d05640 1 --2- 172.21.15.78:0/619151833 >> v2:172.21.15.132:3300/0 conn(0x7f760c0a2ca0 0x7f760c14be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7611d05640 1 -- 172.21.15.78:0/619151833 >> v1:172.21.15.78:6789/0 conn(0x7f760c0a3370 legacy=0x7f760c06cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7603fff640 1 -- 172.21.15.78:0/619151833 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812077811 0 0) 0x7f760c06d620 con 0x7f760c0a3370 2023-06-02T15:31:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7611d05640 1 -- 172.21.15.78:0/619151833 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c14b390 con 0x7f760c1482e0 2023-06-02T15:31:20.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7610d03640 1 --2- 172.21.15.78:0/619151833 >> v2:172.21.15.132:3300/0 conn(0x7f760c0a2ca0 0x7f760c14be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.478+0000 7f7611d05640 1 --2- 172.21.15.78:0/619151833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c1482e0 0x7f760c148720 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f760c0bba20 tx=0x7f760401c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f87c63997c9c69 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7603fff640 1 -- 172.21.15.78:0/619151833 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76040a59a0 con 0x7f760c1482e0 2023-06-02T15:31:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7603fff640 1 -- 172.21.15.78:0/619151833 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76040a5b00 con 0x7f760c1482e0 2023-06-02T15:31:20.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7603fff640 1 -- 172.21.15.78:0/619151833 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76040a5e90 con 0x7f760c1482e0 2023-06-02T15:31:20.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 -- 172.21.15.78:0/619151833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c1482e0 msgr2=0x7f760c148720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 --2- 172.21.15.78:0/619151833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c1482e0 0x7f760c148720 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f760c0bba20 tx=0x7f760401c8e0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 -- 172.21.15.78:0/619151833 shutdown_connections 2023-06-02T15:31:20.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 --2- 172.21.15.78:0/619151833 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c1482e0 0x7f760c148720 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 --2- 172.21.15.78:0/619151833 >> v2:172.21.15.132:3300/0 conn(0x7f760c0a2ca0 0x7f760c14be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 -- 172.21.15.78:0/619151833 >> 172.21.15.78:0/619151833 conn(0x7f760c0c14b0 msgr2=0x7f760c0c18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:20.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 -- 172.21.15.78:0/619151833 shutdown_connections 2023-06-02T15:31:20.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 -- 172.21.15.78:0/619151833 wait complete. 2023-06-02T15:31:20.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 Processor -- start 2023-06-02T15:31:20.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 -- start start 2023-06-02T15:31:20.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f760c0a2ca0 0x7f760c14d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c0a3370 0x7f760c070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f760c1482e0 0x7f760c13e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c14d200 con 0x7f760c0a3370 2023-06-02T15:31:20.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f760c14db60 con 0x7f760c1482e0 2023-06-02T15:31:20.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7613768640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f760c14c8f0 con 0x7f760c0a2ca0 2023-06-02T15:31:20.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7610d03640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c0a3370 0x7f760c070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7610d03640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c0a3370 0x7f760c070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39318/0 (socket says 172.21.15.78:39318) 2023-06-02T15:31:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7610d03640 1 -- 172.21.15.78:0/4187489739 learned_addr learned my addr 172.21.15.78:0/4187489739 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7611504640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f760c0a2ca0 0x7f760c14d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7611d05640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f760c1482e0 0x7f760c13e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7610d03640 1 -- 172.21.15.78:0/4187489739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f760c0a2ca0 msgr2=0x7f760c14d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7610d03640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f760c0a2ca0 0x7f760c14d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7610d03640 1 -- 172.21.15.78:0/4187489739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f760c1482e0 msgr2=0x7f760c13e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7610d03640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f760c1482e0 0x7f760c13e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.482+0000 7f7610d03640 1 -- 172.21.15.78:0/4187489739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7604009a70 con 0x7f760c0a3370 2023-06-02T15:31:20.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7610d03640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c0a3370 0x7f760c070f70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c7f0 tx=0x7f75fc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7601ffb640 1 -- 172.21.15.78:0/4187489739 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc00cea0 con 0x7f760c0a3370 2023-06-02T15:31:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7601ffb640 1 -- 172.21.15.78:0/4187489739 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75fc0079d0 con 0x7f760c0a3370 2023-06-02T15:31:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7613768640 1 -- 172.21.15.78:0/4187489739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f760c0bc9b0 con 0x7f760c0a3370 2023-06-02T15:31:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7601ffb640 1 -- 172.21.15.78:0/4187489739 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75fc007d80 con 0x7f760c0a3370 2023-06-02T15:31:20.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7613768640 1 -- 172.21.15.78:0/4187489739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f760c148c60 con 0x7f760c0a3370 2023-06-02T15:31:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7613768640 1 -- 172.21.15.78:0/4187489739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f760c0a3740 con 0x7f760c0a3370 2023-06-02T15:31:20.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7601ffb640 1 -- 172.21.15.78:0/4187489739 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f75fc0113f0 con 0x7f760c0a3370 2023-06-02T15:31:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7601ffb640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f75f0065c00 0x7f75f00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7601ffb640 1 -- 172.21.15.78:0/4187489739 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f75fc0836b0 con 0x7f760c0a3370 2023-06-02T15:31:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7611504640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f75f0065c00 0x7f75f00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.486+0000 7f7611504640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f75f0065c00 0x7f75f00680b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7608000f70 tx=0x7f7608007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:20.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.490+0000 7f7601ffb640 1 -- 172.21.15.78:0/4187489739 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f75fc050c20 con 0x7f760c0a3370 2023-06-02T15:31:20.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.630+0000 7f7613768640 1 -- 172.21.15.78:0/4187489739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f760c073bc0 con 0x7f760c0a3370 2023-06-02T15:31:20.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.630+0000 7f7601ffb640 1 -- 172.21.15.78:0/4187489739 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f75fc054240 con 0x7f760c0a3370 2023-06-02T15:31:20.640 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-02T15:31:20.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 -- 172.21.15.78:0/4187489739 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f75f0065c00 msgr2=0x7f75f00680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f75f0065c00 0x7f75f00680b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7608000f70 tx=0x7f7608007b60 comp rx=0 tx=0).stop 2023-06-02T15:31:20.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 -- 172.21.15.78:0/4187489739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c0a3370 msgr2=0x7f760c070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c0a3370 0x7f760c070f70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c7f0 tx=0x7f75fc00ccb0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 -- 172.21.15.78:0/4187489739 shutdown_connections 2023-06-02T15:31:20.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f760c1482e0 0x7f760c13e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f75f0065c00 0x7f75f00680b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f760c0a3370 0x7f760c070f70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 --2- 172.21.15.78:0/4187489739 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f760c0a2ca0 0x7f760c14d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 -- 172.21.15.78:0/4187489739 >> 172.21.15.78:0/4187489739 conn(0x7f760c0c14b0 msgr2=0x7f760c0bf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:20.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 -- 172.21.15.78:0/4187489739 shutdown_connections 2023-06-02T15:31:20.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.634+0000 7f7613768640 1 -- 172.21.15.78:0/4187489739 wait complete. 2023-06-02T15:31:20.657 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-02T15:31:20.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.766+0000 7f20d1ade640 1 Processor -- start 2023-06-02T15:31:20.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.766+0000 7f20d1ade640 1 -- start start 2023-06-02T15:31:20.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20d1ade640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f20cc0c0570 0x7f20cc0ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20d1ade640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20cc071780 0x7f20cc0bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20d1ade640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20cc0a5f30 con 0x7f20cc1485c0 2023-06-02T15:31:20.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20d1ade640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20cc0c1100 con 0x7f20cc0c0570 2023-06-02T15:31:20.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20d1ade640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc14bcc0 con 0x7f20cc071780 2023-06-02T15:31:20.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20cb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f20cc0c0570 0x7f20cc0ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20cb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f20cc0c0570 0x7f20cc0ba640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39322/0 (socket says 172.21.15.78:39322) 2023-06-02T15:31:20.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20cb7fe640 1 -- 172.21.15.78:0/2819635097 learned_addr learned my addr 172.21.15.78:0/2819635097 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:20.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20cb7fe640 1 -- 172.21.15.78:0/2819635097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20cc071780 msgr2=0x7f20cc0bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:20.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20cb7fe640 1 --2- 172.21.15.78:0/2819635097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20cc071780 0x7f20cc0bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20cb7fe640 1 -- 172.21.15.78:0/2819635097 >> v1:172.21.15.132:6789/0 conn(0x7f20cc1485c0 legacy=0x7f20cc14e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:20.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20cb7fe640 1 -- 172.21.15.78:0/2819635097 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20cc14bfa0 con 0x7f20cc0c0570 2023-06-02T15:31:20.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20cb7fe640 1 --2- 172.21.15.78:0/2819635097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 0x7f20cc0ba640 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00bb40 tx=0x7f20bc01eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee986506f3f79e9 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:20.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20ca7fc640 1 -- 172.21.15.78:0/2819635097 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0a7b20 con 0x7f20cc0c0570 2023-06-02T15:31:20.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20ca7fc640 1 -- 172.21.15.78:0/2819635097 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20bc0a7c80 con 0x7f20cc0c0570 2023-06-02T15:31:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.770+0000 7f20ca7fc640 1 -- 172.21.15.78:0/2819635097 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20bc0af440 con 0x7f20cc0c0570 2023-06-02T15:31:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- 172.21.15.78:0/2819635097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 msgr2=0x7f20cc0ba640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 --2- 172.21.15.78:0/2819635097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 0x7f20cc0ba640 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f20bc00bb40 tx=0x7f20bc01eb80 comp rx=0 tx=0).stop 2023-06-02T15:31:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- 172.21.15.78:0/2819635097 shutdown_connections 2023-06-02T15:31:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 --2- 172.21.15.78:0/2819635097 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20cc071780 0x7f20cc0bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 --2- 172.21.15.78:0/2819635097 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 0x7f20cc0ba640 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- 172.21.15.78:0/2819635097 >> 172.21.15.78:0/2819635097 conn(0x7f20cc0a2170 msgr2=0x7f20cc0a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- 172.21.15.78:0/2819635097 shutdown_connections 2023-06-02T15:31:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- 172.21.15.78:0/2819635097 wait complete. 2023-06-02T15:31:20.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 Processor -- start 2023-06-02T15:31:20.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- start start 2023-06-02T15:31:20.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20cc071780 0x7f20cc1e3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 0x7f20cc0bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20cc1485c0 0x7f20cc0bdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc0be810 con 0x7f20cc0c0570 2023-06-02T15:31:20.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc1e39d0 con 0x7f20cc071780 2023-06-02T15:31:20.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20cc13e7c0 con 0x7f20cc1485c0 2023-06-02T15:31:20.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20caffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 0x7f20cc0bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20caffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 0x7f20cc0bec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39338/0 (socket says 172.21.15.78:39338) 2023-06-02T15:31:20.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20caffd640 1 -- 172.21.15.78:0/3595516410 learned_addr learned my addr 172.21.15.78:0/3595516410 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:20.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20cbfff640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20cc1485c0 0x7f20cc0bdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20caffd640 1 -- 172.21.15.78:0/3595516410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20cc1485c0 msgr2=0x7f20cc0bdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20caffd640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20cc1485c0 0x7f20cc0bdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20caffd640 1 -- 172.21.15.78:0/3595516410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20cc071780 msgr2=0x7f20cc1e3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20cb7fe640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20cc071780 0x7f20cc1e3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20caffd640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20cc071780 0x7f20cc1e3490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20caffd640 1 -- 172.21.15.78:0/3595516410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc00b770 con 0x7f20cc0c0570 2023-06-02T15:31:20.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20cbfff640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20cc1485c0 0x7f20cc0bdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:20.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20caffd640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 0x7f20cc0bec00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20c000b580 tx=0x7f20c000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:20.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20b3fff640 1 -- 172.21.15.78:0/3595516410 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0010870 con 0x7f20cc0c0570 2023-06-02T15:31:20.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20b3fff640 1 -- 172.21.15.78:0/3595516410 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c00109f0 con 0x7f20cc0c0570 2023-06-02T15:31:20.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- 172.21.15.78:0/3595516410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20cc0c0940 con 0x7f20cc0c0570 2023-06-02T15:31:20.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20b3fff640 1 -- 172.21.15.78:0/3595516410 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c0010da0 con 0x7f20cc0c0570 2023-06-02T15:31:20.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- 172.21.15.78:0/3595516410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20cc148e50 con 0x7f20cc0c0570 2023-06-02T15:31:20.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.774+0000 7f20d1ade640 1 -- 172.21.15.78:0/3595516410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20cc0c0ad0 con 0x7f20cc0c0570 2023-06-02T15:31:20.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.778+0000 7f20b3fff640 1 -- 172.21.15.78:0/3595516410 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f20c000f3c0 con 0x7f20cc0c0570 2023-06-02T15:31:20.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.778+0000 7f20b3fff640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f20b8065c00 0x7f20b80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:20.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.778+0000 7f20b3fff640 1 -- 172.21.15.78:0/3595516410 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f20c00835e0 con 0x7f20cc0c0570 2023-06-02T15:31:20.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.778+0000 7f20cb7fe640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f20b8065c00 0x7f20b80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:20.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.778+0000 7f20cb7fe640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f20b8065c00 0x7f20b80680b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0b1000 tx=0x7f20bc0a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:20.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.782+0000 7f20b3fff640 1 -- 172.21.15.78:0/3595516410 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f20c0050ad0 con 0x7f20cc0c0570 2023-06-02T15:31:20.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.922+0000 7f20d1ade640 1 -- 172.21.15.78:0/3595516410 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f20cc073bc0 con 0x7f20cc0c0570 2023-06-02T15:31:20.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.922+0000 7f20b3fff640 1 -- 172.21.15.78:0/3595516410 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f20c00540f0 con 0x7f20cc0c0570 2023-06-02T15:31:20.932 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:20.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 -- 172.21.15.78:0/3595516410 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f20b8065c00 msgr2=0x7f20b80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f20b8065c00 0x7f20b80680b0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f20bc0b1000 tx=0x7f20bc0a9070 comp rx=0 tx=0).stop 2023-06-02T15:31:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 -- 172.21.15.78:0/3595516410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 msgr2=0x7f20cc0bec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 0x7f20cc0bec00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f20c000b580 tx=0x7f20c000ba40 comp rx=0 tx=0).stop 2023-06-02T15:31:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 -- 172.21.15.78:0/3595516410 shutdown_connections 2023-06-02T15:31:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f20cc1485c0 0x7f20cc0bdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f20b8065c00 0x7f20b80680b0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f20cc0c0570 0x7f20cc0bec00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 --2- 172.21.15.78:0/3595516410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20cc071780 0x7f20cc1e3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:20.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 -- 172.21.15.78:0/3595516410 >> 172.21.15.78:0/3595516410 conn(0x7f20cc0a2170 msgr2=0x7f20cc149b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:20.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 -- 172.21.15.78:0/3595516410 shutdown_connections 2023-06-02T15:31:20.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:20.926+0000 7f20d1ade640 1 -- 172.21.15.78:0/3595516410 wait complete. 2023-06-02T15:31:20.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-02T15:31:21.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a7919640 1 Processor -- start 2023-06-02T15:31:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a7919640 1 -- start start 2023-06-02T15:31:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a7919640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8a014bdb0 0x7fa8a00c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a7919640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8a014e540 0x7fa8a014e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a7919640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a00c3fa0 con 0x7fa8a00a3ed0 2023-06-02T15:31:21.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a7919640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a00a96f0 con 0x7fa8a014e540 2023-06-02T15:31:21.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a7919640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00c3690 con 0x7fa8a014bdb0 2023-06-02T15:31:21.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a4eb4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa8a00a3ed0 0x7fa8a00c2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57090/0 (socket says 172.21.15.78:57090) 2023-06-02T15:31:21.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a4eb4640 1 -- 172.21.15.78:0/3226437681 learned_addr learned my addr 172.21.15.78:0/3226437681 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:21.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a56b5640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8a014bdb0 0x7fa8a00c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a5eb6640 1 --2- 172.21.15.78:0/3226437681 >> v2:172.21.15.132:3300/0 conn(0x7fa8a014e540 0x7fa8a014e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1760298017 0 0) 0x7fa8a00c3fa0 con 0x7fa8a00a3ed0 2023-06-02T15:31:21.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa88c003530 con 0x7fa8a00a3ed0 2023-06-02T15:31:21.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3804216969 0 0) 0x7fa88c003530 con 0x7fa8a00a3ed0 2023-06-02T15:31:21.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8a014bdb0 msgr2=0x7fa8a00c3150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:21.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8a014bdb0 0x7fa8a00c3150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 >> v2:172.21.15.132:3300/0 conn(0x7fa8a014e540 msgr2=0x7fa8a014e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 --2- 172.21.15.78:0/3226437681 >> v2:172.21.15.132:3300/0 conn(0x7fa8a014e540 0x7fa8a014e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00a98e0 con 0x7fa8a00a3ed0 2023-06-02T15:31:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fa890001680 con 0x7fa8a00a3ed0 2023-06-02T15:31:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 >> v1:172.21.15.78:6789/0 conn(0x7fa8a00a3ed0 legacy=0x7fa8a00c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa88c0039f0 0x7fa88c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88c0047d0 0x7fa88c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8a014bdb0 0x7fa88c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a00c3690 con 0x7fa88c0047d0 2023-06-02T15:31:21.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c00b990 con 0x7fa88c0039f0 2023-06-02T15:31:21.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c00bb00 con 0x7fa8a014bdb0 2023-06-02T15:31:21.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a4eb4640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88c0047d0 0x7fa88c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a4eb4640 1 -- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8a014bdb0 msgr2=0x7fa88c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:21.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a5eb6640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8a014bdb0 0x7fa88c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a56b5640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa88c0039f0 0x7fa88c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a4eb4640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa8a014bdb0 0x7fa88c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a4eb4640 1 -- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa88c0039f0 msgr2=0x7fa88c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:21.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a4eb4640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa88c0039f0 0x7fa88c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a4eb4640 1 -- 172.21.15.78:0/3226437681 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c003530 con 0x7fa88c0047d0 2023-06-02T15:31:21.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.050+0000 7fa8a56b5640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa88c0039f0 0x7fa88c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:21.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa8a4eb4640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88c0047d0 0x7fa88c004c40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c240 tx=0x7fa89001cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b227b1c8cf760309 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:21.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900a5960 con 0x7fa88c0047d0 2023-06-02T15:31:21.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8900a5ac0 con 0x7fa88c0047d0 2023-06-02T15:31:21.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa897fff640 1 -- 172.21.15.78:0/3226437681 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8900a5e90 con 0x7fa88c0047d0 2023-06-02T15:31:21.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa8a7919640 1 -- 172.21.15.78:0/3226437681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88c0047d0 msgr2=0x7fa88c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa8a7919640 1 --2- 172.21.15.78:0/3226437681 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa88c0047d0 0x7fa88c004c40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa89000c240 tx=0x7fa89001cc00 comp rx=0 tx=0).stop 2023-06-02T15:31:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa8a5eb6640 1 -- 172.21.15.78:0/3226437681 reap_dead start 2023-06-02T15:31:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa8a7919640 1 -- 172.21.15.78:0/3226437681 shutdown_connections 2023-06-02T15:31:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa8a7919640 1 -- 172.21.15.78:0/3226437681 >> 172.21.15.78:0/3226437681 conn(0x7fa8a00a6470 msgr2=0x7fa8a00a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa8a7919640 1 -- 172.21.15.78:0/3226437681 shutdown_connections 2023-06-02T15:31:21.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa8a7919640 1 -- 172.21.15.78:0/3226437681 wait complete. 2023-06-02T15:31:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa8a7919640 1 Processor -- start 2023-06-02T15:31:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.054+0000 7fa8a7919640 1 -- start start 2023-06-02T15:31:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a7919640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa88c0047d0 0x7fa8a0150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a7919640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a00c1810 0x7fa8a006b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a7919640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8a01e75b0 0x7fa8a00c09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a7919640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0149d80 con 0x7fa8a01e75b0 2023-06-02T15:31:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a7919640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a0151a00 con 0x7fa8a00c1810 2023-06-02T15:31:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a7919640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a01529a0 con 0x7fa88c0047d0 2023-06-02T15:31:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a5eb6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8a01e75b0 0x7fa8a00c09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a5eb6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8a01e75b0 0x7fa8a00c09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39354/0 (socket says 172.21.15.78:39354) 2023-06-02T15:31:21.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a5eb6640 1 -- 172.21.15.78:0/2539490239 learned_addr learned my addr 172.21.15.78:0/2539490239 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a56b5640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa88c0047d0 0x7fa8a0150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a4eb4640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a00c1810 0x7fa8a006b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a5eb6640 1 -- 172.21.15.78:0/2539490239 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa88c0047d0 msgr2=0x7fa8a0150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a5eb6640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa88c0047d0 0x7fa8a0150c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a5eb6640 1 -- 172.21.15.78:0/2539490239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a00c1810 msgr2=0x7fa8a006b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a5eb6640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a00c1810 0x7fa8a006b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a5eb6640 1 -- 172.21.15.78:0/2539490239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a00c2e70 con 0x7fa8a01e75b0 2023-06-02T15:31:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a5eb6640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8a01e75b0 0x7fa8a00c09a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00c23e0 tx=0x7fa898007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa895ffb640 1 -- 172.21.15.78:0/2539490239 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980147e0 con 0x7fa8a01e75b0 2023-06-02T15:31:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa895ffb640 1 -- 172.21.15.78:0/2539490239 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898014960 con 0x7fa8a01e75b0 2023-06-02T15:31:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a7919640 1 -- 172.21.15.78:0/2539490239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a00c4210 con 0x7fa8a01e75b0 2023-06-02T15:31:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa895ffb640 1 -- 172.21.15.78:0/2539490239 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898014d10 con 0x7fa8a01e75b0 2023-06-02T15:31:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a7919640 1 -- 172.21.15.78:0/2539490239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a00a9bc0 con 0x7fa8a01e75b0 2023-06-02T15:31:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a7919640 1 -- 172.21.15.78:0/2539490239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a01e72d0 con 0x7fa8a01e75b0 2023-06-02T15:31:21.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa895ffb640 1 -- 172.21.15.78:0/2539490239 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fa898016420 con 0x7fa8a01e75b0 2023-06-02T15:31:21.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa895ffb640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa884065c30 0x7fa8840680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa895ffb640 1 -- 172.21.15.78:0/2539490239 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa8980838b0 con 0x7fa8a01e75b0 2023-06-02T15:31:21.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a56b5640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa884065c30 0x7fa8840680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.058+0000 7fa8a56b5640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa884065c30 0x7fa8840680e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009910 tx=0x7fa89c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:21.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.062+0000 7fa895ffb640 1 -- 172.21.15.78:0/2539490239 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fa8a01e72d0 con 0x7fa8a01e75b0 2023-06-02T15:31:21.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 -- 172.21.15.78:0/2539490239 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa8a01e7280 con 0x7fa8a01e75b0 2023-06-02T15:31:21.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa895ffb640 1 -- 172.21.15.78:0/2539490239 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa8980548b0 con 0x7fa8a01e75b0 2023-06-02T15:31:21.222 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-02T15:31:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 -- 172.21.15.78:0/2539490239 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa884065c30 msgr2=0x7fa8840680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa884065c30 0x7fa8840680e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa89c009910 tx=0x7fa89c008040 comp rx=0 tx=0).stop 2023-06-02T15:31:21.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 -- 172.21.15.78:0/2539490239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8a01e75b0 msgr2=0x7fa8a00c09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8a01e75b0 0x7fa8a00c09a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa8a00c23e0 tx=0x7fa898007f30 comp rx=0 tx=0).stop 2023-06-02T15:31:21.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 -- 172.21.15.78:0/2539490239 shutdown_connections 2023-06-02T15:31:21.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fa884065c30 0x7fa8840680e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa8a01e75b0 0x7fa8a00c09a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a00c1810 0x7fa8a006b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 --2- 172.21.15.78:0/2539490239 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fa88c0047d0 0x7fa8a0150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.214+0000 7fa8a7919640 1 -- 172.21.15.78:0/2539490239 >> 172.21.15.78:0/2539490239 conn(0x7fa8a00a6470 msgr2=0x7fa8a00a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:21.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.218+0000 7fa8a7919640 1 -- 172.21.15.78:0/2539490239 shutdown_connections 2023-06-02T15:31:21.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.218+0000 7fa8a7919640 1 -- 172.21.15.78:0/2539490239 wait complete. 2023-06-02T15:31:21.239 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi150.front.sepia.ceph.com... 2023-06-02T15:31:21.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:21.240 DEBUG:teuthology.orchestra.run.smithi150:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-06-02T15:31:21.252 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi150.stderr:ceph-fuse[32469]: fuse finished with error 0 and tester_r 0 2023-06-02T15:31:21.254 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:31:21.346 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi150.front.sepia.ceph.com 2023-06-02T15:31:21.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:21.347 DEBUG:teuthology.orchestra.run.smithi150:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-06-02T15:31:21.354 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:31:21.354 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-02T15:31:21.360 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:31:21.361 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-02T15:31:21.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:31:21.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.522+0000 7f4b150fb640 1 Processor -- start 2023-06-02T15:31:21.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b150fb640 1 -- start start 2023-06-02T15:31:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b150fb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b10149e00 0x7f4b100a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b150fb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4b1014fe20 0x7f4b101502a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b150fb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b100bb0e0 con 0x7f4b100ba880 2023-06-02T15:31:21.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b150fb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1014a1d0 con 0x7f4b1014fe20 2023-06-02T15:31:21.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b150fb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100a61d0 con 0x7f4b10149e00 2023-06-02T15:31:21.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b0f59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4b1014fe20 0x7f4b101502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b0f59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4b1014fe20 0x7f4b101502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39364/0 (socket says 172.21.15.78:39364) 2023-06-02T15:31:21.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b0f59e640 1 -- 172.21.15.78:0/1510498399 learned_addr learned my addr 172.21.15.78:0/1510498399 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:21.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b0ed9d640 1 --2- 172.21.15.78:0/1510498399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b10149e00 0x7f4b100a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b0f59e640 1 -- 172.21.15.78:0/1510498399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b10149e00 msgr2=0x7f4b100a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:21.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b0f59e640 1 --2- 172.21.15.78:0/1510498399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b10149e00 0x7f4b100a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b0f59e640 1 -- 172.21.15.78:0/1510498399 >> v1:172.21.15.78:6789/0 conn(0x7f4b100ba880 legacy=0x7f4b100a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b0f59e640 1 -- 172.21.15.78:0/1510498399 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b100a3810 con 0x7f4b1014fe20 2023-06-02T15:31:21.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.526+0000 7f4b0f59e640 1 --2- 172.21.15.78:0/1510498399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b1014fe20 0x7f4b101502a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009e50 tx=0x7f4b0801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d78e8d56419f4b1 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b0dd9b640 1 -- 172.21.15.78:0/1510498399 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b080a56e0 con 0x7f4b1014fe20 2023-06-02T15:31:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b0dd9b640 1 -- 172.21.15.78:0/1510498399 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b080a5840 con 0x7f4b1014fe20 2023-06-02T15:31:21.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b0dd9b640 1 -- 172.21.15.78:0/1510498399 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b080a5bd0 con 0x7f4b1014fe20 2023-06-02T15:31:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b150fb640 1 -- 172.21.15.78:0/1510498399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b1014fe20 msgr2=0x7f4b101502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b150fb640 1 --2- 172.21.15.78:0/1510498399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b1014fe20 0x7f4b101502a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f4b08009e50 tx=0x7f4b0801ca10 comp rx=0 tx=0).stop 2023-06-02T15:31:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b150fb640 1 -- 172.21.15.78:0/1510498399 shutdown_connections 2023-06-02T15:31:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b150fb640 1 --2- 172.21.15.78:0/1510498399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b1014fe20 0x7f4b101502a0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b150fb640 1 --2- 172.21.15.78:0/1510498399 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b10149e00 0x7f4b100a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b150fb640 1 -- 172.21.15.78:0/1510498399 >> 172.21.15.78:0/1510498399 conn(0x7f4b100bcf50 msgr2=0x7f4b100bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:21.540 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b150fb640 1 -- 172.21.15.78:0/1510498399 shutdown_connections 2023-06-02T15:31:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b150fb640 1 -- 172.21.15.78:0/1510498399 wait complete. 2023-06-02T15:31:21.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b150fb640 1 Processor -- start 2023-06-02T15:31:21.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.530+0000 7f4b150fb640 1 -- start start 2023-06-02T15:31:21.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b150fb640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b100ba880 0x7f4b1014ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b150fb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10149e00 0x7f4b101463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b150fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b1014fe20 0x7f4b1013f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b150fb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1014b0d0 con 0x7f4b10149e00 2023-06-02T15:31:21.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b150fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100c1020 con 0x7f4b1014fe20 2023-06-02T15:31:21.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b150fb640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1014c2a0 con 0x7f4b100ba880 2023-06-02T15:31:21.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10149e00 0x7f4b101463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10149e00 0x7f4b101463f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39372/0 (socket says 172.21.15.78:39372) 2023-06-02T15:31:21.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0e59c640 1 -- 172.21.15.78:0/1398074043 learned_addr learned my addr 172.21.15.78:0/1398074043 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0ed9d640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b100ba880 0x7f4b1014ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0f59e640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b1014fe20 0x7f4b1013f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0e59c640 1 -- 172.21.15.78:0/1398074043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b100ba880 msgr2=0x7f4b1014ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0e59c640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b100ba880 0x7f4b1014ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0e59c640 1 -- 172.21.15.78:0/1398074043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b1014fe20 msgr2=0x7f4b1013f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0e59c640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b1014fe20 0x7f4b1013f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0e59c640 1 -- 172.21.15.78:0/1398074043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b08009b30 con 0x7f4b10149e00 2023-06-02T15:31:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0ed9d640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b100ba880 0x7f4b1014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0e59c640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10149e00 0x7f4b101463f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400c530 tx=0x7f4b0400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:21.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4af77fe640 1 -- 172.21.15.78:0/1398074043 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04005220 con 0x7f4b10149e00 2023-06-02T15:31:21.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4af77fe640 1 -- 172.21.15.78:0/1398074043 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b04005380 con 0x7f4b10149e00 2023-06-02T15:31:21.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b150fb640 1 -- 172.21.15.78:0/1398074043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b10159700 con 0x7f4b10149e00 2023-06-02T15:31:21.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4af77fe640 1 -- 172.21.15.78:0/1398074043 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b04007270 con 0x7f4b10149e00 2023-06-02T15:31:21.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b150fb640 1 -- 172.21.15.78:0/1398074043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b100a2b00 con 0x7f4b10149e00 2023-06-02T15:31:21.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b150fb640 1 -- 172.21.15.78:0/1398074043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b10159890 con 0x7f4b10149e00 2023-06-02T15:31:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4af77fe640 1 -- 172.21.15.78:0/1398074043 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f4b040073d0 con 0x7f4b10149e00 2023-06-02T15:31:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4af77fe640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4afc065c00 0x7f4afc0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0ed9d640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4afc065c00 0x7f4afc0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.534+0000 7f4b0ed9d640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4afc065c00 0x7f4afc0680b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000a9d0 tx=0x7f4b00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:21.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.538+0000 7f4af77fe640 1 -- 172.21.15.78:0/1398074043 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4b04007680 con 0x7f4b10149e00 2023-06-02T15:31:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.542+0000 7f4af77fe640 1 -- 172.21.15.78:0/1398074043 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f4b040503d0 con 0x7f4b10149e00 2023-06-02T15:31:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.682+0000 7f4b150fb640 1 -- 172.21.15.78:0/1398074043 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b10073bc0 con 0x7f4b10149e00 2023-06-02T15:31:21.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.686+0000 7f4af77fe640 1 -- 172.21.15.78:0/1398074043 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f4b040539f0 con 0x7f4b10149e00 2023-06-02T15:31:21.696 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:21.696 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:31:21.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 -- 172.21.15.78:0/1398074043 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4afc065c00 msgr2=0x7f4afc0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4afc065c00 0x7f4afc0680b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000a9d0 tx=0x7f4b00008040 comp rx=0 tx=0).stop 2023-06-02T15:31:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 -- 172.21.15.78:0/1398074043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10149e00 msgr2=0x7f4b101463f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10149e00 0x7f4b101463f0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f4b0400c530 tx=0x7f4b0400c9f0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 -- 172.21.15.78:0/1398074043 shutdown_connections 2023-06-02T15:31:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b1014fe20 0x7f4b1013f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4afc065c00 0x7f4afc0680b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b10149e00 0x7f4b101463f0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 --2- 172.21.15.78:0/1398074043 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b100ba880 0x7f4b1014ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 -- 172.21.15.78:0/1398074043 >> 172.21.15.78:0/1398074043 conn(0x7f4b100bcf50 msgr2=0x7f4b10156110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 -- 172.21.15.78:0/1398074043 shutdown_connections 2023-06-02T15:31:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.690+0000 7f4b150fb640 1 -- 172.21.15.78:0/1398074043 wait complete. 2023-06-02T15:31:21.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-02T15:30:31.844882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-02T15:30:33.293644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-02T15:30:36.277798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-02T15:30:37.599884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-02T15:30:40.680165+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-02T15:31:21.713 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-02T15:31:21.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.826+0000 7f9856c8e640 1 Processor -- start 2023-06-02T15:31:21.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.826+0000 7f9856c8e640 1 -- start start 2023-06-02T15:31:21.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f98500a59e0 0x7f98500718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f985006cfc0 0x7f985014f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985014d220 con 0x7f985014fd80 2023-06-02T15:31:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98500ba640 con 0x7f98500a59e0 2023-06-02T15:31:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985014cd30 con 0x7f985006cfc0 2023-06-02T15:31:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f985522b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f985014fd80 0x7f9850149660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57112/0 (socket says 172.21.15.78:57112) 2023-06-02T15:31:21.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f985522b640 1 -- 172.21.15.78:0/3873561258 learned_addr learned my addr 172.21.15.78:0/3873561258 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:21.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9854a2a640 1 --2- 172.21.15.78:0/3873561258 >> v2:172.21.15.78:3300/0 conn(0x7f98500a59e0 0x7f98500718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f984ffff640 1 --2- 172.21.15.78:0/3873561258 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f985006cfc0 0x7f985014f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f984f7fe640 1 -- 172.21.15.78:0/3873561258 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141069690 0 0) 0x7f985014d220 con 0x7f985014fd80 2023-06-02T15:31:21.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f984f7fe640 1 -- 172.21.15.78:0/3873561258 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9838003530 con 0x7f985014fd80 2023-06-02T15:31:21.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9854a2a640 1 -- 172.21.15.78:0/3873561258 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f985006cfc0 msgr2=0x7f985014f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:21.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9854a2a640 1 --2- 172.21.15.78:0/3873561258 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f985006cfc0 0x7f985014f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9854a2a640 1 -- 172.21.15.78:0/3873561258 >> v1:172.21.15.78:6789/0 conn(0x7f985014fd80 legacy=0x7f9850149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9854a2a640 1 -- 172.21.15.78:0/3873561258 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98500ba850 con 0x7f98500a59e0 2023-06-02T15:31:21.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9854a2a640 1 --2- 172.21.15.78:0/3873561258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98500a59e0 0x7f98500718d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f98400097c0 tx=0x7f984001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485f6302bb3e370e server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:21.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f984f7fe640 1 -- 172.21.15.78:0/3873561258 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400ac640 con 0x7f98500a59e0 2023-06-02T15:31:21.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f984f7fe640 1 -- 172.21.15.78:0/3873561258 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98400ac7a0 con 0x7f98500a59e0 2023-06-02T15:31:21.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f984f7fe640 1 -- 172.21.15.78:0/3873561258 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98400acb30 con 0x7f98500a59e0 2023-06-02T15:31:21.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 -- 172.21.15.78:0/3873561258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98500a59e0 msgr2=0x7f98500718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 --2- 172.21.15.78:0/3873561258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98500a59e0 0x7f98500718d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f98400097c0 tx=0x7f984001c3c0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 -- 172.21.15.78:0/3873561258 shutdown_connections 2023-06-02T15:31:21.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 --2- 172.21.15.78:0/3873561258 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f985006cfc0 0x7f985014f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 --2- 172.21.15.78:0/3873561258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f98500a59e0 0x7f98500718d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 -- 172.21.15.78:0/3873561258 >> 172.21.15.78:0/3873561258 conn(0x7f98500a2170 msgr2=0x7f98500a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:21.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 -- 172.21.15.78:0/3873561258 shutdown_connections 2023-06-02T15:31:21.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.830+0000 7f9856c8e640 1 -- 172.21.15.78:0/3873561258 wait complete. 2023-06-02T15:31:21.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 Processor -- start 2023-06-02T15:31:21.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 -- start start 2023-06-02T15:31:21.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985006cfc0 0x7f9850070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98500a59e0 0x7f985013b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f985014fd80 0x7f985013bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9850071360 con 0x7f985014fd80 2023-06-02T15:31:21.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9850148300 con 0x7f985006cfc0 2023-06-02T15:31:21.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9850147770 con 0x7f98500a59e0 2023-06-02T15:31:21.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f985522b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f985014fd80 0x7f985013bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f985522b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f985014fd80 0x7f985013bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39394/0 (socket says 172.21.15.78:39394) 2023-06-02T15:31:21.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f985522b640 1 -- 172.21.15.78:0/2419080773 learned_addr learned my addr 172.21.15.78:0/2419080773 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:21.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f984ffff640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98500a59e0 0x7f985013b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9854a2a640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985006cfc0 0x7f9850070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f985522b640 1 -- 172.21.15.78:0/2419080773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98500a59e0 msgr2=0x7f985013b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f985522b640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98500a59e0 0x7f985013b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f985522b640 1 -- 172.21.15.78:0/2419080773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985006cfc0 msgr2=0x7f9850070820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f985522b640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985006cfc0 0x7f9850070820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f985522b640 1 -- 172.21.15.78:0/2419080773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840009420 con 0x7f985014fd80 2023-06-02T15:31:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f984ffff640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98500a59e0 0x7f985013b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f985522b640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f985014fd80 0x7f985013bdf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f984800cad0 tx=0x7f984800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f984d7fa640 1 -- 172.21.15.78:0/2419080773 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984800abd0 con 0x7f985014fd80 2023-06-02T15:31:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f984d7fa640 1 -- 172.21.15.78:0/2419080773 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984800ad30 con 0x7f985014fd80 2023-06-02T15:31:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f984d7fa640 1 -- 172.21.15.78:0/2419080773 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984800aea0 con 0x7f985014fd80 2023-06-02T15:31:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 -- 172.21.15.78:0/2419080773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9850149f00 con 0x7f985014fd80 2023-06-02T15:31:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 -- 172.21.15.78:0/2419080773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9850149d70 con 0x7f985014fd80 2023-06-02T15:31:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.834+0000 7f9856c8e640 1 -- 172.21.15.78:0/2419080773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98501593f0 con 0x7f985014fd80 2023-06-02T15:31:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.838+0000 7f984d7fa640 1 -- 172.21.15.78:0/2419080773 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f9848007070 con 0x7f985014fd80 2023-06-02T15:31:21.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.838+0000 7f984d7fa640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f983c065c00 0x7f983c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.838+0000 7f984d7fa640 1 -- 172.21.15.78:0/2419080773 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9848083590 con 0x7f985014fd80 2023-06-02T15:31:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.838+0000 7f9854a2a640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f983c065c00 0x7f983c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.838+0000 7f9854a2a640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f983c065c00 0x7f983c0680b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f98400ae000 tx=0x7f98400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:21.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.842+0000 7f984d7fa640 1 -- 172.21.15.78:0/2419080773 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f9848050a70 con 0x7f985014fd80 2023-06-02T15:31:21.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 -- 172.21.15.78:0/2419080773 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f98500714a0 con 0x7f985014fd80 2023-06-02T15:31:21.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f984d7fa640 1 -- 172.21.15.78:0/2419080773 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9848054090 con 0x7f985014fd80 2023-06-02T15:31:21.993 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-02T15:31:21.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 -- 172.21.15.78:0/2419080773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f983c065c00 msgr2=0x7f983c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f983c065c00 0x7f983c0680b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f98400ae000 tx=0x7f98400a7000 comp rx=0 tx=0).stop 2023-06-02T15:31:21.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 -- 172.21.15.78:0/2419080773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f985014fd80 msgr2=0x7f985013bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:21.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f985014fd80 0x7f985013bdf0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f984800cad0 tx=0x7f984800cf90 comp rx=0 tx=0).stop 2023-06-02T15:31:21.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 -- 172.21.15.78:0/2419080773 shutdown_connections 2023-06-02T15:31:21.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f983c065c00 0x7f983c0680b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f985014fd80 0x7f985013bdf0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f98500a59e0 0x7f985013b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 --2- 172.21.15.78:0/2419080773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985006cfc0 0x7f9850070820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:21.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 -- 172.21.15.78:0/2419080773 >> 172.21.15.78:0/2419080773 conn(0x7f98500a2170 msgr2=0x7f985014ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:21.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 -- 172.21.15.78:0/2419080773 shutdown_connections 2023-06-02T15:31:21.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:21.982+0000 7f9856c8e640 1 -- 172.21.15.78:0/2419080773 wait complete. 2023-06-02T15:31:22.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-02T15:31:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126c4f6640 1 Processor -- start 2023-06-02T15:31:22.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126c4f6640 1 -- start start 2023-06-02T15:31:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126c4f6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12640a59e0 0x7f12640718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126c4f6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f126406cfc0 0x7f126414f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126c4f6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126414fd80 0x7f1264149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126c4f6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12640ba640 con 0x7f12640a59e0 2023-06-02T15:31:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126c4f6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f126414cd30 con 0x7f126406cfc0 2023-06-02T15:31:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126c4f6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f126414d220 con 0x7f126414fd80 2023-06-02T15:31:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126a292640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12640a59e0 0x7f12640718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126a292640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12640a59e0 0x7f12640718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39410/0 (socket says 172.21.15.78:39410) 2023-06-02T15:31:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126a292640 1 -- 172.21.15.78:0/1914018490 learned_addr learned my addr 172.21.15.78:0/1914018490 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126aa93640 1 --2- 172.21.15.78:0/1914018490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126414fd80 0x7f1264149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126a292640 1 -- 172.21.15.78:0/1914018490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126414fd80 msgr2=0x7f1264149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126a292640 1 --2- 172.21.15.78:0/1914018490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126414fd80 0x7f1264149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126a292640 1 -- 172.21.15.78:0/1914018490 >> v2:172.21.15.132:3300/0 conn(0x7f126406cfc0 msgr2=0x7f126414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126a292640 1 --2- 172.21.15.78:0/1914018490 >> v2:172.21.15.132:3300/0 conn(0x7f126406cfc0 0x7f126414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.110+0000 7f126a292640 1 -- 172.21.15.78:0/1914018490 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12640ba850 con 0x7f12640a59e0 2023-06-02T15:31:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126a292640 1 --2- 172.21.15.78:0/1914018490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 0x7f12640718d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12640bac90 tx=0x7f125c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6c1f0fab2b379 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f1269290640 1 -- 172.21.15.78:0/1914018490 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c0a57b0 con 0x7f12640a59e0 2023-06-02T15:31:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f1269290640 1 -- 172.21.15.78:0/1914018490 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125c0a5910 con 0x7f12640a59e0 2023-06-02T15:31:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f1269290640 1 -- 172.21.15.78:0/1914018490 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c0a5ca0 con 0x7f12640a59e0 2023-06-02T15:31:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 -- 172.21.15.78:0/1914018490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 msgr2=0x7f12640718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 --2- 172.21.15.78:0/1914018490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 0x7f12640718d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12640bac90 tx=0x7f125c01c910 comp rx=0 tx=0).stop 2023-06-02T15:31:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 -- 172.21.15.78:0/1914018490 shutdown_connections 2023-06-02T15:31:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 --2- 172.21.15.78:0/1914018490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126414fd80 0x7f1264149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 --2- 172.21.15.78:0/1914018490 >> v2:172.21.15.132:3300/0 conn(0x7f126406cfc0 0x7f126414f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 --2- 172.21.15.78:0/1914018490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 0x7f12640718d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 -- 172.21.15.78:0/1914018490 >> 172.21.15.78:0/1914018490 conn(0x7f12640a2170 msgr2=0x7f12640a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 -- 172.21.15.78:0/1914018490 shutdown_connections 2023-06-02T15:31:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 -- 172.21.15.78:0/1914018490 wait complete. 2023-06-02T15:31:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 Processor -- start 2023-06-02T15:31:22.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.114+0000 7f126c4f6640 1 -- start start 2023-06-02T15:31:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126c4f6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126406cfc0 0x7f12641481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126c4f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 0x7f126414a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126c4f6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126414fd80 0x7f126414f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126c4f6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126414c0f0 con 0x7f12640a59e0 2023-06-02T15:31:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126c4f6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1264147b40 con 0x7f126406cfc0 2023-06-02T15:31:22.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126c4f6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1264147e20 con 0x7f126414fd80 2023-06-02T15:31:22.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1269a91640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 0x7f126414a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1269a91640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 0x7f126414a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39416/0 (socket says 172.21.15.78:39416) 2023-06-02T15:31:22.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1269a91640 1 -- 172.21.15.78:0/1748846950 learned_addr learned my addr 172.21.15.78:0/1748846950 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:22.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126a292640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126406cfc0 0x7f12641481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1269a91640 1 -- 172.21.15.78:0/1748846950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126414fd80 msgr2=0x7f126414f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126aa93640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126414fd80 0x7f126414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1269a91640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126414fd80 0x7f126414f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1269a91640 1 -- 172.21.15.78:0/1748846950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126406cfc0 msgr2=0x7f12641481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1269a91640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126406cfc0 0x7f12641481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1269a91640 1 -- 172.21.15.78:0/1748846950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c009b30 con 0x7f12640a59e0 2023-06-02T15:31:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126a292640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126406cfc0 0x7f12641481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1269a91640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 0x7f126414a220 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f125800b480 tx=0x7f125800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1256ffd640 1 -- 172.21.15.78:0/1748846950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258010870 con 0x7f12640a59e0 2023-06-02T15:31:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1256ffd640 1 -- 172.21.15.78:0/1748846950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12580109f0 con 0x7f12640a59e0 2023-06-02T15:31:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126c4f6640 1 -- 172.21.15.78:0/1748846950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12640c0cb0 con 0x7f12640a59e0 2023-06-02T15:31:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1256ffd640 1 -- 172.21.15.78:0/1748846950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1258010da0 con 0x7f12640a59e0 2023-06-02T15:31:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126c4f6640 1 -- 172.21.15.78:0/1748846950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12640c0b20 con 0x7f12640a59e0 2023-06-02T15:31:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126c4f6640 1 -- 172.21.15.78:0/1748846950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12640c0e40 con 0x7f12640a59e0 2023-06-02T15:31:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1256ffd640 1 -- 172.21.15.78:0/1748846950 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f125800f3c0 con 0x7f12640a59e0 2023-06-02T15:31:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1256ffd640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1248065c30 0x7f12480680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f1256ffd640 1 -- 172.21.15.78:0/1748846950 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12580835e0 con 0x7f12640a59e0 2023-06-02T15:31:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126a292640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1248065c30 0x7f12480680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.118+0000 7f126a292640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1248065c30 0x7f12480680e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f125c0ae000 tx=0x7f125c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:22.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.122+0000 7f1256ffd640 1 -- 172.21.15.78:0/1748846950 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f1258050b50 con 0x7f12640a59e0 2023-06-02T15:31:22.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.262+0000 7f126c4f6640 1 -- 172.21.15.78:0/1748846950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1264073bc0 con 0x7f12640a59e0 2023-06-02T15:31:22.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f1256ffd640 1 -- 172.21.15.78:0/1748846950 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1258054170 con 0x7f12640a59e0 2023-06-02T15:31:22.273 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-02T15:31:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 -- 172.21.15.78:0/1748846950 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1248065c30 msgr2=0x7f12480680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1248065c30 0x7f12480680e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f125c0ae000 tx=0x7f125c0a7070 comp rx=0 tx=0).stop 2023-06-02T15:31:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 -- 172.21.15.78:0/1748846950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 msgr2=0x7f126414a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 0x7f126414a220 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f125800b480 tx=0x7f125800b940 comp rx=0 tx=0).stop 2023-06-02T15:31:22.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 -- 172.21.15.78:0/1748846950 shutdown_connections 2023-06-02T15:31:22.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f126414fd80 0x7f126414f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1248065c30 0x7f12480680e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12640a59e0 0x7f126414a220 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 --2- 172.21.15.78:0/1748846950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f126406cfc0 0x7f12641481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 -- 172.21.15.78:0/1748846950 >> 172.21.15.78:0/1748846950 conn(0x7f12640a2170 msgr2=0x7f1264071450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:22.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 -- 172.21.15.78:0/1748846950 shutdown_connections 2023-06-02T15:31:22.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.266+0000 7f126c4f6640 1 -- 172.21.15.78:0/1748846950 wait complete. 2023-06-02T15:31:22.291 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-02T15:31:22.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe961752640 1 Processor -- start 2023-06-02T15:31:22.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe961752640 1 -- start start 2023-06-02T15:31:22.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe961752640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe95c0a59e0 0x7fe95c0718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe961752640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe95c06c250 0x7fe95c149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe961752640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95c14d220 con 0x7fe95c06cfc0 2023-06-02T15:31:22.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe961752640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c0ba640 con 0x7fe95c0a59e0 2023-06-02T15:31:22.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe961752640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95c14cd30 con 0x7fe95c06c250 2023-06-02T15:31:22.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe95affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe95c0a59e0 0x7fe95c0718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe95affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe95c0a59e0 0x7fe95c0718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39420/0 (socket says 172.21.15.78:39420) 2023-06-02T15:31:22.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe95affd640 1 -- 172.21.15.78:0/630248877 learned_addr learned my addr 172.21.15.78:0/630248877 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:22.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe95b7fe640 1 --2- 172.21.15.78:0/630248877 >> v2:172.21.15.132:3300/0 conn(0x7fe95c06c250 0x7fe95c149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe95affd640 1 -- 172.21.15.78:0/630248877 >> v2:172.21.15.132:3300/0 conn(0x7fe95c06c250 msgr2=0x7fe95c149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:22.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe95affd640 1 --2- 172.21.15.78:0/630248877 >> v2:172.21.15.132:3300/0 conn(0x7fe95c06c250 0x7fe95c149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe95affd640 1 -- 172.21.15.78:0/630248877 >> v1:172.21.15.132:6789/0 conn(0x7fe95c06cfc0 legacy=0x7fe95c14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:22.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.394+0000 7fe95affd640 1 -- 172.21.15.78:0/630248877 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c0ba850 con 0x7fe95c0a59e0 2023-06-02T15:31:22.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe95affd640 1 --2- 172.21.15.78:0/630248877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c0a59e0 0x7fe95c0718d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe95c06ae10 tx=0x7fe94c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9531472f57d7d1e server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:22.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe95a7fc640 1 -- 172.21.15.78:0/630248877 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0ac640 con 0x7fe95c0a59e0 2023-06-02T15:31:22.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe95a7fc640 1 -- 172.21.15.78:0/630248877 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94c0ac7a0 con 0x7fe95c0a59e0 2023-06-02T15:31:22.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe95a7fc640 1 -- 172.21.15.78:0/630248877 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0acb30 con 0x7fe95c0a59e0 2023-06-02T15:31:22.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- 172.21.15.78:0/630248877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c0a59e0 msgr2=0x7fe95c0718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 --2- 172.21.15.78:0/630248877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c0a59e0 0x7fe95c0718d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe95c06ae10 tx=0x7fe94c01c400 comp rx=0 tx=0).stop 2023-06-02T15:31:22.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- 172.21.15.78:0/630248877 shutdown_connections 2023-06-02T15:31:22.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 --2- 172.21.15.78:0/630248877 >> v2:172.21.15.132:3300/0 conn(0x7fe95c06c250 0x7fe95c149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 --2- 172.21.15.78:0/630248877 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c0a59e0 0x7fe95c0718d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- 172.21.15.78:0/630248877 >> 172.21.15.78:0/630248877 conn(0x7fe95c0a2170 msgr2=0x7fe95c0a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:22.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- 172.21.15.78:0/630248877 shutdown_connections 2023-06-02T15:31:22.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- 172.21.15.78:0/630248877 wait complete. 2023-06-02T15:31:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 Processor -- start 2023-06-02T15:31:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- start start 2023-06-02T15:31:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe95c06c250 0x7fe95c0a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c06cfc0 0x7fe95c0a4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95c0a59e0 0x7fe95c0b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c140bb0 con 0x7fe95c06cfc0 2023-06-02T15:31:22.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c0a54e0 con 0x7fe95c0a59e0 2023-06-02T15:31:22.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95c1e7a70 con 0x7fe95c06c250 2023-06-02T15:31:22.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe953fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c06cfc0 0x7fe95c0a4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe953fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c06cfc0 0x7fe95c0a4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39434/0 (socket says 172.21.15.78:39434) 2023-06-02T15:31:22.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe953fff640 1 -- 172.21.15.78:0/1618643610 learned_addr learned my addr 172.21.15.78:0/1618643610 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:22.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe953fff640 1 -- 172.21.15.78:0/1618643610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe95c06c250 msgr2=0x7fe95c0a3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe953fff640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe95c06c250 0x7fe95c0a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe953fff640 1 -- 172.21.15.78:0/1618643610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95c0a59e0 msgr2=0x7fe95c0b97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe953fff640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95c0a59e0 0x7fe95c0b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe953fff640 1 -- 172.21.15.78:0/1618643610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe94c0094d0 con 0x7fe95c06cfc0 2023-06-02T15:31:22.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe953fff640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c06cfc0 0x7fe95c0a4fa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe94400c470 tx=0x7fe94400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:22.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe9537fe640 1 -- 172.21.15.78:0/1618643610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944012830 con 0x7fe95c06cfc0 2023-06-02T15:31:22.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe9537fe640 1 -- 172.21.15.78:0/1618643610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe944012990 con 0x7fe95c06cfc0 2023-06-02T15:31:22.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- 172.21.15.78:0/1618643610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe95c0a5f40 con 0x7fe95c06cfc0 2023-06-02T15:31:22.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe9537fe640 1 -- 172.21.15.78:0/1618643610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944012d40 con 0x7fe95c06cfc0 2023-06-02T15:31:22.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.398+0000 7fe961752640 1 -- 172.21.15.78:0/1618643610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe95c0a5db0 con 0x7fe95c06cfc0 2023-06-02T15:31:22.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.402+0000 7fe961752640 1 -- 172.21.15.78:0/1618643610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe95c1593f0 con 0x7fe95c06cfc0 2023-06-02T15:31:22.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.402+0000 7fe9537fe640 1 -- 172.21.15.78:0/1618643610 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fe94401b400 con 0x7fe95c06cfc0 2023-06-02T15:31:22.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.402+0000 7fe9537fe640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe93c065c00 0x7fe93c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.402+0000 7fe95affd640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe93c065c00 0x7fe93c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.402+0000 7fe9537fe640 1 -- 172.21.15.78:0/1618643610 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe9440834e0 con 0x7fe95c06cfc0 2023-06-02T15:31:22.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.402+0000 7fe95affd640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe93c065c00 0x7fe93c0680b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0ae000 tx=0x7fe94c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:22.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.406+0000 7fe9537fe640 1 -- 172.21.15.78:0/1618643610 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fe944050a50 con 0x7fe95c06cfc0 2023-06-02T15:31:22.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.558+0000 7fe961752640 1 -- 172.21.15.78:0/1618643610 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe95c14c870 con 0x7fe95c06cfc0 2023-06-02T15:31:22.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe9537fe640 1 -- 172.21.15.78:0/1618643610 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe944054070 con 0x7fe95c06cfc0 2023-06-02T15:31:22.569 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 -- 172.21.15.78:0/1618643610 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe93c065c00 msgr2=0x7fe93c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe93c065c00 0x7fe93c0680b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0ae000 tx=0x7fe94c008040 comp rx=0 tx=0).stop 2023-06-02T15:31:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 -- 172.21.15.78:0/1618643610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c06cfc0 msgr2=0x7fe95c0a4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c06cfc0 0x7fe95c0a4fa0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe94400c470 tx=0x7fe94400c930 comp rx=0 tx=0).stop 2023-06-02T15:31:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 -- 172.21.15.78:0/1618643610 shutdown_connections 2023-06-02T15:31:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe95c0a59e0 0x7fe95c0b97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe93c065c00 0x7fe93c0680b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe95c06cfc0 0x7fe95c0a4fa0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 --2- 172.21.15.78:0/1618643610 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe95c06c250 0x7fe95c0a3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 -- 172.21.15.78:0/1618643610 >> 172.21.15.78:0/1618643610 conn(0x7fe95c0a2170 msgr2=0x7fe95c14dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 -- 172.21.15.78:0/1618643610 shutdown_connections 2023-06-02T15:31:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.562+0000 7fe961752640 1 -- 172.21.15.78:0/1618643610 wait complete. 2023-06-02T15:31:22.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-02T15:31:22.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feecf1b5640 1 Processor -- start 2023-06-02T15:31:22.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feecf1b5640 1 -- start start 2023-06-02T15:31:22.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feecf1b5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec8149a00 0x7feec80a6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feecf1b5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feec80be910 0x7feec8156c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feecf1b5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec8149dd0 con 0x7feec80a6cd0 2023-06-02T15:31:22.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feecf1b5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec81502a0 con 0x7feec80be910 2023-06-02T15:31:22.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feecf1b5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec80c12b0 con 0x7feec8149a00 2023-06-02T15:31:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7feec80a6cd0 0x7feec814c350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57114/0 (socket says 172.21.15.78:57114) 2023-06-02T15:31:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec7fff640 1 -- 172.21.15.78:0/1604242008 learned_addr learned my addr 172.21.15.78:0/1604242008 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feeccf51640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec8149a00 0x7feec80a6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feecd752640 1 --2- 172.21.15.78:0/1604242008 >> v2:172.21.15.132:3300/0 conn(0x7feec80be910 0x7feec8156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985027698 0 0) 0x7feec8149dd0 con 0x7feec80a6cd0 2023-06-02T15:31:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb4003530 con 0x7feec80a6cd0 2023-06-02T15:31:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 882240715 0 0) 0x7feeb4003530 con 0x7feec80a6cd0 2023-06-02T15:31:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec8149a00 msgr2=0x7feec80a6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec8149a00 0x7feec80a6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 >> v2:172.21.15.132:3300/0 conn(0x7feec80be910 msgr2=0x7feec8156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:22.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 --2- 172.21.15.78:0/1604242008 >> v2:172.21.15.132:3300/0 conn(0x7feec80be910 0x7feec8156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec814f900 con 0x7feec80a6cd0 2023-06-02T15:31:22.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7feeb8001680 con 0x7feec80a6cd0 2023-06-02T15:31:22.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 >> v1:172.21.15.78:6789/0 conn(0x7feec80a6cd0 legacy=0x7feec814c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec8149a00 0x7feeb40039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feeb4003f70 0x7feeb40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb4004d10 0x7feeb4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81502a0 con 0x7feeb4004d10 2023-06-02T15:31:22.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec80c12b0 con 0x7feeb4003f70 2023-06-02T15:31:22.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb400b990 con 0x7feec8149a00 2023-06-02T15:31:22.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feecd752640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb4004d10 0x7feeb4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feeccf51640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec8149a00 0x7feeb40039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.698+0000 7feec7fff640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feeb4003f70 0x7feeb40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecd752640 1 -- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec8149a00 msgr2=0x7feeb40039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:22.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecd752640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec8149a00 0x7feeb40039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecd752640 1 -- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feeb4003f70 msgr2=0x7feeb40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:22.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecd752640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feeb4003f70 0x7feeb40047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecd752640 1 -- 172.21.15.78:0/1604242008 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb4003530 con 0x7feeb4004d10 2023-06-02T15:31:22.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecd752640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb4004d10 0x7feeb4005180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009b10 tx=0x7feeb001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7ce79c52a01bb43 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:22.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00a5680 con 0x7feeb4004d10 2023-06-02T15:31:22.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb00a57e0 con 0x7feeb4004d10 2023-06-02T15:31:22.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feec77fe640 1 -- 172.21.15.78:0/1604242008 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00a5b90 con 0x7feeb4004d10 2023-06-02T15:31:22.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecf1b5640 1 -- 172.21.15.78:0/1604242008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb4004d10 msgr2=0x7feeb4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecf1b5640 1 --2- 172.21.15.78:0/1604242008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feeb4004d10 0x7feeb4005180 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7feeb0009b10 tx=0x7feeb001ca90 comp rx=0 tx=0).stop 2023-06-02T15:31:22.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecd752640 1 -- 172.21.15.78:0/1604242008 reap_dead start 2023-06-02T15:31:22.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecf1b5640 1 -- 172.21.15.78:0/1604242008 shutdown_connections 2023-06-02T15:31:22.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecf1b5640 1 -- 172.21.15.78:0/1604242008 >> 172.21.15.78:0/1604242008 conn(0x7feec80a3180 msgr2=0x7feec80a3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:22.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecf1b5640 1 -- 172.21.15.78:0/1604242008 shutdown_connections 2023-06-02T15:31:22.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.702+0000 7feecf1b5640 1 -- 172.21.15.78:0/1604242008 wait complete. 2023-06-02T15:31:22.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 Processor -- start 2023-06-02T15:31:22.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 -- start start 2023-06-02T15:31:22.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec80b77d0 0x7feec80ba900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec80b7ba0 0x7feec814c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec814c690 0x7feec80bcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec80bb2a0 con 0x7feec80b7ba0 2023-06-02T15:31:22.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec80b87f0 con 0x7feec814c690 2023-06-02T15:31:22.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec80b7fd0 con 0x7feec80b77d0 2023-06-02T15:31:22.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec80b7ba0 0x7feec814c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec80b7ba0 0x7feec814c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39454/0 (socket says 172.21.15.78:39454) 2023-06-02T15:31:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec7fff640 1 -- 172.21.15.78:0/95369369 learned_addr learned my addr 172.21.15.78:0/95369369 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feeccf51640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec80b77d0 0x7feec80ba900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecd752640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec814c690 0x7feec80bcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec7fff640 1 -- 172.21.15.78:0/95369369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec80b77d0 msgr2=0x7feec80ba900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec7fff640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec80b77d0 0x7feec80ba900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec7fff640 1 -- 172.21.15.78:0/95369369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec814c690 msgr2=0x7feec80bcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec7fff640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec814c690 0x7feec80bcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec7fff640 1 -- 172.21.15.78:0/95369369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec814fec0 con 0x7feec80b7ba0 2023-06-02T15:31:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec7fff640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec80b7ba0 0x7feec814c150 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7feeb800dae0 tx=0x7feeb8001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec57fa640 1 -- 172.21.15.78:0/95369369 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8004cc0 con 0x7feec80b7ba0 2023-06-02T15:31:22.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec57fa640 1 -- 172.21.15.78:0/95369369 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb8004e20 con 0x7feec80b7ba0 2023-06-02T15:31:22.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 -- 172.21.15.78:0/95369369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec814fbe0 con 0x7feec80b7ba0 2023-06-02T15:31:22.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feec57fa640 1 -- 172.21.15.78:0/95369369 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb80072d0 con 0x7feec80b7ba0 2023-06-02T15:31:22.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 -- 172.21.15.78:0/95369369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80c0310 con 0x7feec80b7ba0 2023-06-02T15:31:22.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.706+0000 7feecf1b5640 1 -- 172.21.15.78:0/95369369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec8073bc0 con 0x7feec80b7ba0 2023-06-02T15:31:22.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.710+0000 7feec57fa640 1 -- 172.21.15.78:0/95369369 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7feeb8007430 con 0x7feec80b7ba0 2023-06-02T15:31:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.710+0000 7feec57fa640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feea8065c30 0x7feea80680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.710+0000 7feec57fa640 1 -- 172.21.15.78:0/95369369 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7feeb8082e60 con 0x7feec80b7ba0 2023-06-02T15:31:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.710+0000 7feeccf51640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feea8065c30 0x7feea80680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:22.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.710+0000 7feeccf51640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feea8065c30 0x7feea80680e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feec0007520 tx=0x7feec000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:22.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.714+0000 7feec57fa640 1 -- 172.21.15.78:0/95369369 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7feeb8050420 con 0x7feec80b7ba0 2023-06-02T15:31:22.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.862+0000 7feecf1b5640 1 -- 172.21.15.78:0/95369369 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feec80b8930 con 0x7feec80b7ba0 2023-06-02T15:31:22.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feec57fa640 1 -- 172.21.15.78:0/95369369 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7feeb80190a0 con 0x7feec80b7ba0 2023-06-02T15:31:22.873 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-02T15:31:22.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 -- 172.21.15.78:0/95369369 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feea8065c30 msgr2=0x7feea80680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feea8065c30 0x7feea80680e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7feec0007520 tx=0x7feec000b040 comp rx=0 tx=0).stop 2023-06-02T15:31:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 -- 172.21.15.78:0/95369369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec80b7ba0 msgr2=0x7feec814c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec80b7ba0 0x7feec814c150 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7feeb800dae0 tx=0x7feeb8001dc0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 -- 172.21.15.78:0/95369369 shutdown_connections 2023-06-02T15:31:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feec814c690 0x7feec80bcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7feea8065c30 0x7feea80680e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feec80b7ba0 0x7feec814c150 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 --2- 172.21.15.78:0/95369369 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7feec80b77d0 0x7feec80ba900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 -- 172.21.15.78:0/95369369 >> 172.21.15.78:0/95369369 conn(0x7feec80a3180 msgr2=0x7feec80698f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:22.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 -- 172.21.15.78:0/95369369 shutdown_connections 2023-06-02T15:31:22.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.866+0000 7feecf1b5640 1 -- 172.21.15.78:0/95369369 wait complete. 2023-06-02T15:31:22.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-02T15:31:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.994+0000 7f1bde217640 1 Processor -- start 2023-06-02T15:31:23.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.994+0000 7f1bde217640 1 -- start start 2023-06-02T15:31:23.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bde217640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8071780 0x7f1bd80ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bde217640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd80a5f30 con 0x7f1bd81485c0 2023-06-02T15:31:23.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bde217640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd814bcc0 con 0x7f1bd80c0570 2023-06-02T15:31:23.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bde217640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd80c1100 con 0x7f1bd8071780 2023-06-02T15:31:23.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1bd81485c0 0x7f1bd80badc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57122/0 (socket says 172.21.15.78:57122) 2023-06-02T15:31:23.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd7fff640 1 -- 172.21.15.78:0/810202154 learned_addr learned my addr 172.21.15.78:0/810202154 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:23.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd6ffd640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8071780 0x7f1bd80ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406546624 0 0) 0x7f1bd80a5f30 con 0x7f1bd81485c0 2023-06-02T15:31:23.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc4003530 con 0x7f1bd81485c0 2023-06-02T15:31:23.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 158254694 0 0) 0x7f1bc4003530 con 0x7f1bd81485c0 2023-06-02T15:31:23.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8071780 msgr2=0x7f1bd80ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8071780 0x7f1bd80ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 >> v1:172.21.15.132:6789/0 conn(0x7f1bd80c0570 legacy=0x7f1bd80bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd814bfa0 con 0x7f1bd81485c0 2023-06-02T15:31:23.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f1bc8001a00 con 0x7f1bd81485c0 2023-06-02T15:31:23.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 >> v1:172.21.15.78:6789/0 conn(0x7f1bd81485c0 legacy=0x7f1bd80badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc4003a20 0x7f1bc4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40047d0 0x7f1bc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8071780 0x7f1bc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc400ba40 con 0x7f1bc4003a20 2023-06-02T15:31:23.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc400bbb0 con 0x7f1bc40047d0 2023-06-02T15:31:23.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc400df80 con 0x7f1bd8071780 2023-06-02T15:31:23.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd77fe640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc4003a20 0x7f1bc4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd6ffd640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40047d0 0x7f1bc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd77fe640 1 -- 172.21.15.78:0/810202154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8071780 msgr2=0x7f1bc4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd77fe640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8071780 0x7f1bc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd77fe640 1 -- 172.21.15.78:0/810202154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40047d0 msgr2=0x7f1bc4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd77fe640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40047d0 0x7f1bc4004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd77fe640 1 -- 172.21.15.78:0/810202154 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc4003530 con 0x7f1bc4003a20 2023-06-02T15:31:23.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd77fe640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc4003a20 0x7f1bc4003e30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0001780 tx=0x7f1bd001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a372d0497fc88698 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd00052d0 con 0x7f1bc4003a20 2023-06-02T15:31:23.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd00a7050 con 0x7f1bc4003a20 2023-06-02T15:31:23.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:22.998+0000 7f1bd67fc640 1 -- 172.21.15.78:0/810202154 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd0003600 con 0x7f1bc4003a20 2023-06-02T15:31:23.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- 172.21.15.78:0/810202154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc4003a20 msgr2=0x7f1bc4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 --2- 172.21.15.78:0/810202154 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bc4003a20 0x7f1bc4003e30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0001780 tx=0x7f1bd001c400 comp rx=0 tx=0).stop 2023-06-02T15:31:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd7fff640 1 -- 172.21.15.78:0/810202154 reap_dead start 2023-06-02T15:31:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- 172.21.15.78:0/810202154 shutdown_connections 2023-06-02T15:31:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- 172.21.15.78:0/810202154 >> 172.21.15.78:0/810202154 conn(0x7f1bd80a2170 msgr2=0x7f1bd80a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:23.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- 172.21.15.78:0/810202154 shutdown_connections 2023-06-02T15:31:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- 172.21.15.78:0/810202154 wait complete. 2023-06-02T15:31:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 Processor -- start 2023-06-02T15:31:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- start start 2023-06-02T15:31:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc4003a20 0x7f1bd80bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8152500 0x7f1bd8150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bd8142970 0x7f1bd806f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd814f9c0 con 0x7f1bd8142970 2023-06-02T15:31:23.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd81510d0 con 0x7f1bc4003a20 2023-06-02T15:31:23.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd806eb30 con 0x7f1bd8152500 2023-06-02T15:31:23.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bd8142970 0x7f1bd806f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bd8142970 0x7f1bd806f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39474/0 (socket says 172.21.15.78:39474) 2023-06-02T15:31:23.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd7fff640 1 -- 172.21.15.78:0/2801653103 learned_addr learned my addr 172.21.15.78:0/2801653103 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:23.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd77fe640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc4003a20 0x7f1bd80bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd6ffd640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8152500 0x7f1bd8150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd7fff640 1 -- 172.21.15.78:0/2801653103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8152500 msgr2=0x7f1bd8150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd7fff640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8152500 0x7f1bd8150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd7fff640 1 -- 172.21.15.78:0/2801653103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc4003a20 msgr2=0x7f1bd80bfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd7fff640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc4003a20 0x7f1bd80bfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd7fff640 1 -- 172.21.15.78:0/2801653103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd80c0940 con 0x7f1bd8142970 2023-06-02T15:31:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd77fe640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc4003a20 0x7f1bd80bfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:23.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bd7fff640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bd8142970 0x7f1bd806f540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1bd814b1a0 tx=0x7f1bc800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bcffff640 1 -- 172.21.15.78:0/2801653103 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8004d70 con 0x7f1bd8142970 2023-06-02T15:31:23.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bcffff640 1 -- 172.21.15.78:0/2801653103 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc800cec0 con 0x7f1bd8142970 2023-06-02T15:31:23.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- 172.21.15.78:0/2801653103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd80baa50 con 0x7f1bd8142970 2023-06-02T15:31:23.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bcffff640 1 -- 172.21.15.78:0/2801653103 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8007350 con 0x7f1bd8142970 2023-06-02T15:31:23.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.002+0000 7f1bde217640 1 -- 172.21.15.78:0/2801653103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd80c0ad0 con 0x7f1bd8142970 2023-06-02T15:31:23.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.006+0000 7f1bde217640 1 -- 172.21.15.78:0/2801653103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd8073bc0 con 0x7f1bd8142970 2023-06-02T15:31:23.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.006+0000 7f1bcffff640 1 -- 172.21.15.78:0/2801653103 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f1bc80074b0 con 0x7f1bd8142970 2023-06-02T15:31:23.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.006+0000 7f1bcffff640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1bb8065c30 0x7f1bb80680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.006+0000 7f1bcffff640 1 -- 172.21.15.78:0/2801653103 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1bc8082230 con 0x7f1bd8142970 2023-06-02T15:31:23.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.006+0000 7f1bd77fe640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1bb8065c30 0x7f1bb80680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.006+0000 7f1bd77fe640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1bb8065c30 0x7f1bb80680e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0001750 tx=0x7f1bd00011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.010+0000 7f1bcffff640 1 -- 172.21.15.78:0/2801653103 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f1bc804f7a0 con 0x7f1bd8142970 2023-06-02T15:31:23.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 -- 172.21.15.78:0/2801653103 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1bd8149dc0 con 0x7f1bd8142970 2023-06-02T15:31:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bcffff640 1 -- 172.21.15.78:0/2801653103 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1bc8052dc0 con 0x7f1bd8142970 2023-06-02T15:31:23.175 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:23.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 -- 172.21.15.78:0/2801653103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1bb8065c30 msgr2=0x7f1bb80680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1bb8065c30 0x7f1bb80680e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0001750 tx=0x7f1bd00011a0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 -- 172.21.15.78:0/2801653103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bd8142970 msgr2=0x7f1bd806f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bd8142970 0x7f1bd806f540 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1bd814b1a0 tx=0x7f1bc800c880 comp rx=0 tx=0).stop 2023-06-02T15:31:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 -- 172.21.15.78:0/2801653103 shutdown_connections 2023-06-02T15:31:23.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1bb8065c30 0x7f1bb80680e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bd8142970 0x7f1bd806f540 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f1bd8152500 0x7f1bd8150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 --2- 172.21.15.78:0/2801653103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc4003a20 0x7f1bd80bfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.166+0000 7f1bde217640 1 -- 172.21.15.78:0/2801653103 >> 172.21.15.78:0/2801653103 conn(0x7f1bd80a2170 msgr2=0x7f1bd80bc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:23.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.170+0000 7f1bde217640 1 -- 172.21.15.78:0/2801653103 shutdown_connections 2023-06-02T15:31:23.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.170+0000 7f1bde217640 1 -- 172.21.15.78:0/2801653103 wait complete. 2023-06-02T15:31:23.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-02T15:31:23.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603a2c1640 1 Processor -- start 2023-06-02T15:31:23.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603a2c1640 1 -- start start 2023-06-02T15:31:23.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603a2c1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f603406cfc0 0x7f60340718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603a2c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f603406c250 0x7f6034149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603a2c1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f603414d220 con 0x7f60340a59e0 2023-06-02T15:31:23.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603a2c1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60340ba640 con 0x7f603406cfc0 2023-06-02T15:31:23.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603a2c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603414cd30 con 0x7f603406c250 2023-06-02T15:31:23.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6033fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f60340a59e0 0x7f603414f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57126/0 (socket says 172.21.15.78:57126) 2023-06-02T15:31:23.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6033fff640 1 -- 172.21.15.78:0/1119456826 learned_addr learned my addr 172.21.15.78:0/1119456826 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:23.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3417581021 0 0) 0x7f603414d220 con 0x7f60340a59e0 2023-06-02T15:31:23.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6014003530 con 0x7f60340a59e0 2023-06-02T15:31:23.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603885e640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f603406c250 0x7f6034149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f60337fe640 1 --2- 172.21.15.78:0/1119456826 >> v2:172.21.15.132:3300/0 conn(0x7f603406cfc0 0x7f60340718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701701920 0 0) 0x7f6014003530 con 0x7f60340a59e0 2023-06-02T15:31:23.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f603406c250 msgr2=0x7f6034149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f603406c250 0x7f6034149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 >> v2:172.21.15.132:3300/0 conn(0x7f603406cfc0 msgr2=0x7f60340718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 --2- 172.21.15.78:0/1119456826 >> v2:172.21.15.132:3300/0 conn(0x7f603406cfc0 0x7f60340718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60340ba850 con 0x7f60340a59e0 2023-06-02T15:31:23.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f6024001680 con 0x7f60340a59e0 2023-06-02T15:31:23.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 >> v1:172.21.15.78:6789/0 conn(0x7f60340a59e0 legacy=0x7f603414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60140039f0 0x7f6014003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f603406c250 0x7f60140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 0x7f6014005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60340ba640 con 0x7f6014004d10 2023-06-02T15:31:23.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603414cd30 con 0x7f60140039f0 2023-06-02T15:31:23.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601400bb20 con 0x7f603406c250 2023-06-02T15:31:23.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603885e640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 0x7f6014005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f6033fff640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60140039f0 0x7f6014003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f60337fe640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f603406c250 0x7f60140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603885e640 1 -- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f603406c250 msgr2=0x7f60140047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603885e640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f603406c250 0x7f60140047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603885e640 1 -- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60140039f0 msgr2=0x7f6014003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603885e640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60140039f0 0x7f6014003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.294+0000 7f603885e640 1 -- 172.21.15.78:0/1119456826 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014003530 con 0x7f6014004d10 2023-06-02T15:31:23.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603885e640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 0x7f6014005180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f602c00ba30 tx=0x7f602c01c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8053dc5c022a520 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c0ac620 con 0x7f6014004d10 2023-06-02T15:31:23.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f602c0a6040 con 0x7f6014004d10 2023-06-02T15:31:23.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f6032ffd640 1 -- 172.21.15.78:0/1119456826 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602c0ac9c0 con 0x7f6014004d10 2023-06-02T15:31:23.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 -- 172.21.15.78:0/1119456826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 msgr2=0x7f6014005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 --2- 172.21.15.78:0/1119456826 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 0x7f6014005180 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f602c00ba30 tx=0x7f602c01c680 comp rx=0 tx=0).stop 2023-06-02T15:31:23.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603885e640 1 -- 172.21.15.78:0/1119456826 reap_dead start 2023-06-02T15:31:23.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 -- 172.21.15.78:0/1119456826 shutdown_connections 2023-06-02T15:31:23.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 -- 172.21.15.78:0/1119456826 >> 172.21.15.78:0/1119456826 conn(0x7f60340a2170 msgr2=0x7f60340a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:23.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 -- 172.21.15.78:0/1119456826 shutdown_connections 2023-06-02T15:31:23.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 -- 172.21.15.78:0/1119456826 wait complete. 2023-06-02T15:31:23.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 Processor -- start 2023-06-02T15:31:23.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 -- start start 2023-06-02T15:31:23.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 0x7f6034070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6034147e80 0x7f6034147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60341477b0 0x7f60341439c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60341468d0 con 0x7f6014004d10 2023-06-02T15:31:23.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6034070c80 con 0x7f60341477b0 2023-06-02T15:31:23.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.298+0000 7f603a2c1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6034144960 con 0x7f6034147e80 2023-06-02T15:31:23.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6033fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 0x7f6034070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6033fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 0x7f6034070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39496/0 (socket says 172.21.15.78:39496) 2023-06-02T15:31:23.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6033fff640 1 -- 172.21.15.78:0/342582309 learned_addr learned my addr 172.21.15.78:0/342582309 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:23.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6033fff640 1 -- 172.21.15.78:0/342582309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6034147e80 msgr2=0x7f6034147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6033fff640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6034147e80 0x7f6034147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6033fff640 1 -- 172.21.15.78:0/342582309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60341477b0 msgr2=0x7f60341439c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f603885e640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60341477b0 0x7f60341439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6033fff640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60341477b0 0x7f60341439c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6033fff640 1 -- 172.21.15.78:0/342582309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603414ff50 con 0x7f6014004d10 2023-06-02T15:31:23.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6033fff640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 0x7f6034070740 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f60240017b0 tx=0x7f6024011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6030ff9640 1 -- 172.21.15.78:0/342582309 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f602400fb60 con 0x7f6014004d10 2023-06-02T15:31:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6030ff9640 1 -- 172.21.15.78:0/342582309 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6024011ed0 con 0x7f6014004d10 2023-06-02T15:31:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f603a2c1640 1 -- 172.21.15.78:0/342582309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603414cf40 con 0x7f6014004d10 2023-06-02T15:31:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6030ff9640 1 -- 172.21.15.78:0/342582309 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6024015410 con 0x7f6014004d10 2023-06-02T15:31:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f603a2c1640 1 -- 172.21.15.78:0/342582309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60340a5db0 con 0x7f6014004d10 2023-06-02T15:31:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f603a2c1640 1 -- 172.21.15.78:0/342582309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6034073bc0 con 0x7f6014004d10 2023-06-02T15:31:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6030ff9640 1 -- 172.21.15.78:0/342582309 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f6024015570 con 0x7f6014004d10 2023-06-02T15:31:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6030ff9640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6018065c30 0x7f60180680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f6030ff9640 1 -- 172.21.15.78:0/342582309 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f60240868c0 con 0x7f6014004d10 2023-06-02T15:31:23.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f60337fe640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6018065c30 0x7f60180680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.302+0000 7f60337fe640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6018065c30 0x7f60180680e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f601c003fd0 tx=0x7f601c0039c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.306+0000 7f6030ff9640 1 -- 172.21.15.78:0/342582309 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f6024053e30 con 0x7f6014004d10 2023-06-02T15:31:23.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 -- 172.21.15.78:0/342582309 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f603414fd30 con 0x7f6014004d10 2023-06-02T15:31:23.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f6030ff9640 1 -- 172.21.15.78:0/342582309 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6024057450 con 0x7f6014004d10 2023-06-02T15:31:23.466 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-02T15:31:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 -- 172.21.15.78:0/342582309 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6018065c30 msgr2=0x7f60180680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6018065c30 0x7f60180680e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f601c003fd0 tx=0x7f601c0039c0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 -- 172.21.15.78:0/342582309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 msgr2=0x7f6034070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 0x7f6034070740 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f60240017b0 tx=0x7f6024011c80 comp rx=0 tx=0).stop 2023-06-02T15:31:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 -- 172.21.15.78:0/342582309 shutdown_connections 2023-06-02T15:31:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60341477b0 0x7f60341439c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6034147e80 0x7f6034147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6018065c30 0x7f60180680e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 --2- 172.21.15.78:0/342582309 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6014004d10 0x7f6034070740 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 -- 172.21.15.78:0/342582309 >> 172.21.15.78:0/342582309 conn(0x7f60340a2170 msgr2=0x7f60340be890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 -- 172.21.15.78:0/342582309 shutdown_connections 2023-06-02T15:31:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.458+0000 7f603a2c1640 1 -- 172.21.15.78:0/342582309 wait complete. 2023-06-02T15:31:23.482 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2023-06-02T15:31:23.483 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2023-06-02T15:31:23.488 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:31:23.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.586+0000 7f5df324e640 1 Processor -- start 2023-06-02T15:31:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.586+0000 7f5df324e640 1 -- start start 2023-06-02T15:31:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.586+0000 7f5df324e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec0bc1c0 0x7f5dec14bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.586+0000 7f5df324e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5dec14f330 0x7f5dec0a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.586+0000 7f5df324e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dec14ba90 con 0x7f5dec0a0020 2023-06-02T15:31:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.586+0000 7f5df324e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dec14f7c0 con 0x7f5dec14f330 2023-06-02T15:31:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.586+0000 7f5df324e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec14b440 con 0x7f5dec0bc1c0 2023-06-02T15:31:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df17eb640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5dec0a0020 0x7f5dec1487d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57130/0 (socket says 172.21.15.78:57130) 2023-06-02T15:31:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df17eb640 1 -- 172.21.15.78:0/2322812492 learned_addr learned my addr 172.21.15.78:0/2322812492 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103607985 0 0) 0x7f5dec14ba90 con 0x7f5dec0a0020 2023-06-02T15:31:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd4003530 con 0x7f5dec0a0020 2023-06-02T15:31:23.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df0fea640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec0bc1c0 0x7f5dec14bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de3fff640 1 --2- 172.21.15.78:0/2322812492 >> v2:172.21.15.132:3300/0 conn(0x7f5dec14f330 0x7f5dec0a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1205671433 0 0) 0x7f5dd4003530 con 0x7f5dec0a0020 2023-06-02T15:31:23.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec0bc1c0 msgr2=0x7f5dec14bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec0bc1c0 0x7f5dec14bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 >> v2:172.21.15.132:3300/0 conn(0x7f5dec14f330 msgr2=0x7f5dec0a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 --2- 172.21.15.78:0/2322812492 >> v2:172.21.15.132:3300/0 conn(0x7f5dec14f330 0x7f5dec0a40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec14b720 con 0x7f5dec0a0020 2023-06-02T15:31:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f5de4001a00 con 0x7f5dec0a0020 2023-06-02T15:31:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 >> v1:172.21.15.78:6789/0 conn(0x7f5dec0a0020 legacy=0x7f5dec1487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec0bc1c0 0x7f5dd4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd4003fb0 0x7f5dd40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dd4004d10 0x7f5dd4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec14f7c0 con 0x7f5dd4004d10 2023-06-02T15:31:23.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec14b440 con 0x7f5dd4003fb0 2023-06-02T15:31:23.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd400bbd0 con 0x7f5dec0bc1c0 2023-06-02T15:31:23.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df17eb640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dd4004d10 0x7f5dd4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df0fea640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec0bc1c0 0x7f5dd4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de3fff640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd4003fb0 0x7f5dd40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df17eb640 1 -- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec0bc1c0 msgr2=0x7f5dd4003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df17eb640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec0bc1c0 0x7f5dd4003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df17eb640 1 -- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd4003fb0 msgr2=0x7f5dd40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df17eb640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd4003fb0 0x7f5dd40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df17eb640 1 -- 172.21.15.78:0/2322812492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4003530 con 0x7f5dd4004d10 2023-06-02T15:31:23.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df17eb640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dd4004d10 0x7f5dd4005180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5de400a8d0 tx=0x7f5de401d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37687b717b5f7f71 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40ad630 con 0x7f5dd4004d10 2023-06-02T15:31:23.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de40a8070 con 0x7f5dd4004d10 2023-06-02T15:31:23.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5de37fe640 1 -- 172.21.15.78:0/2322812492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de40ad9d0 con 0x7f5dd4004d10 2023-06-02T15:31:23.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df324e640 1 -- 172.21.15.78:0/2322812492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dd4004d10 msgr2=0x7f5dd4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df324e640 1 --2- 172.21.15.78:0/2322812492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dd4004d10 0x7f5dd4005180 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5de400a8d0 tx=0x7f5de401d3e0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df17eb640 1 -- 172.21.15.78:0/2322812492 reap_dead start 2023-06-02T15:31:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df324e640 1 -- 172.21.15.78:0/2322812492 shutdown_connections 2023-06-02T15:31:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df324e640 1 -- 172.21.15.78:0/2322812492 >> 172.21.15.78:0/2322812492 conn(0x7f5dec0bcf50 msgr2=0x7f5dec0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df324e640 1 -- 172.21.15.78:0/2322812492 shutdown_connections 2023-06-02T15:31:23.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.590+0000 7f5df324e640 1 -- 172.21.15.78:0/2322812492 wait complete. 2023-06-02T15:31:23.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 Processor -- start 2023-06-02T15:31:23.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 -- start start 2023-06-02T15:31:23.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dec0a0d40 0x7f5dec1468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dec154920 0x7f5dec151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec1521d0 0x7f5dec1458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec153350 con 0x7f5dec154920 2023-06-02T15:31:23.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec153ef0 con 0x7f5dec0a0d40 2023-06-02T15:31:23.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dec1465e0 con 0x7f5dec1521d0 2023-06-02T15:31:23.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dec154920 0x7f5dec151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dec154920 0x7f5dec151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:39504/0 (socket says 172.21.15.78:39504) 2023-06-02T15:31:23.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de3fff640 1 -- 172.21.15.78:0/2324067393 learned_addr learned my addr 172.21.15.78:0/2324067393 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:23.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df0fea640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dec0a0d40 0x7f5dec1468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de3fff640 1 -- 172.21.15.78:0/2324067393 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec1521d0 msgr2=0x7f5dec1458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df17eb640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec1521d0 0x7f5dec1458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.617 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de3fff640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec1521d0 0x7f5dec1458d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de3fff640 1 -- 172.21.15.78:0/2324067393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dec0a0d40 msgr2=0x7f5dec1468c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de3fff640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dec0a0d40 0x7f5dec1468c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de3fff640 1 -- 172.21.15.78:0/2324067393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dec0bcb90 con 0x7f5dec154920 2023-06-02T15:31:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df0fea640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dec0a0d40 0x7f5dec1468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de3fff640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dec154920 0x7f5dec151c90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00f5d0 tx=0x7f5ddc00fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de17fa640 1 -- 172.21.15.78:0/2324067393 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc014870 con 0x7f5dec154920 2023-06-02T15:31:23.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de17fa640 1 -- 172.21.15.78:0/2324067393 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ddc0149d0 con 0x7f5dec154920 2023-06-02T15:31:23.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 -- 172.21.15.78:0/2324067393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dec0bca00 con 0x7f5dec154920 2023-06-02T15:31:23.619 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de17fa640 1 -- 172.21.15.78:0/2324067393 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc014d80 con 0x7f5dec154920 2023-06-02T15:31:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 -- 172.21.15.78:0/2324067393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dec0a45e0 con 0x7f5dec154920 2023-06-02T15:31:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5df324e640 1 -- 172.21.15.78:0/2324067393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dec1525d0 con 0x7f5dec154920 2023-06-02T15:31:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.594+0000 7f5de17fa640 1 -- 172.21.15.78:0/2324067393 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f5ddc00b440 con 0x7f5dec154920 2023-06-02T15:31:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.598+0000 7f5de17fa640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5dd8065c00 0x7f5dd80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.598+0000 7f5de17fa640 1 -- 172.21.15.78:0/2324067393 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5ddc084120 con 0x7f5dec154920 2023-06-02T15:31:23.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.598+0000 7f5df0fea640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5dd8065c00 0x7f5dd80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.598+0000 7f5df0fea640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5dd8065c00 0x7f5dd80680b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5de800b8c0 tx=0x7f5de8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.602+0000 7f5de17fa640 1 -- 172.21.15.78:0/2324067393 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f5ddc051600 con 0x7f5dec154920 2023-06-02T15:31:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.742+0000 7f5df324e640 1 -- 172.21.15.78:0/2324067393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5dec073bc0 con 0x7f5dec154920 2023-06-02T15:31:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.742+0000 7f5de17fa640 1 -- 172.21.15.78:0/2324067393 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+19594 (secure 0 0 0) 0x7f5ddc054c20 con 0x7f5dec154920 2023-06-02T15:31:23.753 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:23.753 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":25,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:30:43.029487+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:31:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 -- 172.21.15.78:0/2324067393 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5dd8065c00 msgr2=0x7f5dd80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5dd8065c00 0x7f5dd80680b0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5de800b8c0 tx=0x7f5de8008040 comp rx=0 tx=0).stop 2023-06-02T15:31:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 -- 172.21.15.78:0/2324067393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dec154920 msgr2=0x7f5dec151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dec154920 0x7f5dec151c90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00f5d0 tx=0x7f5ddc00fa90 comp rx=0 tx=0).stop 2023-06-02T15:31:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 -- 172.21.15.78:0/2324067393 shutdown_connections 2023-06-02T15:31:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f5dec1521d0 0x7f5dec1458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5dd8065c00 0x7f5dd80680b0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5dec154920 0x7f5dec151c90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 --2- 172.21.15.78:0/2324067393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dec0a0d40 0x7f5dec1468c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 -- 172.21.15.78:0/2324067393 >> 172.21.15.78:0/2324067393 conn(0x7f5dec0bcf50 msgr2=0x7f5dec155060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 -- 172.21.15.78:0/2324067393 shutdown_connections 2023-06-02T15:31:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.746+0000 7f5df324e640 1 -- 172.21.15.78:0/2324067393 wait complete. 2023-06-02T15:31:23.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2023-06-02T15:30:31.844882+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2023-06-02T15:30:33.293644+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-06-02T15:30:36.277798+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-06-02T15:30:37.599884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-06-02T15:30:40.680165+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-06-02T15:31:23.771 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-06-02T15:31:23.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2f0c2640 1 Processor -- start 2023-06-02T15:31:23.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2f0c2640 1 -- start start 2023-06-02T15:31:23.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2f0c2640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c2814bdb0 0x7f7c280c3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2f0c2640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c280c3fa0 con 0x7f7c280a3ed0 2023-06-02T15:31:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2f0c2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c280a98e0 con 0x7f7c2814e540 2023-06-02T15:31:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2f0c2640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c280a96f0 con 0x7f7c2814bdb0 2023-06-02T15:31:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2ce5e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c2814bdb0 0x7f7c280c3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c27fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7c280a3ed0 0x7f7c280c2760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56098/0 (socket says 172.21.15.78:56098) 2023-06-02T15:31:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c27fff640 1 -- 172.21.15.78:0/3877601257 learned_addr learned my addr 172.21.15.78:0/3877601257 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2ce5e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c2814bdb0 0x7f7c280c3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33256/0 (socket says 172.21.15.78:33256) 2023-06-02T15:31:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2ce5e640 1 -- 172.21.15.78:0/3877601257 >> v1:172.21.15.132:6789/0 conn(0x7f7c2814e540 legacy=0x7f7c2814e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2ce5e640 1 -- 172.21.15.78:0/3877601257 >> v1:172.21.15.78:6789/0 conn(0x7f7c280a3ed0 legacy=0x7f7c280c2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2ce5e640 1 -- 172.21.15.78:0/3877601257 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280c4210 con 0x7f7c2814bdb0 2023-06-02T15:31:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c2ce5e640 1 --2- 172.21.15.78:0/3877601257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 0x7f7c280c3150 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0097c0 tx=0x7f7c1c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cf13ea5d0e7e45 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c277fe640 1 -- 172.21.15.78:0/3877601257 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0a8930 con 0x7f7c2814bdb0 2023-06-02T15:31:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c277fe640 1 -- 172.21.15.78:0/3877601257 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0a8a90 con 0x7f7c2814bdb0 2023-06-02T15:31:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.874+0000 7f7c277fe640 1 -- 172.21.15.78:0/3877601257 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0a8e20 con 0x7f7c2814bdb0 2023-06-02T15:31:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/3877601257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 msgr2=0x7f7c280c3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 --2- 172.21.15.78:0/3877601257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 0x7f7c280c3150 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0097c0 tx=0x7f7c1c01ec30 comp rx=0 tx=0).stop 2023-06-02T15:31:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/3877601257 shutdown_connections 2023-06-02T15:31:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 --2- 172.21.15.78:0/3877601257 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 0x7f7c280c3150 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/3877601257 >> 172.21.15.78:0/3877601257 conn(0x7f7c280a6470 msgr2=0x7f7c280a6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/3877601257 shutdown_connections 2023-06-02T15:31:23.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/3877601257 wait complete. 2023-06-02T15:31:23.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 Processor -- start 2023-06-02T15:31:23.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- start start 2023-06-02T15:31:23.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c280a3ed0 0x7f7c281db1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 0x7f7c28151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c2814e540 0x7f7c28152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281da0a0 con 0x7f7c2814bdb0 2023-06-02T15:31:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281e41b0 con 0x7f7c280a3ed0 2023-06-02T15:31:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c281db6e0 con 0x7f7c2814e540 2023-06-02T15:31:23.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c27fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 0x7f7c28151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c27fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 0x7f7c28151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33270/0 (socket says 172.21.15.78:33270) 2023-06-02T15:31:23.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c27fff640 1 -- 172.21.15.78:0/1873754376 learned_addr learned my addr 172.21.15.78:0/1873754376 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:23.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2ce5e640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c280a3ed0 0x7f7c281db1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c27fff640 1 -- 172.21.15.78:0/1873754376 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c2814e540 msgr2=0x7f7c28152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c27fff640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c2814e540 0x7f7c28152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c27fff640 1 -- 172.21.15.78:0/1873754376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c280a3ed0 msgr2=0x7f7c281db1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c27fff640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c280a3ed0 0x7f7c281db1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c27fff640 1 -- 172.21.15.78:0/1873754376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c009420 con 0x7f7c2814bdb0 2023-06-02T15:31:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c27fff640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 0x7f7c28151f40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c500 tx=0x7f7c1400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c257fa640 1 -- 172.21.15.78:0/1873754376 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14005cf0 con 0x7f7c2814bdb0 2023-06-02T15:31:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c257fa640 1 -- 172.21.15.78:0/1873754376 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14005e50 con 0x7f7c2814bdb0 2023-06-02T15:31:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/1873754376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c280a9bc0 con 0x7f7c2814bdb0 2023-06-02T15:31:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c257fa640 1 -- 172.21.15.78:0/1873754376 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c140072f0 con 0x7f7c2814bdb0 2023-06-02T15:31:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.878+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/1873754376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c280c2e70 con 0x7f7c2814bdb0 2023-06-02T15:31:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.882+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/1873754376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2814f090 con 0x7f7c2814bdb0 2023-06-02T15:31:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.882+0000 7f7c257fa640 1 -- 172.21.15.78:0/1873754376 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f7c14007450 con 0x7f7c2814bdb0 2023-06-02T15:31:23.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.882+0000 7f7c257fa640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7c0c065c00 0x7f7c0c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.882+0000 7f7c257fa640 1 -- 172.21.15.78:0/1873754376 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7c14082b10 con 0x7f7c2814bdb0 2023-06-02T15:31:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.882+0000 7f7c2ce5e640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7c0c065c00 0x7f7c0c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.882+0000 7f7c2ce5e640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7c0c065c00 0x7f7c0c0680b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0b2000 tx=0x7f7c1c0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:23.886+0000 7f7c257fa640 1 -- 172.21.15.78:0/1873754376 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f7c1404a6e0 con 0x7f7c2814bdb0 2023-06-02T15:31:24.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/1873754376 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f7c281529c0 con 0x7f7c2814bdb0 2023-06-02T15:31:24.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c257fa640 1 -- 172.21.15.78:0/1873754376 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v25) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7c140170a0 con 0x7f7c2814bdb0 2023-06-02T15:31:24.035 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 8 2023-06-02T15:31:24.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/1873754376 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7c0c065c00 msgr2=0x7f7c0c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7c0c065c00 0x7f7c0c0680b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0b2000 tx=0x7f7c1c0aa070 comp rx=0 tx=0).stop 2023-06-02T15:31:24.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/1873754376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 msgr2=0x7f7c28151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 0x7f7c28151f40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7c1400c500 tx=0x7f7c1400c9c0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/1873754376 shutdown_connections 2023-06-02T15:31:24.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7c2814e540 0x7f7c28152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7c0c065c00 0x7f7c0c0680b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c2814bdb0 0x7f7c28151f40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 --2- 172.21.15.78:0/1873754376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c280a3ed0 0x7f7c281db1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/1873754376 >> 172.21.15.78:0/1873754376 conn(0x7f7c280a6470 msgr2=0x7f7c28149ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:24.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/1873754376 shutdown_connections 2023-06-02T15:31:24.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.026+0000 7f7c2f0c2640 1 -- 172.21.15.78:0/1873754376 wait complete. 2023-06-02T15:31:24.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-06-02T15:31:24.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a637e7640 1 Processor -- start 2023-06-02T15:31:24.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a637e7640 1 -- start start 2023-06-02T15:31:24.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a637e7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a5c06bd60 0x7f3a5c06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a637e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3a5c0aa5b0 0x7f3a5c06a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a637e7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c06ada0 con 0x7f3a5c151f90 2023-06-02T15:31:24.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a637e7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c0c0a50 con 0x7f3a5c06bd60 2023-06-02T15:31:24.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a637e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c152360 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a61583640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3a5c151f90 0x7f3a5c0c1260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56108/0 (socket says 172.21.15.78:56108) 2023-06-02T15:31:24.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a61583640 1 -- 172.21.15.78:0/3955169131 learned_addr learned my addr 172.21.15.78:0/3955169131 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:24.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a60d82640 1 --2- 172.21.15.78:0/3955169131 >> v2:172.21.15.78:3300/0 conn(0x7f3a5c06bd60 0x7f3a5c06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a61d84640 1 --2- 172.21.15.78:0/3955169131 >> v2:172.21.15.132:3300/0 conn(0x7f3a5c0aa5b0 0x7f3a5c06a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a60d82640 1 -- 172.21.15.78:0/3955169131 >> v2:172.21.15.132:3300/0 conn(0x7f3a5c0aa5b0 msgr2=0x7f3a5c06a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:24.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a60d82640 1 --2- 172.21.15.78:0/3955169131 >> v2:172.21.15.132:3300/0 conn(0x7f3a5c0aa5b0 0x7f3a5c06a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a60d82640 1 -- 172.21.15.78:0/3955169131 >> v1:172.21.15.78:6789/0 conn(0x7f3a5c151f90 legacy=0x7f3a5c0c1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a60d82640 1 -- 172.21.15.78:0/3955169131 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c152620 con 0x7f3a5c06bd60 2023-06-02T15:31:24.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a60d82640 1 --2- 172.21.15.78:0/3955169131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c06bd60 0x7f3a5c06a320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0a42e0 tx=0x7f3a5801ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af753a7bb4d2db5d server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:24.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.154+0000 7f3a53fff640 1 -- 172.21.15.78:0/3955169131 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580a8950 con 0x7f3a5c06bd60 2023-06-02T15:31:24.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a53fff640 1 -- 172.21.15.78:0/3955169131 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580a8ab0 con 0x7f3a5c06bd60 2023-06-02T15:31:24.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a53fff640 1 -- 172.21.15.78:0/3955169131 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580a8e40 con 0x7f3a5c06bd60 2023-06-02T15:31:24.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- 172.21.15.78:0/3955169131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c06bd60 msgr2=0x7f3a5c06a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 --2- 172.21.15.78:0/3955169131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c06bd60 0x7f3a5c06a320 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c0a42e0 tx=0x7f3a5801ec50 comp rx=0 tx=0).stop 2023-06-02T15:31:24.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- 172.21.15.78:0/3955169131 shutdown_connections 2023-06-02T15:31:24.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 --2- 172.21.15.78:0/3955169131 >> v2:172.21.15.132:3300/0 conn(0x7f3a5c0aa5b0 0x7f3a5c06a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 --2- 172.21.15.78:0/3955169131 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c06bd60 0x7f3a5c06a320 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- 172.21.15.78:0/3955169131 >> 172.21.15.78:0/3955169131 conn(0x7f3a5c0a63c0 msgr2=0x7f3a5c0a67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:24.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- 172.21.15.78:0/3955169131 shutdown_connections 2023-06-02T15:31:24.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- 172.21.15.78:0/3955169131 wait complete. 2023-06-02T15:31:24.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 Processor -- start 2023-06-02T15:31:24.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- start start 2023-06-02T15:31:24.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a5c06bd60 0x7f3a5c0bdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0aa5b0 0x7f3a5c14e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a5c151f90 0x7f3a5c14ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c1e78c0 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0be290 con 0x7f3a5c06bd60 2023-06-02T15:31:24.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c1e6cf0 con 0x7f3a5c151f90 2023-06-02T15:31:24.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a60d82640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0aa5b0 0x7f3a5c14e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a60d82640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0aa5b0 0x7f3a5c14e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33294/0 (socket says 172.21.15.78:33294) 2023-06-02T15:31:24.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a60d82640 1 -- 172.21.15.78:0/3216588446 learned_addr learned my addr 172.21.15.78:0/3216588446 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:24.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a60d82640 1 -- 172.21.15.78:0/3216588446 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a5c151f90 msgr2=0x7f3a5c14ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a60d82640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a5c151f90 0x7f3a5c14ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a60d82640 1 -- 172.21.15.78:0/3216588446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a5c06bd60 msgr2=0x7f3a5c0bdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a60d82640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a5c06bd60 0x7f3a5c0bdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a60d82640 1 -- 172.21.15.78:0/3216588446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58009420 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a60d82640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0aa5b0 0x7f3a5c14e6f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a5801c880 tx=0x7f3a5801b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:24.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a51ffb640 1 -- 172.21.15.78:0/3216588446 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580b9630 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a51ffb640 1 -- 172.21.15.78:0/3216588446 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580b97b0 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- 172.21.15.78:0/3216588446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c0c1970 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a51ffb640 1 -- 172.21.15.78:0/3216588446 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580b9b60 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- 172.21.15.78:0/3216588446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c152900 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.158+0000 7f3a637e7640 1 -- 172.21.15.78:0/3216588446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c0bf320 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.162+0000 7f3a51ffb640 1 -- 172.21.15.78:0/3216588446 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f3a580b7040 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.162+0000 7f3a51ffb640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3a40065c00 0x7f3a400680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.162+0000 7f3a51ffb640 1 -- 172.21.15.78:0/3216588446 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3a58121720 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.162+0000 7f3a61583640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3a40065c00 0x7f3a400680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.162+0000 7f3a61583640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3a40065c00 0x7f3a400680b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c001560 tx=0x7f3a4c007a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:24.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.166+0000 7f3a51ffb640 1 -- 172.21.15.78:0/3216588446 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f3a580eec00 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.310+0000 7f3a637e7640 1 -- 172.21.15.78:0/3216588446 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3a5c1e7a70 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a51ffb640 1 -- 172.21.15.78:0/3216588446 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3a5c1e7a70 con 0x7f3a5c0aa5b0 2023-06-02T15:31:24.321 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-06-02T15:31:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 -- 172.21.15.78:0/3216588446 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3a40065c00 msgr2=0x7f3a400680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3a40065c00 0x7f3a400680b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c001560 tx=0x7f3a4c007a50 comp rx=0 tx=0).stop 2023-06-02T15:31:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 -- 172.21.15.78:0/3216588446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0aa5b0 msgr2=0x7f3a5c14e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0aa5b0 0x7f3a5c14e6f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3a5801c880 tx=0x7f3a5801b9f0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 -- 172.21.15.78:0/3216588446 shutdown_connections 2023-06-02T15:31:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3a5c151f90 0x7f3a5c14ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3a40065c00 0x7f3a400680b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a5c0aa5b0 0x7f3a5c14e6f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 --2- 172.21.15.78:0/3216588446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3a5c06bd60 0x7f3a5c0bdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 -- 172.21.15.78:0/3216588446 >> 172.21.15.78:0/3216588446 conn(0x7f3a5c0a63c0 msgr2=0x7f3a5c150410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 -- 172.21.15.78:0/3216588446 shutdown_connections 2023-06-02T15:31:24.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.314+0000 7f3a637e7640 1 -- 172.21.15.78:0/3216588446 wait complete. 2023-06-02T15:31:24.338 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-06-02T15:31:24.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.446+0000 7f27f7571640 1 Processor -- start 2023-06-02T15:31:24.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.446+0000 7f27f7571640 1 -- start start 2023-06-02T15:31:24.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f7571640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27f00bd0b0 0x7f27f0071480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f7571640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 0x7f27f00bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f7571640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f27f006c060 0x7f27f006c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f7571640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00bcac0 con 0x7f27f00bd0b0 2023-06-02T15:31:24.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f7571640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27f00899f0 con 0x7f27f006c060 2023-06-02T15:31:24.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f7571640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00bc4a0 con 0x7f27f00bb1a0 2023-06-02T15:31:24.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f530d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27f00bd0b0 0x7f27f0071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f530d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27f00bd0b0 0x7f27f0071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33302/0 (socket says 172.21.15.78:33302) 2023-06-02T15:31:24.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f4b0c640 1 --2- 172.21.15.78:0/179078141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 0x7f27f00bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f530d640 1 -- 172.21.15.78:0/179078141 learned_addr learned my addr 172.21.15.78:0/179078141 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:24.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.450+0000 7f27f5b0e640 1 --2- 172.21.15.78:0/179078141 >> v2:172.21.15.132:3300/0 conn(0x7f27f006c060 0x7f27f006c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.486+0000 7f27f530d640 1 -- 172.21.15.78:0/179078141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 msgr2=0x7f27f00bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:24.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.486+0000 7f27f530d640 1 --2- 172.21.15.78:0/179078141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 0x7f27f00bba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.486+0000 7f27f530d640 1 -- 172.21.15.78:0/179078141 >> v2:172.21.15.132:3300/0 conn(0x7f27f006c060 msgr2=0x7f27f006c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:24.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.486+0000 7f27f530d640 1 --2- 172.21.15.78:0/179078141 >> v2:172.21.15.132:3300/0 conn(0x7f27f006c060 0x7f27f006c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.486+0000 7f27f530d640 1 -- 172.21.15.78:0/179078141 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27f00bb5b0 con 0x7f27f00bd0b0 2023-06-02T15:31:24.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.486+0000 7f27f5b0e640 1 --2- 172.21.15.78:0/179078141 >> v2:172.21.15.132:3300/0 conn(0x7f27f006c060 0x7f27f006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.486+0000 7f27f530d640 1 --2- 172.21.15.78:0/179078141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 0x7f27f0071480 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f27f00bdb30 tx=0x7f27e801cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acae96c5c1a163e8 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27e3fff640 1 -- 172.21.15.78:0/179078141 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80a5ba0 con 0x7f27f00bd0b0 2023-06-02T15:31:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27e3fff640 1 -- 172.21.15.78:0/179078141 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27e80a9070 con 0x7f27f00bd0b0 2023-06-02T15:31:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27e3fff640 1 -- 172.21.15.78:0/179078141 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e80af400 con 0x7f27f00bd0b0 2023-06-02T15:31:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 -- 172.21.15.78:0/179078141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 msgr2=0x7f27f0071480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 --2- 172.21.15.78:0/179078141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 0x7f27f0071480 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f27f00bdb30 tx=0x7f27e801cb10 comp rx=0 tx=0).stop 2023-06-02T15:31:24.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 -- 172.21.15.78:0/179078141 shutdown_connections 2023-06-02T15:31:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 --2- 172.21.15.78:0/179078141 >> v2:172.21.15.132:3300/0 conn(0x7f27f006c060 0x7f27f006c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 --2- 172.21.15.78:0/179078141 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 0x7f27f00bba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 --2- 172.21.15.78:0/179078141 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 0x7f27f0071480 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 -- 172.21.15.78:0/179078141 >> 172.21.15.78:0/179078141 conn(0x7f27f00698f0 msgr2=0x7f27f0069cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 -- 172.21.15.78:0/179078141 shutdown_connections 2023-06-02T15:31:24.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 -- 172.21.15.78:0/179078141 wait complete. 2023-06-02T15:31:24.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 Processor -- start 2023-06-02T15:31:24.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.490+0000 7f27f7571640 1 -- start start 2023-06-02T15:31:24.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f7571640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27f006c060 0x7f27f00b7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f7571640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 0x7f27f00b86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f7571640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 0x7f27f00b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f7571640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00ba540 con 0x7f27f00bd0b0 2023-06-02T15:31:24.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f7571640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f00b8270 con 0x7f27f006c060 2023-06-02T15:31:24.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f7571640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f0099920 con 0x7f27f00bb1a0 2023-06-02T15:31:24.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f5b0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 0x7f27f00b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f5b0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 0x7f27f00b8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33306/0 (socket says 172.21.15.78:33306) 2023-06-02T15:31:24.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f5b0e640 1 -- 172.21.15.78:0/4020818185 learned_addr learned my addr 172.21.15.78:0/4020818185 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:24.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f530d640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27f006c060 0x7f27f00b7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f4b0c640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 0x7f27f00b86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f5b0e640 1 -- 172.21.15.78:0/4020818185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 msgr2=0x7f27f00b86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f5b0e640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 0x7f27f00b86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f5b0e640 1 -- 172.21.15.78:0/4020818185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27f006c060 msgr2=0x7f27f00b7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f5b0e640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27f006c060 0x7f27f00b7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f5b0e640 1 -- 172.21.15.78:0/4020818185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e80077f0 con 0x7f27f00bd0b0 2023-06-02T15:31:24.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f4b0c640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 0x7f27f00b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:24.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f5b0e640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 0x7f27f00b8bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00e5e0 tx=0x7f27ec00eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:24.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27e1ffb640 1 -- 172.21.15.78:0/4020818185 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec004230 con 0x7f27f00bd0b0 2023-06-02T15:31:24.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f7571640 1 -- 172.21.15.78:0/4020818185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27f006ce30 con 0x7f27f00bd0b0 2023-06-02T15:31:24.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27e1ffb640 1 -- 172.21.15.78:0/4020818185 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27ec004390 con 0x7f27f00bd0b0 2023-06-02T15:31:24.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27e1ffb640 1 -- 172.21.15.78:0/4020818185 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ec003860 con 0x7f27f00bd0b0 2023-06-02T15:31:24.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f7571640 1 -- 172.21.15.78:0/4020818185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f00bc750 con 0x7f27f00bd0b0 2023-06-02T15:31:24.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27f7571640 1 -- 172.21.15.78:0/4020818185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f00bd480 con 0x7f27f00bd0b0 2023-06-02T15:31:24.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.494+0000 7f27e1ffb640 1 -- 172.21.15.78:0/4020818185 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f27ec0039c0 con 0x7f27f00bd0b0 2023-06-02T15:31:24.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.498+0000 7f27e1ffb640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f27d4065c00 0x7f27d40680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.498+0000 7f27f530d640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f27d4065c00 0x7f27d40680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.498+0000 7f27e1ffb640 1 -- 172.21.15.78:0/4020818185 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f27ec0837f0 con 0x7f27f00bd0b0 2023-06-02T15:31:24.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.498+0000 7f27f530d640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f27d4065c00 0x7f27d40680b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f27e80b0000 tx=0x7f27e8004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:24.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.506+0000 7f27e1ffb640 1 -- 172.21.15.78:0/4020818185 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f27ec050cb0 con 0x7f27f00bd0b0 2023-06-02T15:31:24.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 -- 172.21.15.78:0/4020818185 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f27f00ba0c0 con 0x7f27f00bd0b0 2023-06-02T15:31:24.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27e1ffb640 1 -- 172.21.15.78:0/4020818185 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f27f00ba0c0 con 0x7f27f00bd0b0 2023-06-02T15:31:24.666 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:24.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 -- 172.21.15.78:0/4020818185 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f27d4065c00 msgr2=0x7f27d40680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f27d4065c00 0x7f27d40680b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f27e80b0000 tx=0x7f27e8004ac0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 -- 172.21.15.78:0/4020818185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 msgr2=0x7f27f00b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 0x7f27f00b8bf0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f27ec00e5e0 tx=0x7f27ec00eaa0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 -- 172.21.15.78:0/4020818185 shutdown_connections 2023-06-02T15:31:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f27d4065c00 0x7f27d40680b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27f00bd0b0 0x7f27f00b8bf0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f27f00bb1a0 0x7f27f00b86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 --2- 172.21.15.78:0/4020818185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27f006c060 0x7f27f00b7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 -- 172.21.15.78:0/4020818185 >> 172.21.15.78:0/4020818185 conn(0x7f27f00698f0 msgr2=0x7f27f0161f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 -- 172.21.15.78:0/4020818185 shutdown_connections 2023-06-02T15:31:24.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.658+0000 7f27f7571640 1 -- 172.21.15.78:0/4020818185 wait complete. 2023-06-02T15:31:24.683 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-06-02T15:31:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.798+0000 7fcbeb198640 1 Processor -- start 2023-06-02T15:31:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.798+0000 7fcbeb198640 1 -- start start 2023-06-02T15:31:24.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbeb198640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcbe406cfc0 0x7fcbe40718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbeb198640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe406c250 0x7fcbe4149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbeb198640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbe414d220 con 0x7fcbe40a59e0 2023-06-02T15:31:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbeb198640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbe40ba640 con 0x7fcbe406cfc0 2023-06-02T15:31:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbeb198640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe414cd30 con 0x7fcbe406c250 2023-06-02T15:31:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe8f34640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcbe40a59e0 0x7fcbe414f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56112/0 (socket says 172.21.15.78:56112) 2023-06-02T15:31:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe8f34640 1 -- 172.21.15.78:0/3346893714 learned_addr learned my addr 172.21.15.78:0/3346893714 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259614978 0 0) 0x7fcbe414d220 con 0x7fcbe40a59e0 2023-06-02T15:31:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbcc003530 con 0x7fcbe40a59e0 2023-06-02T15:31:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe3fff640 1 --2- 172.21.15.78:0/3346893714 >> v2:172.21.15.132:3300/0 conn(0x7fcbe406cfc0 0x7fcbe40718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe9735640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe406c250 0x7fcbe4149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 755804350 0 0) 0x7fcbcc003530 con 0x7fcbe40a59e0 2023-06-02T15:31:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe406c250 msgr2=0x7fcbe4149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe406c250 0x7fcbe4149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 >> v2:172.21.15.132:3300/0 conn(0x7fcbe406cfc0 msgr2=0x7fcbe40718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:24.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 --2- 172.21.15.78:0/3346893714 >> v2:172.21.15.132:3300/0 conn(0x7fcbe406cfc0 0x7fcbe40718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe40ba850 con 0x7fcbe40a59e0 2023-06-02T15:31:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fcbdc001680 con 0x7fcbe40a59e0 2023-06-02T15:31:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 >> v1:172.21.15.78:6789/0 conn(0x7fcbe40a59e0 legacy=0x7fcbe414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbcc0039f0 0x7fcbcc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbcc005180 0x7fcbcc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40ba640 con 0x7fcbcc0047d0 2023-06-02T15:31:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe414cd30 con 0x7fcbcc0039f0 2023-06-02T15:31:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbcc00c080 con 0x7fcbcc005180 2023-06-02T15:31:24.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe9735640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe406c250 0x7fcbe4149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe3fff640 1 --2- 172.21.15.78:0/3346893714 >> v2:172.21.15.132:3300/0 conn(0x7fcbe406cfc0 0x7fcbe40718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:31:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe3fff640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe8f34640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbcc0039f0 0x7fcbcc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe9735640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbcc005180 0x7fcbcc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe3fff640 1 -- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbcc005180 msgr2=0x7fcbcc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe3fff640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbcc005180 0x7fcbcc00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe3fff640 1 -- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbcc0039f0 msgr2=0x7fcbcc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe3fff640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbcc0039f0 0x7fcbcc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe3fff640 1 -- 172.21.15.78:0/3346893714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc003530 con 0x7fcbcc0047d0 2023-06-02T15:31:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe8f34640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbcc0039f0 0x7fcbcc003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe3fff640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80098a0 tx=0x7fcbd801c5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72b85ce380d5022e server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80aa670 con 0x7fcbcc0047d0 2023-06-02T15:31:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbd80aa7d0 con 0x7fcbcc0047d0 2023-06-02T15:31:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.802+0000 7fcbe37fe640 1 -- 172.21.15.78:0/3346893714 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbd80aab60 con 0x7fcbcc0047d0 2023-06-02T15:31:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- 172.21.15.78:0/3346893714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 msgr2=0x7fcbcc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 --2- 172.21.15.78:0/3346893714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 0x7fcbcc004c40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80098a0 tx=0x7fcbd801c5c0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe9735640 1 -- 172.21.15.78:0/3346893714 reap_dead start 2023-06-02T15:31:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- 172.21.15.78:0/3346893714 shutdown_connections 2023-06-02T15:31:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- 172.21.15.78:0/3346893714 >> 172.21.15.78:0/3346893714 conn(0x7fcbe40a2170 msgr2=0x7fcbe40a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- 172.21.15.78:0/3346893714 shutdown_connections 2023-06-02T15:31:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- 172.21.15.78:0/3346893714 wait complete. 2023-06-02T15:31:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 Processor -- start 2023-06-02T15:31:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- start start 2023-06-02T15:31:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 0x7fcbe406f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe40a1c90 0x7fcbe4070e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbe4070970 0x7fcbe4142370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe4071370 con 0x7fcbcc0047d0 2023-06-02T15:31:24.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe40705b0 con 0x7fcbe4070970 2023-06-02T15:31:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbe414efb0 con 0x7fcbe40a1c90 2023-06-02T15:31:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe8f34640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 0x7fcbe406f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe8f34640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 0x7fcbe406f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33312/0 (socket says 172.21.15.78:33312) 2023-06-02T15:31:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe8f34640 1 -- 172.21.15.78:0/1734829304 learned_addr learned my addr 172.21.15.78:0/1734829304 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe9735640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbe4070970 0x7fcbe4142370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe3fff640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe40a1c90 0x7fcbe4070e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe8f34640 1 -- 172.21.15.78:0/1734829304 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe40a1c90 msgr2=0x7fcbe4070e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe8f34640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe40a1c90 0x7fcbe4070e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe8f34640 1 -- 172.21.15.78:0/1734829304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbe4070970 msgr2=0x7fcbe4142370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe8f34640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbe4070970 0x7fcbe4142370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe8f34640 1 -- 172.21.15.78:0/1734829304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe40a5f40 con 0x7fcbcc0047d0 2023-06-02T15:31:24.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe3fff640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe40a1c90 0x7fcbe4070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:24.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe9735640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbe4070970 0x7fcbe4142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:24.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe8f34640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 0x7fcbe406f590 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc007fd0 tx=0x7fcbdc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:24.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe17fa640 1 -- 172.21.15.78:0/1734829304 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0074e0 con 0x7fcbcc0047d0 2023-06-02T15:31:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe17fa640 1 -- 172.21.15.78:0/1734829304 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc007640 con 0x7fcbcc0047d0 2023-06-02T15:31:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- 172.21.15.78:0/1734829304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbe40a5db0 con 0x7fcbcc0047d0 2023-06-02T15:31:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbe17fa640 1 -- 172.21.15.78:0/1734829304 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0049f0 con 0x7fcbcc0047d0 2023-06-02T15:31:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.806+0000 7fcbeb198640 1 -- 172.21.15.78:0/1734829304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbe4156bd0 con 0x7fcbcc0047d0 2023-06-02T15:31:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.810+0000 7fcbeb198640 1 -- 172.21.15.78:0/1734829304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbe4073bc0 con 0x7fcbcc0047d0 2023-06-02T15:31:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.810+0000 7fcbe17fa640 1 -- 172.21.15.78:0/1734829304 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fcbdc004b50 con 0x7fcbcc0047d0 2023-06-02T15:31:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.810+0000 7fcbe17fa640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcbd0065c00 0x7fcbd00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.810+0000 7fcbe17fa640 1 -- 172.21.15.78:0/1734829304 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcbdc083370 con 0x7fcbcc0047d0 2023-06-02T15:31:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.810+0000 7fcbe3fff640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcbd0065c00 0x7fcbd00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.810+0000 7fcbe3fff640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcbd0065c00 0x7fcbd00680b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80ae000 tx=0x7fcbd80046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:24.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.814+0000 7fcbe17fa640 1 -- 172.21.15.78:0/1734829304 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fcbdc054370 con 0x7fcbcc0047d0 2023-06-02T15:31:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.950+0000 7fcbeb198640 1 -- 172.21.15.78:0/1734829304 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbe414fb00 con 0x7fcbcc0047d0 2023-06-02T15:31:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbe17fa640 1 -- 172.21.15.78:0/1734829304 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbdc053f00 con 0x7fcbcc0047d0 2023-06-02T15:31:24.962 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-06-02T15:31:24.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 -- 172.21.15.78:0/1734829304 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcbd0065c00 msgr2=0x7fcbd00680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcbd0065c00 0x7fcbd00680b0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fcbd80ae000 tx=0x7fcbd80046d0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 -- 172.21.15.78:0/1734829304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 msgr2=0x7fcbe406f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:24.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 0x7fcbe406f590 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc007fd0 tx=0x7fcbdc00dd40 comp rx=0 tx=0).stop 2023-06-02T15:31:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 -- 172.21.15.78:0/1734829304 shutdown_connections 2023-06-02T15:31:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbe4070970 0x7fcbe4142370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcbe40a1c90 0x7fcbe4070e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcbd0065c00 0x7fcbd00680b0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 --2- 172.21.15.78:0/1734829304 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbcc0047d0 0x7fcbe406f590 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:24.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 -- 172.21.15.78:0/1734829304 >> 172.21.15.78:0/1734829304 conn(0x7fcbe40a2170 msgr2=0x7fcbe414a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 -- 172.21.15.78:0/1734829304 shutdown_connections 2023-06-02T15:31:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:24.954+0000 7fcbeb198640 1 -- 172.21.15.78:0/1734829304 wait complete. 2023-06-02T15:31:24.979 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-06-02T15:31:25.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.086+0000 7f6150300640 1 Processor -- start 2023-06-02T15:31:25.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f6150300640 1 -- start start 2023-06-02T15:31:25.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f6150300640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61480c0570 0x7f61480ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f6150300640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148071780 0x7f61480bc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f6150300640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61480a5f30 con 0x7f61481485c0 2023-06-02T15:31:25.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f6150300640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61480c1100 con 0x7f61480c0570 2023-06-02T15:31:25.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f6150300640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f614814bcc0 con 0x7f6148071780 2023-06-02T15:31:25.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f614e09c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61480c0570 0x7f61480ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f614e09c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f61480c0570 0x7f61480ba640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33328/0 (socket says 172.21.15.78:33328) 2023-06-02T15:31:25.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f614e09c640 1 -- 172.21.15.78:0/393140395 learned_addr learned my addr 172.21.15.78:0/393140395 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:25.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f614d89b640 1 --2- 172.21.15.78:0/393140395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148071780 0x7f61480bc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f614e09c640 1 -- 172.21.15.78:0/393140395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148071780 msgr2=0x7f61480bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:25.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f614e09c640 1 --2- 172.21.15.78:0/393140395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148071780 0x7f61480bc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f614e09c640 1 -- 172.21.15.78:0/393140395 >> v1:172.21.15.132:6789/0 conn(0x7f61481485c0 legacy=0x7f614814e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:25.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.090+0000 7f614e09c640 1 -- 172.21.15.78:0/393140395 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614814bfa0 con 0x7f61480c0570 2023-06-02T15:31:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e09c640 1 --2- 172.21.15.78:0/393140395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61480c0570 0x7f61480ba640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6144009e80 tx=0x7f614401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d1f55bef3f0ec54 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614d09a640 1 -- 172.21.15.78:0/393140395 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440a5710 con 0x7f61480c0570 2023-06-02T15:31:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614d09a640 1 -- 172.21.15.78:0/393140395 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61440a5870 con 0x7f61480c0570 2023-06-02T15:31:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614d09a640 1 -- 172.21.15.78:0/393140395 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61440a5c00 con 0x7f61480c0570 2023-06-02T15:31:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 -- 172.21.15.78:0/393140395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61480c0570 msgr2=0x7f61480ba640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 --2- 172.21.15.78:0/393140395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61480c0570 0x7f61480ba640 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f6144009e80 tx=0x7f614401c980 comp rx=0 tx=0).stop 2023-06-02T15:31:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 -- 172.21.15.78:0/393140395 shutdown_connections 2023-06-02T15:31:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 --2- 172.21.15.78:0/393140395 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148071780 0x7f61480bc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 --2- 172.21.15.78:0/393140395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61480c0570 0x7f61480ba640 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 -- 172.21.15.78:0/393140395 >> 172.21.15.78:0/393140395 conn(0x7f61480a2170 msgr2=0x7f61480a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:25.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 -- 172.21.15.78:0/393140395 shutdown_connections 2023-06-02T15:31:25.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 -- 172.21.15.78:0/393140395 wait complete. 2023-06-02T15:31:25.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 Processor -- start 2023-06-02T15:31:25.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 -- start start 2023-06-02T15:31:25.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148071780 0x7f6148070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61480c0570 0x7f614814cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61481485c0 0x7f61480bea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61480be640 con 0x7f61481485c0 2023-06-02T15:31:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61480bf710 con 0x7f61480c0570 2023-06-02T15:31:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61480705d0 con 0x7f6148071780 2023-06-02T15:31:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e89d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61481485c0 0x7f61480bea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e89d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61481485c0 0x7f61480bea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33342/0 (socket says 172.21.15.78:33342) 2023-06-02T15:31:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e89d640 1 -- 172.21.15.78:0/67451887 learned_addr learned my addr 172.21.15.78:0/67451887 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e09c640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148071780 0x7f6148070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614d89b640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61480c0570 0x7f614814cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e89d640 1 -- 172.21.15.78:0/67451887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148071780 msgr2=0x7f6148070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e89d640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148071780 0x7f6148070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e89d640 1 -- 172.21.15.78:0/67451887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61480c0570 msgr2=0x7f614814cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e89d640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61480c0570 0x7f614814cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e89d640 1 -- 172.21.15.78:0/67451887 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6144009b30 con 0x7f61481485c0 2023-06-02T15:31:25.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f614e89d640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61481485c0 0x7f61480bea60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f613c00b440 tx=0x7f613c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:25.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f613affd640 1 -- 172.21.15.78:0/67451887 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c011830 con 0x7f61481485c0 2023-06-02T15:31:25.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f613affd640 1 -- 172.21.15.78:0/67451887 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f613c0119b0 con 0x7f61481485c0 2023-06-02T15:31:25.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f613affd640 1 -- 172.21.15.78:0/67451887 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613c011d60 con 0x7f61481485c0 2023-06-02T15:31:25.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.094+0000 7f6150300640 1 -- 172.21.15.78:0/67451887 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6148148e50 con 0x7f61481485c0 2023-06-02T15:31:25.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.098+0000 7f6150300640 1 -- 172.21.15.78:0/67451887 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61480bc1e0 con 0x7f61481485c0 2023-06-02T15:31:25.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.098+0000 7f6150300640 1 -- 172.21.15.78:0/67451887 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61480bddf0 con 0x7f61481485c0 2023-06-02T15:31:25.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.098+0000 7f613affd640 1 -- 172.21.15.78:0/67451887 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f613c0193b0 con 0x7f61481485c0 2023-06-02T15:31:25.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.098+0000 7f613affd640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f612c065c00 0x7f612c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.098+0000 7f613affd640 1 -- 172.21.15.78:0/67451887 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f613c083390 con 0x7f61481485c0 2023-06-02T15:31:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.098+0000 7f614e09c640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f612c065c00 0x7f612c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.098+0000 7f614e09c640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f612c065c00 0x7f612c0680b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f61440ae000 tx=0x7f61440a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.102+0000 7f613affd640 1 -- 172.21.15.78:0/67451887 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f613c050900 con 0x7f61481485c0 2023-06-02T15:31:25.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.246+0000 7f6150300640 1 -- 172.21.15.78:0/67451887 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f61480c0940 con 0x7f61481485c0 2023-06-02T15:31:25.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.246+0000 7f613affd640 1 -- 172.21.15.78:0/67451887 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f613c053f20 con 0x7f61481485c0 2023-06-02T15:31:25.256 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-06-02T15:31:25.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 -- 172.21.15.78:0/67451887 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f612c065c00 msgr2=0x7f612c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f612c065c00 0x7f612c0680b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f61440ae000 tx=0x7f61440a7070 comp rx=0 tx=0).stop 2023-06-02T15:31:25.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 -- 172.21.15.78:0/67451887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61481485c0 msgr2=0x7f61480bea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61481485c0 0x7f61480bea60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f613c00b440 tx=0x7f613c00b900 comp rx=0 tx=0).stop 2023-06-02T15:31:25.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 -- 172.21.15.78:0/67451887 shutdown_connections 2023-06-02T15:31:25.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f612c065c00 0x7f612c0680b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61481485c0 0x7f61480bea60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f61480c0570 0x7f614814cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 --2- 172.21.15.78:0/67451887 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6148071780 0x7f6148070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 -- 172.21.15.78:0/67451887 >> 172.21.15.78:0/67451887 conn(0x7f61480a2170 msgr2=0x7f61480ba640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:25.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 -- 172.21.15.78:0/67451887 shutdown_connections 2023-06-02T15:31:25.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.250+0000 7f6150300640 1 -- 172.21.15.78:0/67451887 wait complete. 2023-06-02T15:31:25.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-06-02T15:31:25.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217f345640 1 Processor -- start 2023-06-02T15:31:25.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217f345640 1 -- start start 2023-06-02T15:31:25.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217f345640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f217806f0e0 0x7f21780a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217f345640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2178071be0 0x7f21780a7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217f345640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f217814bfe0 con 0x7f217814bc10 2023-06-02T15:31:25.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217f345640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2178071a10 con 0x7f2178071be0 2023-06-02T15:31:25.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217f345640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f217806e820 con 0x7f217806f0e0 2023-06-02T15:31:25.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217d0e1640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f217814bc10 0x7f21780c26e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56122/0 (socket says 172.21.15.78:56122) 2023-06-02T15:31:25.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217d0e1640 1 -- 172.21.15.78:0/1248103290 learned_addr learned my addr 172.21.15.78:0/1248103290 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:25.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217d8e2640 1 --2- 172.21.15.78:0/1248103290 >> v2:172.21.15.132:3300/0 conn(0x7f2178071be0 0x7f21780a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217c8e0640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f217806f0e0 0x7f21780a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260848508 0 0) 0x7f21680014a0 con 0x7f217814bc10 2023-06-02T15:31:25.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2160003530 con 0x7f217814bc10 2023-06-02T15:31:25.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1530920096 0 0) 0x7f2160003530 con 0x7f217814bc10 2023-06-02T15:31:25.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f217806f0e0 msgr2=0x7f21780a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:25.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f217806f0e0 0x7f21780a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 >> v2:172.21.15.132:3300/0 conn(0x7f2178071be0 msgr2=0x7f21780a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:25.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 --2- 172.21.15.78:0/1248103290 >> v2:172.21.15.132:3300/0 conn(0x7f2178071be0 0x7f21780a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f217806e640 con 0x7f217814bc10 2023-06-02T15:31:25.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f2168001b90 con 0x7f217814bc10 2023-06-02T15:31:25.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 >> v1:172.21.15.78:6789/0 conn(0x7f217814bc10 legacy=0x7f21780c26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21600039f0 0x7f2160003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f217806f0e0 0x7f21600047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2160004d10 0x7f2160005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f217806e820 con 0x7f2160004d10 2023-06-02T15:31:25.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f216000b990 con 0x7f21600039f0 2023-06-02T15:31:25.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f216000bad0 con 0x7f217806f0e0 2023-06-02T15:31:25.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217d8e2640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2160004d10 0x7f2160005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217c8e0640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f217806f0e0 0x7f21600047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217d0e1640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21600039f0 0x7f2160003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217d8e2640 1 -- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f217806f0e0 msgr2=0x7f21600047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217d8e2640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f217806f0e0 0x7f21600047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217d8e2640 1 -- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21600039f0 msgr2=0x7f2160003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217d8e2640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21600039f0 0x7f2160003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.386+0000 7f217d8e2640 1 -- 172.21.15.78:0/1248103290 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2160003530 con 0x7f2160004d10 2023-06-02T15:31:25.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f217d8e2640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2160004d10 0x7f2160005180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2178072000 tx=0x7f217001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6ef045f1069d49 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:25.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21700a55e0 con 0x7f2160004d10 2023-06-02T15:31:25.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21700a5740 con 0x7f2160004d10 2023-06-02T15:31:25.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f2177fff640 1 -- 172.21.15.78:0/1248103290 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21700a5ab0 con 0x7f2160004d10 2023-06-02T15:31:25.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f217f345640 1 -- 172.21.15.78:0/1248103290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2160004d10 msgr2=0x7f2160005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f217f345640 1 --2- 172.21.15.78:0/1248103290 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2160004d10 0x7f2160005180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2178072000 tx=0x7f217001c9b0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f217d8e2640 1 -- 172.21.15.78:0/1248103290 reap_dead start 2023-06-02T15:31:25.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f217f345640 1 -- 172.21.15.78:0/1248103290 shutdown_connections 2023-06-02T15:31:25.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f217f345640 1 -- 172.21.15.78:0/1248103290 >> 172.21.15.78:0/1248103290 conn(0x7f21780a5730 msgr2=0x7f21780a5b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:25.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f217f345640 1 -- 172.21.15.78:0/1248103290 shutdown_connections 2023-06-02T15:31:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.390+0000 7f217f345640 1 -- 172.21.15.78:0/1248103290 wait complete. 2023-06-02T15:31:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 Processor -- start 2023-06-02T15:31:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 -- start start 2023-06-02T15:31:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21781446f0 0x7f21781404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2178140a30 0x7f21780bd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2178140e90 0x7f21780bd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21780bea90 con 0x7f2178140a30 2023-06-02T15:31:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2178144e80 con 0x7f2178140e90 2023-06-02T15:31:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2178144030 con 0x7f21781446f0 2023-06-02T15:31:25.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217c8e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2178140a30 0x7f21780bd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217c8e0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2178140a30 0x7f21780bd180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33346/0 (socket says 172.21.15.78:33346) 2023-06-02T15:31:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217c8e0640 1 -- 172.21.15.78:0/1321696414 learned_addr learned my addr 172.21.15.78:0/1321696414 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217d8e2640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2178140e90 0x7f21780bd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217c8e0640 1 -- 172.21.15.78:0/1321696414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21781446f0 msgr2=0x7f21781404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217c8e0640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21781446f0 0x7f21781404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217c8e0640 1 -- 172.21.15.78:0/1321696414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2178140e90 msgr2=0x7f21780bd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217c8e0640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2178140e90 0x7f21780bd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217c8e0640 1 -- 172.21.15.78:0/1321696414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780714f0 con 0x7f2178140a30 2023-06-02T15:31:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217d8e2640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2178140e90 0x7f21780bd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:25.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217c8e0640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2178140a30 0x7f21780bd180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f216c0115d0 tx=0x7f216c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f2175ffb640 1 -- 172.21.15.78:0/1321696414 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00f8f0 con 0x7f2178140a30 2023-06-02T15:31:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f2175ffb640 1 -- 172.21.15.78:0/1321696414 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216c00fa50 con 0x7f2178140a30 2023-06-02T15:31:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 -- 172.21.15.78:0/1321696414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f217806e360 con 0x7f2178140a30 2023-06-02T15:31:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f2175ffb640 1 -- 172.21.15.78:0/1321696414 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216c00fe00 con 0x7f2178140a30 2023-06-02T15:31:25.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 -- 172.21.15.78:0/1321696414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f217806ee20 con 0x7f2178140a30 2023-06-02T15:31:25.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f217f345640 1 -- 172.21.15.78:0/1321696414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2178073bc0 con 0x7f2178140a30 2023-06-02T15:31:25.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f2175ffb640 1 -- 172.21.15.78:0/1321696414 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f216c015460 con 0x7f2178140a30 2023-06-02T15:31:25.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f2175ffb640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2164065c00 0x7f21640680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:25.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.394+0000 7f2175ffb640 1 -- 172.21.15.78:0/1321696414 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f216c083f20 con 0x7f2178140a30 2023-06-02T15:31:25.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.398+0000 7f217d0e1640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2164065c00 0x7f21640680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:25.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.398+0000 7f217d0e1640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2164065c00 0x7f21640680b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2168002240 tx=0x7f2168002170 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:25.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.398+0000 7f2175ffb640 1 -- 172.21.15.78:0/1321696414 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f216c051400 con 0x7f2178140a30 2023-06-02T15:31:25.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.566+0000 7f217f345640 1 -- 172.21.15.78:0/1321696414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2178071230 con 0x7f2178140a30 2023-06-02T15:31:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.566+0000 7f2175ffb640 1 -- 172.21.15.78:0/1321696414 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f216c054a20 con 0x7f2178140a30 2023-06-02T15:31:25.576 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-06-02T15:31:25.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 -- 172.21.15.78:0/1321696414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2164065c00 msgr2=0x7f21640680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2164065c00 0x7f21640680b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2168002240 tx=0x7f2168002170 comp rx=0 tx=0).stop 2023-06-02T15:31:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 -- 172.21.15.78:0/1321696414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2178140a30 msgr2=0x7f21780bd180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:25.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2178140a30 0x7f21780bd180 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f216c0115d0 tx=0x7f216c011a90 comp rx=0 tx=0).stop 2023-06-02T15:31:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 -- 172.21.15.78:0/1321696414 shutdown_connections 2023-06-02T15:31:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2178140e90 0x7f21780bd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f2164065c00 0x7f21640680b0 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2168002240 tx=0x7f2168002170 comp rx=0 tx=0).stop 2023-06-02T15:31:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2178140a30 0x7f21780bd180 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 --2- 172.21.15.78:0/1321696414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f21781446f0 0x7f21781404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:25.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 -- 172.21.15.78:0/1321696414 >> 172.21.15.78:0/1321696414 conn(0x7f21780a5730 msgr2=0x7f2178141c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:25.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 -- 172.21.15.78:0/1321696414 shutdown_connections 2023-06-02T15:31:25.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:25.570+0000 7f217f345640 1 -- 172.21.15.78:0/1321696414 wait complete. 2023-06-02T15:31:25.596 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi159.front.sepia.ceph.com... 2023-06-02T15:31:25.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:25.597 DEBUG:teuthology.orchestra.run.smithi159:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-06-02T15:31:25.614 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi159.stderr:ceph-fuse[32281]: fuse finished with error 0 and tester_r 0 2023-06-02T15:31:25.616 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:31:31.717 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2023-06-02T15:31:31.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:31.719 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-06-02T15:31:31.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:31.730 DEBUG:teuthology.orchestra.run.smithi150:> ip netns list 2023-06-02T15:31:31.737 INFO:teuthology.orchestra.run.smithi150.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-06-02T15:31:31.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:31.738 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-06-02T15:31:31.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:31.792 DEBUG:teuthology.orchestra.run.smithi150:> sudo ip link delete ceph-brx 2023-06-02T15:31:32.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:32.037 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2023-06-02T15:31:32.043 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-06-02T15:31:32.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:32.043 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-06-02T15:31:32.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-06-02T15:31:32.099 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2023-06-02T15:31:32.302 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-06-02T15:31:32.312 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-06-02T15:31:32.313 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:31:32.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69be314640 1 Processor -- start 2023-06-02T15:31:32.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69be314640 1 -- start start 2023-06-02T15:31:32.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69be314640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b80bc1c0 0x7f69b814bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69be314640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69b80a0020 0x7f69b81487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69be314640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b814ba90 con 0x7f69b814f330 2023-06-02T15:31:32.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69be314640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69b80a47b0 con 0x7f69b80a0020 2023-06-02T15:31:32.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69be314640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b814f7c0 con 0x7f69b80bc1c0 2023-06-02T15:31:32.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69bc8b1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69b80a0020 0x7f69b81487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:32.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69bc8b1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f69b80a0020 0x7f69b81487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33352/0 (socket says 172.21.15.78:33352) 2023-06-02T15:31:32.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69bc8b1640 1 -- 172.21.15.78:0/1728725490 learned_addr learned my addr 172.21.15.78:0/1728725490 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:32.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69bc8b1640 1 -- 172.21.15.78:0/1728725490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b80bc1c0 msgr2=0x7f69b814bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:32.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69bc8b1640 1 --2- 172.21.15.78:0/1728725490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b80bc1c0 0x7f69b814bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69bc8b1640 1 -- 172.21.15.78:0/1728725490 >> v1:172.21.15.132:6789/0 conn(0x7f69b814f330 legacy=0x7f69b80a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:32.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69bc8b1640 1 -- 172.21.15.78:0/1728725490 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b814b440 con 0x7f69b80a0020 2023-06-02T15:31:32.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.434+0000 7f69bc8b1640 1 --2- 172.21.15.78:0/1728725490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 0x7f69b81487d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009e50 tx=0x7f69b001c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452f6b9dc3c80197 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:32.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b77fe640 1 -- 172.21.15.78:0/1728725490 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00a5640 con 0x7f69b80a0020 2023-06-02T15:31:32.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b77fe640 1 -- 172.21.15.78:0/1728725490 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69b00a57a0 con 0x7f69b80a0020 2023-06-02T15:31:32.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b77fe640 1 -- 172.21.15.78:0/1728725490 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b00a5b30 con 0x7f69b80a0020 2023-06-02T15:31:32.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- 172.21.15.78:0/1728725490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 msgr2=0x7f69b81487d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:32.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 --2- 172.21.15.78:0/1728725490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 0x7f69b81487d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f69b0009e50 tx=0x7f69b001c8b0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- 172.21.15.78:0/1728725490 shutdown_connections 2023-06-02T15:31:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 --2- 172.21.15.78:0/1728725490 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 0x7f69b81487d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 --2- 172.21.15.78:0/1728725490 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b80bc1c0 0x7f69b814bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- 172.21.15.78:0/1728725490 >> 172.21.15.78:0/1728725490 conn(0x7f69b80bcf50 msgr2=0x7f69b80bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:32.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- 172.21.15.78:0/1728725490 shutdown_connections 2023-06-02T15:31:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- 172.21.15.78:0/1728725490 wait complete. 2023-06-02T15:31:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 Processor -- start 2023-06-02T15:31:32.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- start start 2023-06-02T15:31:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 0x7f69b80c04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69b80bc1c0 0x7f69b80c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b814f330 0x7f69b8140270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b806f5c0 con 0x7f69b80a0020 2023-06-02T15:31:32.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b80c10b0 con 0x7f69b80bc1c0 2023-06-02T15:31:32.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b8071bb0 con 0x7f69b814f330 2023-06-02T15:31:32.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 0x7f69b80c04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:32.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 0x7f69b80c04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33368/0 (socket says 172.21.15.78:33368) 2023-06-02T15:31:32.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b7fff640 1 -- 172.21.15.78:0/2892673472 learned_addr learned my addr 172.21.15.78:0/2892673472 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:32.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69bc8b1640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b814f330 0x7f69b8140270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:32.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69affff640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69b80bc1c0 0x7f69b80c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:32.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b7fff640 1 -- 172.21.15.78:0/2892673472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b814f330 msgr2=0x7f69b8140270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:32.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b7fff640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b814f330 0x7f69b8140270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b7fff640 1 -- 172.21.15.78:0/2892673472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69b80bc1c0 msgr2=0x7f69b80c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:32.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b7fff640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69b80bc1c0 0x7f69b80c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b7fff640 1 -- 172.21.15.78:0/2892673472 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b0009b30 con 0x7f69b80a0020 2023-06-02T15:31:32.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b7fff640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 0x7f69b80c04f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f69a800b550 tx=0x7f69a800ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:32.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b57fa640 1 -- 172.21.15.78:0/2892673472 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8010870 con 0x7f69b80a0020 2023-06-02T15:31:32.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b57fa640 1 -- 172.21.15.78:0/2892673472 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69a80109f0 con 0x7f69b80a0020 2023-06-02T15:31:32.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- 172.21.15.78:0/2892673472 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b80bcb90 con 0x7f69b80a0020 2023-06-02T15:31:32.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69b57fa640 1 -- 172.21.15.78:0/2892673472 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69a8010da0 con 0x7f69b80a0020 2023-06-02T15:31:32.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.438+0000 7f69be314640 1 -- 172.21.15.78:0/2892673472 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b80bca00 con 0x7f69b80a0020 2023-06-02T15:31:32.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.442+0000 7f69be314640 1 -- 172.21.15.78:0/2892673472 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b81584d0 con 0x7f69b80a0020 2023-06-02T15:31:32.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.442+0000 7f69b57fa640 1 -- 172.21.15.78:0/2892673472 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f69a800f3c0 con 0x7f69b80a0020 2023-06-02T15:31:32.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.442+0000 7f69b57fa640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6998065c30 0x7f69980680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.442+0000 7f69b57fa640 1 -- 172.21.15.78:0/2892673472 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f69a80836d0 con 0x7f69b80a0020 2023-06-02T15:31:32.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.442+0000 7f69affff640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6998065c30 0x7f69980680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:32.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.442+0000 7f69affff640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6998065c30 0x7f69980680e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f69b814e820 tx=0x7f69a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:32.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.446+0000 7f69b57fa640 1 -- 172.21.15.78:0/2892673472 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f69a8050ad0 con 0x7f69b80a0020 2023-06-02T15:31:32.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.594+0000 7f69be314640 1 -- 172.21.15.78:0/2892673472 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69b8073bc0 con 0x7f6998065c30 2023-06-02T15:31:32.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.622+0000 7f69b57fa640 1 -- 172.21.15.78:0/2892673472 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367688 (secure 0 0 0) 0x7f69b8073bc0 con 0x7f6998065c30 2023-06-02T15:31:32.636 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:32.638 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:31:32.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 -- 172.21.15.78:0/2892673472 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6998065c30 msgr2=0x7f69980680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:32.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6998065c30 0x7f69980680e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f69b814e820 tx=0x7f69a0009040 comp rx=0 tx=0).stop 2023-06-02T15:31:32.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 -- 172.21.15.78:0/2892673472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 msgr2=0x7f69b80c04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:32.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 0x7f69b80c04f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f69a800b550 tx=0x7f69a800ba10 comp rx=0 tx=0).stop 2023-06-02T15:31:32.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 -- 172.21.15.78:0/2892673472 shutdown_connections 2023-06-02T15:31:32.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f69b814f330 0x7f69b8140270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69b80bc1c0 0x7f69b80c0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6998065c30 0x7f69980680e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 --2- 172.21.15.78:0/2892673472 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f69b80a0020 0x7f69b80c04f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 -- 172.21.15.78:0/2892673472 >> 172.21.15.78:0/2892673472 conn(0x7f69b80bcf50 msgr2=0x7f69b8149820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 -- 172.21.15.78:0/2892673472 shutdown_connections 2023-06-02T15:31:32.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.626+0000 7f69be314640 1 -- 172.21.15.78:0/2892673472 wait complete. 2023-06-02T15:31:32.655 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2023-06-02T15:31:31.240626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596054,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":339,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69756,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":67264,"kb_avail":754904964,"statfs":{"total":773094113280,"available":773022683136,"internally_reserved":0,"allocated":2486272,"data_stored":2160989,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68878336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002967"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578786+0000","last_change":"2023-06-02T15:30:42.711237+0000","last_active":"2023-06-02T15:31:25.578786+0000","last_peered":"2023-06-02T15:31:25.578786+0000","last_clean":"2023-06-02T15:31:25.578786+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:31:25.578786+0000","last_undegraded":"2023-06-02T15:31:25.578786+0000","last_fullsized":"2023-06-02T15:31:25.578786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987457+0000","last_change":"2023-06-02T15:30:38.275721+0000","last_active":"2023-06-02T15:31:25.987457+0000","last_peered":"2023-06-02T15:31:25.987457+0000","last_clean":"2023-06-02T15:31:25.987457+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:31:25.987457+0000","last_undegraded":"2023-06-02T15:31:25.987457+0000","last_fullsized":"2023-06-02T15:31:25.987457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618872+0000","last_change":"2023-06-02T15:30:38.638911+0000","last_active":"2023-06-02T15:31:25.618872+0000","last_peered":"2023-06-02T15:31:25.618872+0000","last_clean":"2023-06-02T15:31:25.618872+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:31:25.618872+0000","last_undegraded":"2023-06-02T15:31:25.618872+0000","last_fullsized":"2023-06-02T15:31:25.618872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618711+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:31:25.618711+0000","last_peered":"2023-06-02T15:31:25.618711+0000","last_clean":"2023-06-02T15:31:25.618711+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:31:25.618711+0000","last_undegraded":"2023-06-02T15:31:25.618711+0000","last_fullsized":"2023-06-02T15:31:25.618711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:23:12.455644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571682+0000","last_change":"2023-06-02T15:30:38.282116+0000","last_active":"2023-06-02T15:31:25.571682+0000","last_peered":"2023-06-02T15:31:25.571682+0000","last_clean":"2023-06-02T15:31:25.571682+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:31:25.571682+0000","last_undegraded":"2023-06-02T15:31:25.571682+0000","last_fullsized":"2023-06-02T15:31:25.571682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571216+0000","last_change":"2023-06-02T15:30:38.638342+0000","last_active":"2023-06-02T15:31:25.571216+0000","last_peered":"2023-06-02T15:31:25.571216+0000","last_clean":"2023-06-02T15:31:25.571216+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:31:25.571216+0000","last_undegraded":"2023-06-02T15:31:25.571216+0000","last_fullsized":"2023-06-02T15:31:25.571216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578935+0000","last_change":"2023-06-02T15:30:42.715416+0000","last_active":"2023-06-02T15:31:25.578935+0000","last_peered":"2023-06-02T15:31:25.578935+0000","last_clean":"2023-06-02T15:31:25.578935+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:31:25.578935+0000","last_undegraded":"2023-06-02T15:31:25.578935+0000","last_fullsized":"2023-06-02T15:31:25.578935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581243+0000","last_change":"2023-06-02T15:30:38.278973+0000","last_active":"2023-06-02T15:31:25.581243+0000","last_peered":"2023-06-02T15:31:25.581243+0000","last_clean":"2023-06-02T15:31:25.581243+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:31:25.581243+0000","last_undegraded":"2023-06-02T15:31:25.581243+0000","last_fullsized":"2023-06-02T15:31:25.581243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619180+0000","last_change":"2023-06-02T15:30:38.644549+0000","last_active":"2023-06-02T15:31:25.619180+0000","last_peered":"2023-06-02T15:31:25.619180+0000","last_clean":"2023-06-02T15:31:25.619180+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:31:25.619180+0000","last_undegraded":"2023-06-02T15:31:25.619180+0000","last_fullsized":"2023-06-02T15:31:25.619180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:26.088195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627207+0000","last_change":"2023-06-02T15:30:42.707090+0000","last_active":"2023-06-02T15:31:25.627207+0000","last_peered":"2023-06-02T15:31:25.627207+0000","last_clean":"2023-06-02T15:31:25.627207+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:31:25.627207+0000","last_undegraded":"2023-06-02T15:31:25.627207+0000","last_fullsized":"2023-06-02T15:31:25.627207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580585+0000","last_change":"2023-06-02T15:30:38.269876+0000","last_active":"2023-06-02T15:31:25.580585+0000","last_peered":"2023-06-02T15:31:25.580585+0000","last_clean":"2023-06-02T15:31:25.580585+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:31:25.580585+0000","last_undegraded":"2023-06-02T15:31:25.580585+0000","last_fullsized":"2023-06-02T15:31:25.580585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619186+0000","last_change":"2023-06-02T15:30:38.639635+0000","last_active":"2023-06-02T15:31:25.619186+0000","last_peered":"2023-06-02T15:31:25.619186+0000","last_clean":"2023-06-02T15:31:25.619186+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:31:25.619186+0000","last_undegraded":"2023-06-02T15:31:25.619186+0000","last_fullsized":"2023-06-02T15:31:25.619186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:56:57.260064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580130+0000","last_change":"2023-06-02T15:30:42.699623+0000","last_active":"2023-06-02T15:31:25.580130+0000","last_peered":"2023-06-02T15:31:25.580130+0000","last_clean":"2023-06-02T15:31:25.580130+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:31:25.580130+0000","last_undegraded":"2023-06-02T15:31:25.580130+0000","last_fullsized":"2023-06-02T15:31:25.580130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:18.327051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987383+0000","last_change":"2023-06-02T15:30:38.263534+0000","last_active":"2023-06-02T15:31:25.987383+0000","last_peered":"2023-06-02T15:31:25.987383+0000","last_clean":"2023-06-02T15:31:25.987383+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:31:25.987383+0000","last_undegraded":"2023-06-02T15:31:25.987383+0000","last_fullsized":"2023-06-02T15:31:25.987383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577341+0000","last_change":"2023-06-02T15:30:38.644102+0000","last_active":"2023-06-02T15:31:25.577341+0000","last_peered":"2023-06-02T15:31:25.577341+0000","last_clean":"2023-06-02T15:31:25.577341+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:31:25.577341+0000","last_undegraded":"2023-06-02T15:31:25.577341+0000","last_fullsized":"2023-06-02T15:31:25.577341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:11.864794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619418+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:31:25.619418+0000","last_peered":"2023-06-02T15:31:25.619418+0000","last_clean":"2023-06-02T15:31:25.619418+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:31:25.619418+0000","last_undegraded":"2023-06-02T15:31:25.619418+0000","last_fullsized":"2023-06-02T15:31:25.619418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:16:13.363523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619377+0000","last_change":"2023-06-02T15:30:38.272143+0000","last_active":"2023-06-02T15:31:25.619377+0000","last_peered":"2023-06-02T15:31:25.619377+0000","last_clean":"2023-06-02T15:31:25.619377+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:31:25.619377+0000","last_undegraded":"2023-06-02T15:31:25.619377+0000","last_fullsized":"2023-06-02T15:31:25.619377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.572235+0000","last_change":"2023-06-02T15:30:38.650795+0000","last_active":"2023-06-02T15:31:25.572235+0000","last_peered":"2023-06-02T15:31:25.572235+0000","last_clean":"2023-06-02T15:31:25.572235+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:31:25.572235+0000","last_undegraded":"2023-06-02T15:31:25.572235+0000","last_fullsized":"2023-06-02T15:31:25.572235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579795+0000","last_change":"2023-06-02T15:30:42.706975+0000","last_active":"2023-06-02T15:31:25.579795+0000","last_peered":"2023-06-02T15:31:25.579795+0000","last_clean":"2023-06-02T15:31:25.579795+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:31:25.579795+0000","last_undegraded":"2023-06-02T15:31:25.579795+0000","last_fullsized":"2023-06-02T15:31:25.579795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:32.007544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579181+0000","last_change":"2023-06-02T15:30:38.290129+0000","last_active":"2023-06-02T15:31:25.579181+0000","last_peered":"2023-06-02T15:31:25.579181+0000","last_clean":"2023-06-02T15:31:25.579181+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:31:25.579181+0000","last_undegraded":"2023-06-02T15:31:25.579181+0000","last_fullsized":"2023-06-02T15:31:25.579181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987383+0000","last_change":"2023-06-02T15:30:38.656679+0000","last_active":"2023-06-02T15:31:25.987383+0000","last_peered":"2023-06-02T15:31:25.987383+0000","last_clean":"2023-06-02T15:31:25.987383+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:31:25.987383+0000","last_undegraded":"2023-06-02T15:31:25.987383+0000","last_fullsized":"2023-06-02T15:31:25.987383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987725+0000","last_change":"2023-06-02T15:30:42.705633+0000","last_active":"2023-06-02T15:31:25.987725+0000","last_peered":"2023-06-02T15:31:25.987725+0000","last_clean":"2023-06-02T15:31:25.987725+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:31:25.987725+0000","last_undegraded":"2023-06-02T15:31:25.987725+0000","last_fullsized":"2023-06-02T15:31:25.987725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571269+0000","last_change":"2023-06-02T15:30:38.273154+0000","last_active":"2023-06-02T15:31:25.571269+0000","last_peered":"2023-06-02T15:31:25.571269+0000","last_clean":"2023-06-02T15:31:25.571269+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:31:25.571269+0000","last_undegraded":"2023-06-02T15:31:25.571269+0000","last_fullsized":"2023-06-02T15:31:25.571269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579891+0000","last_change":"2023-06-02T15:30:38.647445+0000","last_active":"2023-06-02T15:31:25.579891+0000","last_peered":"2023-06-02T15:31:25.579891+0000","last_clean":"2023-06-02T15:31:25.579891+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:31:25.579891+0000","last_undegraded":"2023-06-02T15:31:25.579891+0000","last_fullsized":"2023-06-02T15:31:25.579891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:34.366098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571012+0000","last_change":"2023-06-02T15:30:38.650927+0000","last_active":"2023-06-02T15:31:25.571012+0000","last_peered":"2023-06-02T15:31:25.571012+0000","last_clean":"2023-06-02T15:31:25.571012+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:31:25.571012+0000","last_undegraded":"2023-06-02T15:31:25.571012+0000","last_fullsized":"2023-06-02T15:31:25.571012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987597+0000","last_change":"2023-06-02T15:30:38.274472+0000","last_active":"2023-06-02T15:31:25.987597+0000","last_peered":"2023-06-02T15:31:25.987597+0000","last_clean":"2023-06-02T15:31:25.987597+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:31:25.987597+0000","last_undegraded":"2023-06-02T15:31:25.987597+0000","last_fullsized":"2023-06-02T15:31:25.987597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578080+0000","last_change":"2023-06-02T15:30:42.710065+0000","last_active":"2023-06-02T15:31:25.578080+0000","last_peered":"2023-06-02T15:31:25.578080+0000","last_clean":"2023-06-02T15:31:25.578080+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:31:25.578080+0000","last_undegraded":"2023-06-02T15:31:25.578080+0000","last_fullsized":"2023-06-02T15:31:25.578080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571297+0000","last_change":"2023-06-02T15:30:38.656769+0000","last_active":"2023-06-02T15:31:25.571297+0000","last_peered":"2023-06-02T15:31:25.571297+0000","last_clean":"2023-06-02T15:31:25.571297+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:31:25.571297+0000","last_undegraded":"2023-06-02T15:31:25.571297+0000","last_fullsized":"2023-06-02T15:31:25.571297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581474+0000","last_change":"2023-06-02T15:30:38.275134+0000","last_active":"2023-06-02T15:31:25.581474+0000","last_peered":"2023-06-02T15:31:25.581474+0000","last_clean":"2023-06-02T15:31:25.581474+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:31:25.581474+0000","last_undegraded":"2023-06-02T15:31:25.581474+0000","last_fullsized":"2023-06-02T15:31:25.581474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626635+0000","last_change":"2023-06-02T15:30:42.706722+0000","last_active":"2023-06-02T15:31:25.626635+0000","last_peered":"2023-06-02T15:31:25.626635+0000","last_clean":"2023-06-02T15:31:25.626635+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:31:25.626635+0000","last_undegraded":"2023-06-02T15:31:25.626635+0000","last_fullsized":"2023-06-02T15:31:25.626635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628183+0000","last_change":"2023-06-02T15:30:38.289736+0000","last_active":"2023-06-02T15:31:25.628183+0000","last_peered":"2023-06-02T15:31:25.628183+0000","last_clean":"2023-06-02T15:31:25.628183+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:31:25.628183+0000","last_undegraded":"2023-06-02T15:31:25.628183+0000","last_fullsized":"2023-06-02T15:31:25.628183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:43:04.205096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579296+0000","last_change":"2023-06-02T15:30:38.642841+0000","last_active":"2023-06-02T15:31:25.579296+0000","last_peered":"2023-06-02T15:31:25.579296+0000","last_clean":"2023-06-02T15:31:25.579296+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:31:25.579296+0000","last_undegraded":"2023-06-02T15:31:25.579296+0000","last_fullsized":"2023-06-02T15:31:25.579296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571470+0000","last_change":"2023-06-02T15:30:42.720577+0000","last_active":"2023-06-02T15:31:25.571470+0000","last_peered":"2023-06-02T15:31:25.571470+0000","last_clean":"2023-06-02T15:31:25.571470+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:31:25.571470+0000","last_undegraded":"2023-06-02T15:31:25.571470+0000","last_fullsized":"2023-06-02T15:31:25.571470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:48:54.291389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"26'15","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626342+0000","last_change":"2023-06-02T15:30:38.276703+0000","last_active":"2023-06-02T15:31:25.626342+0000","last_peered":"2023-06-02T15:31:25.626342+0000","last_clean":"2023-06-02T15:31:25.626342+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:31:25.626342+0000","last_undegraded":"2023-06-02T15:31:25.626342+0000","last_fullsized":"2023-06-02T15:31:25.626342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4904,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619291+0000","last_change":"2023-06-02T15:30:38.634436+0000","last_active":"2023-06-02T15:31:25.619291+0000","last_peered":"2023-06-02T15:31:25.619291+0000","last_clean":"2023-06-02T15:31:25.619291+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:31:25.619291+0000","last_undegraded":"2023-06-02T15:31:25.619291+0000","last_fullsized":"2023-06-02T15:31:25.619291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579046+0000","last_change":"2023-06-02T15:30:42.707445+0000","last_active":"2023-06-02T15:31:25.579046+0000","last_peered":"2023-06-02T15:31:25.579046+0000","last_clean":"2023-06-02T15:31:25.579046+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:31:25.579046+0000","last_undegraded":"2023-06-02T15:31:25.579046+0000","last_fullsized":"2023-06-02T15:31:25.579046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579355+0000","last_change":"2023-06-02T15:30:38.649326+0000","last_active":"2023-06-02T15:31:25.579355+0000","last_peered":"2023-06-02T15:31:25.579355+0000","last_clean":"2023-06-02T15:31:25.579355+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:31:25.579355+0000","last_undegraded":"2023-06-02T15:31:25.579355+0000","last_fullsized":"2023-06-02T15:31:25.579355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579942+0000","last_change":"2023-06-02T15:30:33.407154+0000","last_active":"2023-06-02T15:31:25.579942+0000","last_peered":"2023-06-02T15:31:25.579942+0000","last_clean":"2023-06-02T15:31:25.579942+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:31:25.579942+0000","last_undegraded":"2023-06-02T15:31:25.579942+0000","last_fullsized":"2023-06-02T15:31:25.579942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581239+0000","last_change":"2023-06-02T15:30:38.279321+0000","last_active":"2023-06-02T15:31:25.581239+0000","last_peered":"2023-06-02T15:31:25.581239+0000","last_clean":"2023-06-02T15:31:25.581239+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:31:25.581239+0000","last_undegraded":"2023-06-02T15:31:25.581239+0000","last_fullsized":"2023-06-02T15:31:25.581239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986692+0000","last_change":"2023-06-02T15:30:42.715780+0000","last_active":"2023-06-02T15:31:25.986692+0000","last_peered":"2023-06-02T15:31:25.986692+0000","last_clean":"2023-06-02T15:31:25.986692+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:31:25.986692+0000","last_undegraded":"2023-06-02T15:31:25.986692+0000","last_fullsized":"2023-06-02T15:31:25.986692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986987+0000","last_change":"2023-06-02T15:30:38.632171+0000","last_active":"2023-06-02T15:31:25.986987+0000","last_peered":"2023-06-02T15:31:25.986987+0000","last_clean":"2023-06-02T15:31:25.986987+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:31:25.986987+0000","last_undegraded":"2023-06-02T15:31:25.986987+0000","last_fullsized":"2023-06-02T15:31:25.986987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579661+0000","last_change":"2023-06-02T15:30:33.655215+0000","last_active":"2023-06-02T15:31:25.579661+0000","last_peered":"2023-06-02T15:31:25.579661+0000","last_clean":"2023-06-02T15:31:25.579661+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:31:25.579661+0000","last_undegraded":"2023-06-02T15:31:25.579661+0000","last_fullsized":"2023-06-02T15:31:25.579661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580143+0000","last_change":"2023-06-02T15:30:38.277096+0000","last_active":"2023-06-02T15:31:25.580143+0000","last_peered":"2023-06-02T15:31:25.580143+0000","last_clean":"2023-06-02T15:31:25.580143+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:31:25.580143+0000","last_undegraded":"2023-06-02T15:31:25.580143+0000","last_fullsized":"2023-06-02T15:31:25.580143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578632+0000","last_change":"2023-06-02T15:30:42.698823+0000","last_active":"2023-06-02T15:31:25.578632+0000","last_peered":"2023-06-02T15:31:25.578632+0000","last_clean":"2023-06-02T15:31:25.578632+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:31:25.578632+0000","last_undegraded":"2023-06-02T15:31:25.578632+0000","last_fullsized":"2023-06-02T15:31:25.578632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571086+0000","last_change":"2023-06-02T15:30:38.656372+0000","last_active":"2023-06-02T15:31:25.571086+0000","last_peered":"2023-06-02T15:31:25.571086+0000","last_clean":"2023-06-02T15:31:25.571086+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:31:25.571086+0000","last_undegraded":"2023-06-02T15:31:25.571086+0000","last_fullsized":"2023-06-02T15:31:25.571086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620264+0000","last_change":"2023-06-02T15:30:33.959737+0000","last_active":"2023-06-02T15:31:25.620264+0000","last_peered":"2023-06-02T15:31:25.620264+0000","last_clean":"2023-06-02T15:31:25.620264+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:31:25.620264+0000","last_undegraded":"2023-06-02T15:31:25.620264+0000","last_fullsized":"2023-06-02T15:31:25.620264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.573996+0000","last_change":"2023-06-02T15:30:38.281667+0000","last_active":"2023-06-02T15:31:25.573996+0000","last_peered":"2023-06-02T15:31:25.573996+0000","last_clean":"2023-06-02T15:31:25.573996+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:31:25.573996+0000","last_undegraded":"2023-06-02T15:31:25.573996+0000","last_fullsized":"2023-06-02T15:31:25.573996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618579+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:31:25.618579+0000","last_peered":"2023-06-02T15:31:25.618579+0000","last_clean":"2023-06-02T15:31:25.618579+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:31:25.618579+0000","last_undegraded":"2023-06-02T15:31:25.618579+0000","last_fullsized":"2023-06-02T15:31:25.618579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:02:01.714482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619050+0000","last_change":"2023-06-02T15:30:38.646642+0000","last_active":"2023-06-02T15:31:25.619050+0000","last_peered":"2023-06-02T15:31:25.619050+0000","last_clean":"2023-06-02T15:31:25.619050+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:31:25.619050+0000","last_undegraded":"2023-06-02T15:31:25.619050+0000","last_fullsized":"2023-06-02T15:31:25.619050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571588+0000","last_change":"2023-06-02T15:30:33.413542+0000","last_active":"2023-06-02T15:31:25.571588+0000","last_peered":"2023-06-02T15:31:25.571588+0000","last_clean":"2023-06-02T15:31:25.571588+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:31:25.571588+0000","last_undegraded":"2023-06-02T15:31:25.571588+0000","last_fullsized":"2023-06-02T15:31:25.571588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987572+0000","last_change":"2023-06-02T15:30:38.270941+0000","last_active":"2023-06-02T15:31:25.987572+0000","last_peered":"2023-06-02T15:31:25.987572+0000","last_clean":"2023-06-02T15:31:25.987572+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:31:25.987572+0000","last_undegraded":"2023-06-02T15:31:25.987572+0000","last_fullsized":"2023-06-02T15:31:25.987572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.570918+0000","last_change":"2023-06-02T15:30:42.702383+0000","last_active":"2023-06-02T15:31:25.570918+0000","last_peered":"2023-06-02T15:31:25.570918+0000","last_clean":"2023-06-02T15:31:25.570918+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:31:25.570918+0000","last_undegraded":"2023-06-02T15:31:25.570918+0000","last_fullsized":"2023-06-02T15:31:25.570918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:49:31.222291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987397+0000","last_change":"2023-06-02T15:30:38.642398+0000","last_active":"2023-06-02T15:31:25.987397+0000","last_peered":"2023-06-02T15:31:25.987397+0000","last_clean":"2023-06-02T15:31:25.987397+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:31:25.987397+0000","last_undegraded":"2023-06-02T15:31:25.987397+0000","last_fullsized":"2023-06-02T15:31:25.987397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986410+0000","last_change":"2023-06-02T15:30:38.263733+0000","last_active":"2023-06-02T15:31:25.986410+0000","last_peered":"2023-06-02T15:31:25.986410+0000","last_clean":"2023-06-02T15:31:25.986410+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:31:25.986410+0000","last_undegraded":"2023-06-02T15:31:25.986410+0000","last_fullsized":"2023-06-02T15:31:25.986410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626859+0000","last_change":"2023-06-02T15:30:34.413807+0000","last_active":"2023-06-02T15:31:25.626859+0000","last_peered":"2023-06-02T15:31:25.626859+0000","last_clean":"2023-06-02T15:31:25.626859+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:31:25.626859+0000","last_undegraded":"2023-06-02T15:31:25.626859+0000","last_fullsized":"2023-06-02T15:31:25.626859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_clean_scrub_stamp":"2023-06-02T15:30:33.390390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:47:50.762629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579897+0000","last_change":"2023-06-02T15:30:33.411973+0000","last_active":"2023-06-02T15:31:25.579897+0000","last_peered":"2023-06-02T15:31:25.579897+0000","last_clean":"2023-06-02T15:31:25.579897+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:31:25.579897+0000","last_undegraded":"2023-06-02T15:31:25.579897+0000","last_fullsized":"2023-06-02T15:31:25.579897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581043+0000","last_change":"2023-06-02T15:30:42.712421+0000","last_active":"2023-06-02T15:31:25.581043+0000","last_peered":"2023-06-02T15:31:25.581043+0000","last_clean":"2023-06-02T15:31:25.581043+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:31:25.581043+0000","last_undegraded":"2023-06-02T15:31:25.581043+0000","last_fullsized":"2023-06-02T15:31:25.581043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:38:29.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580505+0000","last_change":"2023-06-02T15:30:38.653404+0000","last_active":"2023-06-02T15:31:25.580505+0000","last_peered":"2023-06-02T15:31:25.580505+0000","last_clean":"2023-06-02T15:31:25.580505+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:31:25.580505+0000","last_undegraded":"2023-06-02T15:31:25.580505+0000","last_fullsized":"2023-06-02T15:31:25.580505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578842+0000","last_change":"2023-06-02T15:30:38.269833+0000","last_active":"2023-06-02T15:31:25.578842+0000","last_peered":"2023-06-02T15:31:25.578842+0000","last_clean":"2023-06-02T15:31:25.578842+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:31:25.578842+0000","last_undegraded":"2023-06-02T15:31:25.578842+0000","last_fullsized":"2023-06-02T15:31:25.578842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:06:46.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627221+0000","last_change":"2023-06-02T15:30:33.654728+0000","last_active":"2023-06-02T15:31:25.627221+0000","last_peered":"2023-06-02T15:31:25.627221+0000","last_clean":"2023-06-02T15:31:25.627221+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:31:25.627221+0000","last_undegraded":"2023-06-02T15:31:25.627221+0000","last_fullsized":"2023-06-02T15:31:25.627221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:05:26.791938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577627+0000","last_change":"2023-06-02T15:30:42.705191+0000","last_active":"2023-06-02T15:31:25.577627+0000","last_peered":"2023-06-02T15:31:25.577627+0000","last_clean":"2023-06-02T15:31:25.577627+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:31:25.577627+0000","last_undegraded":"2023-06-02T15:31:25.577627+0000","last_fullsized":"2023-06-02T15:31:25.577627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:22.765485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580072+0000","last_change":"2023-06-02T15:30:38.642359+0000","last_active":"2023-06-02T15:31:25.580072+0000","last_peered":"2023-06-02T15:31:25.580072+0000","last_clean":"2023-06-02T15:31:25.580072+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:31:25.580072+0000","last_undegraded":"2023-06-02T15:31:25.580072+0000","last_fullsized":"2023-06-02T15:31:25.580072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619577+0000","last_change":"2023-06-02T15:30:38.257531+0000","last_active":"2023-06-02T15:31:25.619577+0000","last_peered":"2023-06-02T15:31:25.619577+0000","last_clean":"2023-06-02T15:31:25.619577+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:31:25.619577+0000","last_undegraded":"2023-06-02T15:31:25.619577+0000","last_fullsized":"2023-06-02T15:31:25.619577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577955+0000","last_change":"2023-06-02T15:30:33.655250+0000","last_active":"2023-06-02T15:31:25.577955+0000","last_peered":"2023-06-02T15:31:25.577955+0000","last_clean":"2023-06-02T15:31:25.577955+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:31:25.577955+0000","last_undegraded":"2023-06-02T15:31:25.577955+0000","last_fullsized":"2023-06-02T15:31:25.577955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986943+0000","last_change":"2023-06-02T15:30:42.693557+0000","last_active":"2023-06-02T15:31:25.986943+0000","last_peered":"2023-06-02T15:31:25.986943+0000","last_clean":"2023-06-02T15:31:25.986943+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:31:25.986943+0000","last_undegraded":"2023-06-02T15:31:25.986943+0000","last_fullsized":"2023-06-02T15:31:25.986943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579446+0000","last_change":"2023-06-02T15:30:38.645488+0000","last_active":"2023-06-02T15:31:25.579446+0000","last_peered":"2023-06-02T15:31:25.579446+0000","last_clean":"2023-06-02T15:31:25.579446+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:31:25.579446+0000","last_undegraded":"2023-06-02T15:31:25.579446+0000","last_fullsized":"2023-06-02T15:31:25.579446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571801+0000","last_change":"2023-06-02T15:30:38.283390+0000","last_active":"2023-06-02T15:31:25.571801+0000","last_peered":"2023-06-02T15:31:25.571801+0000","last_clean":"2023-06-02T15:31:25.571801+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:31:25.571801+0000","last_undegraded":"2023-06-02T15:31:25.571801+0000","last_fullsized":"2023-06-02T15:31:25.571801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626919+0000","last_change":"2023-06-02T15:30:33.653937+0000","last_active":"2023-06-02T15:31:25.626919+0000","last_peered":"2023-06-02T15:31:25.626919+0000","last_clean":"2023-06-02T15:31:25.626919+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:31:25.626919+0000","last_undegraded":"2023-06-02T15:31:25.626919+0000","last_fullsized":"2023-06-02T15:31:25.626919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627136+0000","last_change":"2023-06-02T15:30:42.723169+0000","last_active":"2023-06-02T15:31:25.627136+0000","last_peered":"2023-06-02T15:31:25.627136+0000","last_clean":"2023-06-02T15:31:25.627136+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:31:25.627136+0000","last_undegraded":"2023-06-02T15:31:25.627136+0000","last_fullsized":"2023-06-02T15:31:25.627136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.760660+0000","last_change":"2023-06-02T15:31:26.759068+0000","last_active":"2023-06-02T15:31:26.760660+0000","last_peered":"2023-06-02T15:31:26.760660+0000","last_clean":"2023-06-02T15:31:26.760660+0000","last_became_active":"2023-06-02T15:31:26.758308+0000","last_became_peered":"2023-06-02T15:31:26.758308+0000","last_unstale":"2023-06-02T15:31:26.760660+0000","last_undegraded":"2023-06-02T15:31:26.760660+0000","last_fullsized":"2023-06-02T15:31:26.760660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:21.714894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571177+0000","last_change":"2023-06-02T15:30:38.281851+0000","last_active":"2023-06-02T15:31:25.571177+0000","last_peered":"2023-06-02T15:31:25.571177+0000","last_clean":"2023-06-02T15:31:25.571177+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:31:25.571177+0000","last_undegraded":"2023-06-02T15:31:25.571177+0000","last_fullsized":"2023-06-02T15:31:25.571177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619892+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:31:25.619892+0000","last_peered":"2023-06-02T15:31:25.619892+0000","last_clean":"2023-06-02T15:31:25.619892+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:31:25.619892+0000","last_undegraded":"2023-06-02T15:31:25.619892+0000","last_fullsized":"2023-06-02T15:31:25.619892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:44.594461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620069+0000","last_change":"2023-06-02T15:30:38.638725+0000","last_active":"2023-06-02T15:31:25.620069+0000","last_peered":"2023-06-02T15:31:25.620069+0000","last_clean":"2023-06-02T15:31:25.620069+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:31:25.620069+0000","last_undegraded":"2023-06-02T15:31:25.620069+0000","last_fullsized":"2023-06-02T15:31:25.620069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619044+0000","last_change":"2023-06-02T15:30:38.269278+0000","last_active":"2023-06-02T15:31:25.619044+0000","last_peered":"2023-06-02T15:31:25.619044+0000","last_clean":"2023-06-02T15:31:25.619044+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:31:25.619044+0000","last_undegraded":"2023-06-02T15:31:25.619044+0000","last_fullsized":"2023-06-02T15:31:25.619044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581072+0000","last_change":"2023-06-02T15:30:42.713071+0000","last_active":"2023-06-02T15:31:25.581072+0000","last_peered":"2023-06-02T15:31:25.581072+0000","last_clean":"2023-06-02T15:31:25.581072+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:31:25.581072+0000","last_undegraded":"2023-06-02T15:31:25.581072+0000","last_fullsized":"2023-06-02T15:31:25.581072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620056+0000","last_change":"2023-06-02T15:30:38.636565+0000","last_active":"2023-06-02T15:31:25.620056+0000","last_peered":"2023-06-02T15:31:25.620056+0000","last_clean":"2023-06-02T15:31:25.620056+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:31:25.620056+0000","last_undegraded":"2023-06-02T15:31:25.620056+0000","last_fullsized":"2023-06-02T15:31:25.620056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:56:18.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578976+0000","last_change":"2023-06-02T15:30:38.277404+0000","last_active":"2023-06-02T15:31:25.578976+0000","last_peered":"2023-06-02T15:31:25.578976+0000","last_clean":"2023-06-02T15:31:25.578976+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:31:25.578976+0000","last_undegraded":"2023-06-02T15:31:25.578976+0000","last_fullsized":"2023-06-02T15:31:25.578976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579937+0000","last_change":"2023-06-02T15:30:42.697724+0000","last_active":"2023-06-02T15:31:25.579937+0000","last_peered":"2023-06-02T15:31:25.579937+0000","last_clean":"2023-06-02T15:31:25.579937+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:31:25.579937+0000","last_undegraded":"2023-06-02T15:31:25.579937+0000","last_fullsized":"2023-06-02T15:31:25.579937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619605+0000","last_change":"2023-06-02T15:30:38.640532+0000","last_active":"2023-06-02T15:31:25.619605+0000","last_peered":"2023-06-02T15:31:25.619605+0000","last_clean":"2023-06-02T15:31:25.619605+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:31:25.619605+0000","last_undegraded":"2023-06-02T15:31:25.619605+0000","last_fullsized":"2023-06-02T15:31:25.619605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.572026+0000","last_change":"2023-06-02T15:30:38.281909+0000","last_active":"2023-06-02T15:31:25.572026+0000","last_peered":"2023-06-02T15:31:25.572026+0000","last_clean":"2023-06-02T15:31:25.572026+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:31:25.572026+0000","last_undegraded":"2023-06-02T15:31:25.572026+0000","last_fullsized":"2023-06-02T15:31:25.572026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576942+0000","last_change":"2023-06-02T15:30:42.716337+0000","last_active":"2023-06-02T15:31:25.576942+0000","last_peered":"2023-06-02T15:31:25.576942+0000","last_clean":"2023-06-02T15:31:25.576942+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:31:25.576942+0000","last_undegraded":"2023-06-02T15:31:25.576942+0000","last_fullsized":"2023-06-02T15:31:25.576942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986836+0000","last_change":"2023-06-02T15:30:38.651270+0000","last_active":"2023-06-02T15:31:25.986836+0000","last_peered":"2023-06-02T15:31:25.986836+0000","last_clean":"2023-06-02T15:31:25.986836+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:31:25.986836+0000","last_undegraded":"2023-06-02T15:31:25.986836+0000","last_fullsized":"2023-06-02T15:31:25.986836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580356+0000","last_change":"2023-06-02T15:30:38.277304+0000","last_active":"2023-06-02T15:31:25.580356+0000","last_peered":"2023-06-02T15:31:25.580356+0000","last_clean":"2023-06-02T15:31:25.580356+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:31:25.580356+0000","last_undegraded":"2023-06-02T15:31:25.580356+0000","last_fullsized":"2023-06-02T15:31:25.580356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576791+0000","last_change":"2023-06-02T15:30:42.692861+0000","last_active":"2023-06-02T15:31:25.576791+0000","last_peered":"2023-06-02T15:31:25.576791+0000","last_clean":"2023-06-02T15:31:25.576791+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:31:25.576791+0000","last_undegraded":"2023-06-02T15:31:25.576791+0000","last_fullsized":"2023-06-02T15:31:25.576791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:29.857375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578802+0000","last_change":"2023-06-02T15:30:38.645534+0000","last_active":"2023-06-02T15:31:25.578802+0000","last_peered":"2023-06-02T15:31:25.578802+0000","last_clean":"2023-06-02T15:31:25.578802+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:31:25.578802+0000","last_undegraded":"2023-06-02T15:31:25.578802+0000","last_fullsized":"2023-06-02T15:31:25.578802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628270+0000","last_change":"2023-06-02T15:30:38.282239+0000","last_active":"2023-06-02T15:31:25.628270+0000","last_peered":"2023-06-02T15:31:25.628270+0000","last_clean":"2023-06-02T15:31:25.628270+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:31:25.628270+0000","last_undegraded":"2023-06-02T15:31:25.628270+0000","last_fullsized":"2023-06-02T15:31:25.628270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:40.807809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576809+0000","last_change":"2023-06-02T15:30:42.720849+0000","last_active":"2023-06-02T15:31:25.576809+0000","last_peered":"2023-06-02T15:31:25.576809+0000","last_clean":"2023-06-02T15:31:25.576809+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:31:25.576809+0000","last_undegraded":"2023-06-02T15:31:25.576809+0000","last_fullsized":"2023-06-02T15:31:25.576809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618839+0000","last_change":"2023-06-02T15:30:38.641746+0000","last_active":"2023-06-02T15:31:25.618839+0000","last_peered":"2023-06-02T15:31:25.618839+0000","last_clean":"2023-06-02T15:31:25.618839+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:31:25.618839+0000","last_undegraded":"2023-06-02T15:31:25.618839+0000","last_fullsized":"2023-06-02T15:31:25.618839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628173+0000","last_change":"2023-06-02T15:30:38.282724+0000","last_active":"2023-06-02T15:31:25.628173+0000","last_peered":"2023-06-02T15:31:25.628173+0000","last_clean":"2023-06-02T15:31:25.628173+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:31:25.628173+0000","last_undegraded":"2023-06-02T15:31:25.628173+0000","last_fullsized":"2023-06-02T15:31:25.628173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:21.387209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576497+0000","last_change":"2023-06-02T15:30:42.697662+0000","last_active":"2023-06-02T15:31:25.576497+0000","last_peered":"2023-06-02T15:31:25.576497+0000","last_clean":"2023-06-02T15:31:25.576497+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:31:25.576497+0000","last_undegraded":"2023-06-02T15:31:25.576497+0000","last_fullsized":"2023-06-02T15:31:25.576497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:19.014996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577702+0000","last_change":"2023-06-02T15:30:38.656950+0000","last_active":"2023-06-02T15:31:25.577702+0000","last_peered":"2023-06-02T15:31:25.577702+0000","last_clean":"2023-06-02T15:31:25.577702+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:31:25.577702+0000","last_undegraded":"2023-06-02T15:31:25.577702+0000","last_fullsized":"2023-06-02T15:31:25.577702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628287+0000","last_change":"2023-06-02T15:30:38.283602+0000","last_active":"2023-06-02T15:31:25.628287+0000","last_peered":"2023-06-02T15:31:25.628287+0000","last_clean":"2023-06-02T15:31:25.628287+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:31:25.628287+0000","last_undegraded":"2023-06-02T15:31:25.628287+0000","last_fullsized":"2023-06-02T15:31:25.628287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:33.362323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627029+0000","last_change":"2023-06-02T15:30:42.722884+0000","last_active":"2023-06-02T15:31:25.627029+0000","last_peered":"2023-06-02T15:31:25.627029+0000","last_clean":"2023-06-02T15:31:25.627029+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:31:25.627029+0000","last_undegraded":"2023-06-02T15:31:25.627029+0000","last_fullsized":"2023-06-02T15:31:25.627029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580952+0000","last_change":"2023-06-02T15:30:42.714188+0000","last_active":"2023-06-02T15:31:25.580952+0000","last_peered":"2023-06-02T15:31:25.580952+0000","last_clean":"2023-06-02T15:31:25.580952+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:31:25.580952+0000","last_undegraded":"2023-06-02T15:31:25.580952+0000","last_fullsized":"2023-06-02T15:31:25.580952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578228+0000","last_change":"2023-06-02T15:30:38.261610+0000","last_active":"2023-06-02T15:31:25.578228+0000","last_peered":"2023-06-02T15:31:25.578228+0000","last_clean":"2023-06-02T15:31:25.578228+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:31:25.578228+0000","last_undegraded":"2023-06-02T15:31:25.578228+0000","last_fullsized":"2023-06-02T15:31:25.578228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.574205+0000","last_change":"2023-06-02T15:30:38.658984+0000","last_active":"2023-06-02T15:31:25.574205+0000","last_peered":"2023-06-02T15:31:25.574205+0000","last_clean":"2023-06-02T15:31:25.574205+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:31:25.574205+0000","last_undegraded":"2023-06-02T15:31:25.574205+0000","last_fullsized":"2023-06-02T15:31:25.574205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571841+0000","last_change":"2023-06-02T15:30:42.705561+0000","last_active":"2023-06-02T15:31:25.571841+0000","last_peered":"2023-06-02T15:31:25.571841+0000","last_clean":"2023-06-02T15:31:25.571841+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:31:25.571841+0000","last_undegraded":"2023-06-02T15:31:25.571841+0000","last_fullsized":"2023-06-02T15:31:25.571841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:39:14.247511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627280+0000","last_change":"2023-06-02T15:30:38.283796+0000","last_active":"2023-06-02T15:31:25.627280+0000","last_peered":"2023-06-02T15:31:25.627280+0000","last_clean":"2023-06-02T15:31:25.627280+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:31:25.627280+0000","last_undegraded":"2023-06-02T15:31:25.627280+0000","last_fullsized":"2023-06-02T15:31:25.627280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987622+0000","last_change":"2023-06-02T15:30:38.644966+0000","last_active":"2023-06-02T15:31:25.987622+0000","last_peered":"2023-06-02T15:31:25.987622+0000","last_clean":"2023-06-02T15:31:25.987622+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:31:25.987622+0000","last_undegraded":"2023-06-02T15:31:25.987622+0000","last_fullsized":"2023-06-02T15:31:25.987622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986672+0000","last_change":"2023-06-02T15:30:38.265398+0000","last_active":"2023-06-02T15:31:25.986672+0000","last_peered":"2023-06-02T15:31:25.986672+0000","last_clean":"2023-06-02T15:31:25.986672+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:31:25.986672+0000","last_undegraded":"2023-06-02T15:31:25.986672+0000","last_fullsized":"2023-06-02T15:31:25.986672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:10:29.479149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580971+0000","last_change":"2023-06-02T15:30:38.657999+0000","last_active":"2023-06-02T15:31:25.580971+0000","last_peered":"2023-06-02T15:31:25.580971+0000","last_clean":"2023-06-02T15:31:25.580971+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:31:25.580971+0000","last_undegraded":"2023-06-02T15:31:25.580971+0000","last_fullsized":"2023-06-02T15:31:25.580971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571454+0000","last_change":"2023-06-02T15:30:42.705725+0000","last_active":"2023-06-02T15:31:25.571454+0000","last_peered":"2023-06-02T15:31:25.571454+0000","last_clean":"2023-06-02T15:31:25.571454+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:31:25.571454+0000","last_undegraded":"2023-06-02T15:31:25.571454+0000","last_fullsized":"2023-06-02T15:31:25.571454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627568+0000","last_change":"2023-06-02T15:30:38.282095+0000","last_active":"2023-06-02T15:31:25.627568+0000","last_peered":"2023-06-02T15:31:25.627568+0000","last_clean":"2023-06-02T15:31:25.627568+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:31:25.627568+0000","last_undegraded":"2023-06-02T15:31:25.627568+0000","last_fullsized":"2023-06-02T15:31:25.627568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.926559+0000","last_change":"2023-06-02T15:31:26.924308+0000","last_active":"2023-06-02T15:31:26.926559+0000","last_peered":"2023-06-02T15:31:26.926559+0000","last_clean":"2023-06-02T15:31:26.926559+0000","last_became_active":"2023-06-02T15:31:26.923733+0000","last_became_peered":"2023-06-02T15:31:26.923733+0000","last_unstale":"2023-06-02T15:31:26.926559+0000","last_undegraded":"2023-06-02T15:31:26.926559+0000","last_fullsized":"2023-06-02T15:31:26.926559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:00:54.244135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580545+0000","last_change":"2023-06-02T15:30:42.702456+0000","last_active":"2023-06-02T15:31:25.580545+0000","last_peered":"2023-06-02T15:31:25.580545+0000","last_clean":"2023-06-02T15:31:25.580545+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:31:25.580545+0000","last_undegraded":"2023-06-02T15:31:25.580545+0000","last_fullsized":"2023-06-02T15:31:25.580545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577812+0000","last_change":"2023-06-02T15:30:38.637380+0000","last_active":"2023-06-02T15:31:25.577812+0000","last_peered":"2023-06-02T15:31:25.577812+0000","last_clean":"2023-06-02T15:31:25.577812+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:31:25.577812+0000","last_undegraded":"2023-06-02T15:31:25.577812+0000","last_fullsized":"2023-06-02T15:31:25.577812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571178+0000","last_change":"2023-06-02T15:30:38.655074+0000","last_active":"2023-06-02T15:31:25.571178+0000","last_peered":"2023-06-02T15:31:25.571178+0000","last_clean":"2023-06-02T15:31:25.571178+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:31:25.571178+0000","last_undegraded":"2023-06-02T15:31:25.571178+0000","last_fullsized":"2023-06-02T15:31:25.571178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619438+0000","last_change":"2023-06-02T15:30:38.637979+0000","last_active":"2023-06-02T15:31:25.619438+0000","last_peered":"2023-06-02T15:31:25.619438+0000","last_clean":"2023-06-02T15:31:25.619438+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:31:25.619438+0000","last_undegraded":"2023-06-02T15:31:25.619438+0000","last_fullsized":"2023-06-02T15:31:25.619438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571856+0000","last_change":"2023-06-02T15:30:38.659430+0000","last_active":"2023-06-02T15:31:25.571856+0000","last_peered":"2023-06-02T15:31:25.571856+0000","last_clean":"2023-06-02T15:31:25.571856+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:31:25.571856+0000","last_undegraded":"2023-06-02T15:31:25.571856+0000","last_fullsized":"2023-06-02T15:31:25.571856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580215+0000","last_change":"2023-06-02T15:30:38.656408+0000","last_active":"2023-06-02T15:31:25.580215+0000","last_peered":"2023-06-02T15:31:25.580215+0000","last_clean":"2023-06-02T15:31:25.580215+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:31:25.580215+0000","last_undegraded":"2023-06-02T15:31:25.580215+0000","last_fullsized":"2023-06-02T15:31:25.580215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580963+0000","last_change":"2023-06-02T15:30:38.658103+0000","last_active":"2023-06-02T15:31:25.580963+0000","last_peered":"2023-06-02T15:31:25.580963+0000","last_clean":"2023-06-02T15:31:25.580963+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:31:25.580963+0000","last_undegraded":"2023-06-02T15:31:25.580963+0000","last_fullsized":"2023-06-02T15:31:25.580963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580377+0000","last_change":"2023-06-02T15:30:38.641657+0000","last_active":"2023-06-02T15:31:25.580377+0000","last_peered":"2023-06-02T15:31:25.580377+0000","last_clean":"2023-06-02T15:31:25.580377+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:31:25.580377+0000","last_undegraded":"2023-06-02T15:31:25.580377+0000","last_fullsized":"2023-06-02T15:31:25.580377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:22.309633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580426+0000","last_change":"2023-06-02T15:30:38.640289+0000","last_active":"2023-06-02T15:31:25.580426+0000","last_peered":"2023-06-02T15:31:25.580426+0000","last_clean":"2023-06-02T15:31:25.580426+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:31:25.580426+0000","last_undegraded":"2023-06-02T15:31:25.580426+0000","last_fullsized":"2023-06-02T15:31:25.580426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626779+0000","last_change":"2023-06-02T15:30:38.656963+0000","last_active":"2023-06-02T15:31:25.626779+0000","last_peered":"2023-06-02T15:31:25.626779+0000","last_clean":"2023-06-02T15:31:25.626779+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:31:25.626779+0000","last_undegraded":"2023-06-02T15:31:25.626779+0000","last_fullsized":"2023-06-02T15:31:25.626779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571080+0000","last_change":"2023-06-02T15:30:38.648546+0000","last_active":"2023-06-02T15:31:25.571080+0000","last_peered":"2023-06-02T15:31:25.571080+0000","last_clean":"2023-06-02T15:31:25.571080+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:31:25.571080+0000","last_undegraded":"2023-06-02T15:31:25.571080+0000","last_fullsized":"2023-06-02T15:31:25.571080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986521+0000","last_change":"2023-06-02T15:30:38.643407+0000","last_active":"2023-06-02T15:31:25.986521+0000","last_peered":"2023-06-02T15:31:25.986521+0000","last_clean":"2023-06-02T15:31:25.986521+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:31:25.986521+0000","last_undegraded":"2023-06-02T15:31:25.986521+0000","last_fullsized":"2023-06-02T15:31:25.986521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627438+0000","last_change":"2023-06-02T15:30:38.657038+0000","last_active":"2023-06-02T15:31:25.627438+0000","last_peered":"2023-06-02T15:31:25.627438+0000","last_clean":"2023-06-02T15:31:25.627438+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:31:25.627438+0000","last_undegraded":"2023-06-02T15:31:25.627438+0000","last_fullsized":"2023-06-02T15:31:25.627438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619678+0000","last_change":"2023-06-02T15:30:38.638594+0000","last_active":"2023-06-02T15:31:25.619678+0000","last_peered":"2023-06-02T15:31:25.619678+0000","last_clean":"2023-06-02T15:31:25.619678+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:31:25.619678+0000","last_undegraded":"2023-06-02T15:31:25.619678+0000","last_fullsized":"2023-06-02T15:31:25.619678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:28.604626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576977+0000","last_change":"2023-06-02T15:30:38.638252+0000","last_active":"2023-06-02T15:31:25.576977+0000","last_peered":"2023-06-02T15:31:25.576977+0000","last_clean":"2023-06-02T15:31:25.576977+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:31:25.576977+0000","last_undegraded":"2023-06-02T15:31:25.576977+0000","last_fullsized":"2023-06-02T15:31:25.576977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:24.550049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619807+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:31:25.619807+0000","last_peered":"2023-06-02T15:31:25.619807+0000","last_clean":"2023-06-02T15:31:25.619807+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:31:25.619807+0000","last_undegraded":"2023-06-02T15:31:25.619807+0000","last_fullsized":"2023-06-02T15:31:25.619807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:14.924133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987375+0000","last_change":"2023-06-02T15:30:38.639262+0000","last_active":"2023-06-02T15:31:25.987375+0000","last_peered":"2023-06-02T15:31:25.987375+0000","last_clean":"2023-06-02T15:31:25.987375+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:31:25.987375+0000","last_undegraded":"2023-06-02T15:31:25.987375+0000","last_fullsized":"2023-06-02T15:31:25.987375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618716+0000","last_change":"2023-06-02T15:30:38.636435+0000","last_active":"2023-06-02T15:31:25.618716+0000","last_peered":"2023-06-02T15:31:25.618716+0000","last_clean":"2023-06-02T15:31:25.618716+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:31:25.618716+0000","last_undegraded":"2023-06-02T15:31:25.618716+0000","last_fullsized":"2023-06-02T15:31:25.618716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:41:54.216725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627147+0000","last_change":"2023-06-02T15:30:38.659341+0000","last_active":"2023-06-02T15:31:25.627147+0000","last_peered":"2023-06-02T15:31:25.627147+0000","last_clean":"2023-06-02T15:31:25.627147+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:31:25.627147+0000","last_undegraded":"2023-06-02T15:31:25.627147+0000","last_fullsized":"2023-06-02T15:31:25.627147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578465+0000","last_change":"2023-06-02T15:30:38.636138+0000","last_active":"2023-06-02T15:31:25.578465+0000","last_peered":"2023-06-02T15:31:25.578465+0000","last_clean":"2023-06-02T15:31:25.578465+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:31:25.578465+0000","last_undegraded":"2023-06-02T15:31:25.578465+0000","last_fullsized":"2023-06-02T15:31:25.578465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576902+0000","last_change":"2023-06-02T15:30:38.645755+0000","last_active":"2023-06-02T15:31:25.576902+0000","last_peered":"2023-06-02T15:31:25.576902+0000","last_clean":"2023-06-02T15:31:25.576902+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:31:25.576902+0000","last_undegraded":"2023-06-02T15:31:25.576902+0000","last_fullsized":"2023-06-02T15:31:25.576902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:40.298901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577266+0000","last_change":"2023-06-02T15:30:38.644641+0000","last_active":"2023-06-02T15:31:25.577266+0000","last_peered":"2023-06-02T15:31:25.577266+0000","last_clean":"2023-06-02T15:31:25.577266+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:31:25.577266+0000","last_undegraded":"2023-06-02T15:31:25.577266+0000","last_fullsized":"2023-06-02T15:31:25.577266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:14.588404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620098+0000","last_change":"2023-06-02T15:30:38.650928+0000","last_active":"2023-06-02T15:31:25.620098+0000","last_peered":"2023-06-02T15:31:25.620098+0000","last_clean":"2023-06-02T15:31:25.620098+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:31:25.620098+0000","last_undegraded":"2023-06-02T15:31:25.620098+0000","last_fullsized":"2023-06-02T15:31:25.620098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581483+0000","last_change":"2023-06-02T15:30:38.640368+0000","last_active":"2023-06-02T15:31:25.581483+0000","last_peered":"2023-06-02T15:31:25.581483+0000","last_clean":"2023-06-02T15:31:25.581483+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:31:25.581483+0000","last_undegraded":"2023-06-02T15:31:25.581483+0000","last_fullsized":"2023-06-02T15:31:25.581483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987146+0000","last_change":"2023-06-02T15:30:38.639440+0000","last_active":"2023-06-02T15:31:25.987146+0000","last_peered":"2023-06-02T15:31:25.987146+0000","last_clean":"2023-06-02T15:31:25.987146+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:31:25.987146+0000","last_undegraded":"2023-06-02T15:31:25.987146+0000","last_fullsized":"2023-06-02T15:31:25.987146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577488+0000","last_change":"2023-06-02T15:30:38.647961+0000","last_active":"2023-06-02T15:31:25.577488+0000","last_peered":"2023-06-02T15:31:25.577488+0000","last_clean":"2023-06-02T15:31:25.577488+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:31:25.577488+0000","last_undegraded":"2023-06-02T15:31:25.577488+0000","last_fullsized":"2023-06-02T15:31:25.577488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627017+0000","last_change":"2023-06-02T15:30:38.659299+0000","last_active":"2023-06-02T15:31:25.627017+0000","last_peered":"2023-06-02T15:31:25.627017+0000","last_clean":"2023-06-02T15:31:25.627017+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:31:25.627017+0000","last_undegraded":"2023-06-02T15:31:25.627017+0000","last_fullsized":"2023-06-02T15:31:25.627017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619150+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:31:25.619150+0000","last_peered":"2023-06-02T15:31:25.619150+0000","last_clean":"2023-06-02T15:31:25.619150+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:31:25.619150+0000","last_undegraded":"2023-06-02T15:31:25.619150+0000","last_fullsized":"2023-06-02T15:31:25.619150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:15:27.850958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987178+0000","last_change":"2023-06-02T15:30:38.639043+0000","last_active":"2023-06-02T15:31:25.987178+0000","last_peered":"2023-06-02T15:31:25.987178+0000","last_clean":"2023-06-02T15:31:25.987178+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:31:25.987178+0000","last_undegraded":"2023-06-02T15:31:25.987178+0000","last_fullsized":"2023-06-02T15:31:25.987178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579235+0000","last_change":"2023-06-02T15:30:38.637413+0000","last_active":"2023-06-02T15:31:25.579235+0000","last_peered":"2023-06-02T15:31:25.579235+0000","last_clean":"2023-06-02T15:31:25.579235+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:31:25.579235+0000","last_undegraded":"2023-06-02T15:31:25.579235+0000","last_fullsized":"2023-06-02T15:31:25.579235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:22.390984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619908+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:31:25.619908+0000","last_peered":"2023-06-02T15:31:25.619908+0000","last_clean":"2023-06-02T15:31:25.619908+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:31:25.619908+0000","last_undegraded":"2023-06-02T15:31:25.619908+0000","last_fullsized":"2023-06-02T15:31:25.619908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:17:55.191725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581242+0000","last_change":"2023-06-02T15:30:38.650591+0000","last_active":"2023-06-02T15:31:25.581242+0000","last_peered":"2023-06-02T15:31:25.581242+0000","last_clean":"2023-06-02T15:31:25.581242+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:31:25.581242+0000","last_undegraded":"2023-06-02T15:31:25.581242+0000","last_fullsized":"2023-06-02T15:31:25.581242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577617+0000","last_change":"2023-06-02T15:30:38.639026+0000","last_active":"2023-06-02T15:31:25.577617+0000","last_peered":"2023-06-02T15:31:25.577617+0000","last_clean":"2023-06-02T15:31:25.577617+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:31:25.577617+0000","last_undegraded":"2023-06-02T15:31:25.577617+0000","last_fullsized":"2023-06-02T15:31:25.577617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:49.394624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5686,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9156,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362684,"statfs":{"total":96636764160,"available":96627388416,"internally_reserved":0,"allocated":389120,"data_stored":719524,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8540,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363300,"statfs":{"total":96636764160,"available":96628019200,"internally_reserved":0,"allocated":282624,"data_stored":116541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":315392,"data_stored":128996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8604,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363236,"statfs":{"total":96636764160,"available":96627953664,"internally_reserved":0,"allocated":282624,"data_stored":116981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9124,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362716,"statfs":{"total":96636764160,"available":96627421184,"internally_reserved":0,"allocated":356352,"data_stored":714404,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8600,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363240,"statfs":{"total":96636764160,"available":96627957760,"internally_reserved":0,"allocated":278528,"data_stored":116471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:31:32.664 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:31:32.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f744dfb7640 1 Processor -- start 2023-06-02T15:31:32.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f744dfb7640 1 -- start start 2023-06-02T15:31:32.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f744dfb7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f744814ec20 0x7f74480c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f744dfb7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7448151c40 0x7f7448152070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f744dfb7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f744814f3d0 con 0x7f74481525b0 2023-06-02T15:31:32.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f744dfb7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74480aa650 con 0x7f744814ec20 2023-06-02T15:31:32.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f744dfb7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f744806be70 con 0x7f7448151c40 2023-06-02T15:31:32.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f74477fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f744814ec20 0x7f74480c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:32.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f74477fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f744814ec20 0x7f74480c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33380/0 (socket says 172.21.15.78:33380) 2023-06-02T15:31:32.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f74477fe640 1 -- 172.21.15.78:0/1040694450 learned_addr learned my addr 172.21.15.78:0/1040694450 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:32.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f74477fe640 1 -- 172.21.15.78:0/1040694450 >> v2:172.21.15.132:3300/0 conn(0x7f7448151c40 msgr2=0x7f7448152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:32.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f74477fe640 1 --2- 172.21.15.78:0/1040694450 >> v2:172.21.15.132:3300/0 conn(0x7f7448151c40 0x7f7448152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f74477fe640 1 -- 172.21.15.78:0/1040694450 >> v1:172.21.15.132:6789/0 conn(0x7f74481525b0 legacy=0x7f74480c1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:32.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.810+0000 7f74477fe640 1 -- 172.21.15.78:0/1040694450 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480c2db0 con 0x7f744814ec20 2023-06-02T15:31:32.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f74477fe640 1 --2- 172.21.15.78:0/1040694450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f744814ec20 0x7f74480c2870 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f744806b2b0 tx=0x7f743801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241a4403e0a574 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:32.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f74467fc640 1 -- 172.21.15.78:0/1040694450 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74480c22a0 con 0x7f744814ec20 2023-06-02T15:31:32.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f74467fc640 1 -- 172.21.15.78:0/1040694450 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74380ac410 con 0x7f744814ec20 2023-06-02T15:31:32.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f74467fc640 1 -- 172.21.15.78:0/1040694450 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74380ac7a0 con 0x7f744814ec20 2023-06-02T15:31:32.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f744dfb7640 1 -- 172.21.15.78:0/1040694450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f744814ec20 msgr2=0x7f74480c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:32.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f744dfb7640 1 --2- 172.21.15.78:0/1040694450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f744814ec20 0x7f74480c2870 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f744806b2b0 tx=0x7f743801c4c0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f744dfb7640 1 -- 172.21.15.78:0/1040694450 shutdown_connections 2023-06-02T15:31:32.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f744dfb7640 1 --2- 172.21.15.78:0/1040694450 >> v2:172.21.15.132:3300/0 conn(0x7f7448151c40 0x7f7448152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f744dfb7640 1 --2- 172.21.15.78:0/1040694450 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f744814ec20 0x7f74480c2870 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f744dfb7640 1 -- 172.21.15.78:0/1040694450 >> 172.21.15.78:0/1040694450 conn(0x7f7448071020 msgr2=0x7f7448071420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:32.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f744dfb7640 1 -- 172.21.15.78:0/1040694450 shutdown_connections 2023-06-02T15:31:32.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.814+0000 7f744dfb7640 1 -- 172.21.15.78:0/1040694450 wait complete. 2023-06-02T15:31:32.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 Processor -- start 2023-06-02T15:31:32.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 -- start start 2023-06-02T15:31:32.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f744814ec20 0x7f7448144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7448151c40 0x7f7448144ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74481525b0 0x7f744814a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74480a8380 con 0x7f74481525b0 2023-06-02T15:31:32.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f744814b8d0 con 0x7f744814ec20 2023-06-02T15:31:32.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74481e7330 con 0x7f7448151c40 2023-06-02T15:31:32.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f7447fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74481525b0 0x7f744814a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:32.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f7447fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74481525b0 0x7f744814a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33394/0 (socket says 172.21.15.78:33394) 2023-06-02T15:31:32.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f7447fff640 1 -- 172.21.15.78:0/4004526714 learned_addr learned my addr 172.21.15.78:0/4004526714 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:32.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f7446ffd640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7448151c40 0x7f7448144ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:32.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f74477fe640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f744814ec20 0x7f7448144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:32.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f7447fff640 1 -- 172.21.15.78:0/4004526714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7448151c40 msgr2=0x7f7448144ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:32.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f7447fff640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7448151c40 0x7f7448144ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f7447fff640 1 -- 172.21.15.78:0/4004526714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f744814ec20 msgr2=0x7f7448144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:32.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f7447fff640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f744814ec20 0x7f7448144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f7447fff640 1 -- 172.21.15.78:0/4004526714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74380094d0 con 0x7f74481525b0 2023-06-02T15:31:32.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f74477fe640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f744814ec20 0x7f7448144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:32.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f7447fff640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74481525b0 0x7f744814a150 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f744000b990 tx=0x7f744000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:32.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f742ffff640 1 -- 172.21.15.78:0/4004526714 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744000cba0 con 0x7f74481525b0 2023-06-02T15:31:32.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f742ffff640 1 -- 172.21.15.78:0/4004526714 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744000cd00 con 0x7f74481525b0 2023-06-02T15:31:32.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 -- 172.21.15.78:0/4004526714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f744814eff0 con 0x7f74481525b0 2023-06-02T15:31:32.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f742ffff640 1 -- 172.21.15.78:0/4004526714 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7440014680 con 0x7f74481525b0 2023-06-02T15:31:32.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 -- 172.21.15.78:0/4004526714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7448152a30 con 0x7f74481525b0 2023-06-02T15:31:32.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f744dfb7640 1 -- 172.21.15.78:0/4004526714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74480bec80 con 0x7f74481525b0 2023-06-02T15:31:32.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f742ffff640 1 -- 172.21.15.78:0/4004526714 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f744001d3b0 con 0x7f74481525b0 2023-06-02T15:31:32.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.818+0000 7f742ffff640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7434065c30 0x7f74340680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:32.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.822+0000 7f74477fe640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7434065c30 0x7f74340680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:32.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.822+0000 7f742ffff640 1 -- 172.21.15.78:0/4004526714 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f74400834e0 con 0x7f74481525b0 2023-06-02T15:31:32.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.822+0000 7f74477fe640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7434065c30 0x7f74340680e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f74380ae000 tx=0x7f7438008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:32.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.826+0000 7f742ffff640 1 -- 172.21.15.78:0/4004526714 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f7440050a10 con 0x7f74481525b0 2023-06-02T15:31:32.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.970+0000 7f744dfb7640 1 -- 172.21.15.78:0/4004526714 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f744814e210 con 0x7f7434065c30 2023-06-02T15:31:32.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.982+0000 7f742ffff640 1 -- 172.21.15.78:0/4004526714 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367688 (secure 0 0 0) 0x7f744814e210 con 0x7f7434065c30 2023-06-02T15:31:32.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:32.996 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:31:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 -- 172.21.15.78:0/4004526714 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7434065c30 msgr2=0x7f74340680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7434065c30 0x7f74340680e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f74380ae000 tx=0x7f7438008040 comp rx=0 tx=0).stop 2023-06-02T15:31:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 -- 172.21.15.78:0/4004526714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74481525b0 msgr2=0x7f744814a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:32.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74481525b0 0x7f744814a150 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f744000b990 tx=0x7f744000be50 comp rx=0 tx=0).stop 2023-06-02T15:31:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 -- 172.21.15.78:0/4004526714 shutdown_connections 2023-06-02T15:31:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7434065c30 0x7f74340680e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74481525b0 0x7f744814a150 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f7448151c40 0x7f7448144ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:32.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 --2- 172.21.15.78:0/4004526714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f744814ec20 0x7f7448144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 -- 172.21.15.78:0/4004526714 >> 172.21.15.78:0/4004526714 conn(0x7f7448071020 msgr2=0x7f74480c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:33.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 -- 172.21.15.78:0/4004526714 shutdown_connections 2023-06-02T15:31:33.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:32.986+0000 7f744dfb7640 1 -- 172.21.15.78:0/4004526714 wait complete. 2023-06-02T15:31:33.010 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2023-06-02T15:31:31.240626+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596054,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":339,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69756,"kb_used_data":2428,"kb_used_omap":0,"kb_used_meta":67264,"kb_avail":754904964,"statfs":{"total":773094113280,"available":773022683136,"internally_reserved":0,"allocated":2486272,"data_stored":2160989,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68878336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002967"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578786+0000","last_change":"2023-06-02T15:30:42.711237+0000","last_active":"2023-06-02T15:31:25.578786+0000","last_peered":"2023-06-02T15:31:25.578786+0000","last_clean":"2023-06-02T15:31:25.578786+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:31:25.578786+0000","last_undegraded":"2023-06-02T15:31:25.578786+0000","last_fullsized":"2023-06-02T15:31:25.578786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987457+0000","last_change":"2023-06-02T15:30:38.275721+0000","last_active":"2023-06-02T15:31:25.987457+0000","last_peered":"2023-06-02T15:31:25.987457+0000","last_clean":"2023-06-02T15:31:25.987457+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:31:25.987457+0000","last_undegraded":"2023-06-02T15:31:25.987457+0000","last_fullsized":"2023-06-02T15:31:25.987457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618872+0000","last_change":"2023-06-02T15:30:38.638911+0000","last_active":"2023-06-02T15:31:25.618872+0000","last_peered":"2023-06-02T15:31:25.618872+0000","last_clean":"2023-06-02T15:31:25.618872+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:31:25.618872+0000","last_undegraded":"2023-06-02T15:31:25.618872+0000","last_fullsized":"2023-06-02T15:31:25.618872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618711+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:31:25.618711+0000","last_peered":"2023-06-02T15:31:25.618711+0000","last_clean":"2023-06-02T15:31:25.618711+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:31:25.618711+0000","last_undegraded":"2023-06-02T15:31:25.618711+0000","last_fullsized":"2023-06-02T15:31:25.618711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:23:12.455644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571682+0000","last_change":"2023-06-02T15:30:38.282116+0000","last_active":"2023-06-02T15:31:25.571682+0000","last_peered":"2023-06-02T15:31:25.571682+0000","last_clean":"2023-06-02T15:31:25.571682+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:31:25.571682+0000","last_undegraded":"2023-06-02T15:31:25.571682+0000","last_fullsized":"2023-06-02T15:31:25.571682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571216+0000","last_change":"2023-06-02T15:30:38.638342+0000","last_active":"2023-06-02T15:31:25.571216+0000","last_peered":"2023-06-02T15:31:25.571216+0000","last_clean":"2023-06-02T15:31:25.571216+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:31:25.571216+0000","last_undegraded":"2023-06-02T15:31:25.571216+0000","last_fullsized":"2023-06-02T15:31:25.571216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578935+0000","last_change":"2023-06-02T15:30:42.715416+0000","last_active":"2023-06-02T15:31:25.578935+0000","last_peered":"2023-06-02T15:31:25.578935+0000","last_clean":"2023-06-02T15:31:25.578935+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:31:25.578935+0000","last_undegraded":"2023-06-02T15:31:25.578935+0000","last_fullsized":"2023-06-02T15:31:25.578935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581243+0000","last_change":"2023-06-02T15:30:38.278973+0000","last_active":"2023-06-02T15:31:25.581243+0000","last_peered":"2023-06-02T15:31:25.581243+0000","last_clean":"2023-06-02T15:31:25.581243+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:31:25.581243+0000","last_undegraded":"2023-06-02T15:31:25.581243+0000","last_fullsized":"2023-06-02T15:31:25.581243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619180+0000","last_change":"2023-06-02T15:30:38.644549+0000","last_active":"2023-06-02T15:31:25.619180+0000","last_peered":"2023-06-02T15:31:25.619180+0000","last_clean":"2023-06-02T15:31:25.619180+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:31:25.619180+0000","last_undegraded":"2023-06-02T15:31:25.619180+0000","last_fullsized":"2023-06-02T15:31:25.619180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:26.088195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627207+0000","last_change":"2023-06-02T15:30:42.707090+0000","last_active":"2023-06-02T15:31:25.627207+0000","last_peered":"2023-06-02T15:31:25.627207+0000","last_clean":"2023-06-02T15:31:25.627207+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:31:25.627207+0000","last_undegraded":"2023-06-02T15:31:25.627207+0000","last_fullsized":"2023-06-02T15:31:25.627207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580585+0000","last_change":"2023-06-02T15:30:38.269876+0000","last_active":"2023-06-02T15:31:25.580585+0000","last_peered":"2023-06-02T15:31:25.580585+0000","last_clean":"2023-06-02T15:31:25.580585+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:31:25.580585+0000","last_undegraded":"2023-06-02T15:31:25.580585+0000","last_fullsized":"2023-06-02T15:31:25.580585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619186+0000","last_change":"2023-06-02T15:30:38.639635+0000","last_active":"2023-06-02T15:31:25.619186+0000","last_peered":"2023-06-02T15:31:25.619186+0000","last_clean":"2023-06-02T15:31:25.619186+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:31:25.619186+0000","last_undegraded":"2023-06-02T15:31:25.619186+0000","last_fullsized":"2023-06-02T15:31:25.619186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:56:57.260064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580130+0000","last_change":"2023-06-02T15:30:42.699623+0000","last_active":"2023-06-02T15:31:25.580130+0000","last_peered":"2023-06-02T15:31:25.580130+0000","last_clean":"2023-06-02T15:31:25.580130+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:31:25.580130+0000","last_undegraded":"2023-06-02T15:31:25.580130+0000","last_fullsized":"2023-06-02T15:31:25.580130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:18.327051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987383+0000","last_change":"2023-06-02T15:30:38.263534+0000","last_active":"2023-06-02T15:31:25.987383+0000","last_peered":"2023-06-02T15:31:25.987383+0000","last_clean":"2023-06-02T15:31:25.987383+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:31:25.987383+0000","last_undegraded":"2023-06-02T15:31:25.987383+0000","last_fullsized":"2023-06-02T15:31:25.987383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577341+0000","last_change":"2023-06-02T15:30:38.644102+0000","last_active":"2023-06-02T15:31:25.577341+0000","last_peered":"2023-06-02T15:31:25.577341+0000","last_clean":"2023-06-02T15:31:25.577341+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:31:25.577341+0000","last_undegraded":"2023-06-02T15:31:25.577341+0000","last_fullsized":"2023-06-02T15:31:25.577341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:11.864794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619418+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:31:25.619418+0000","last_peered":"2023-06-02T15:31:25.619418+0000","last_clean":"2023-06-02T15:31:25.619418+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:31:25.619418+0000","last_undegraded":"2023-06-02T15:31:25.619418+0000","last_fullsized":"2023-06-02T15:31:25.619418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:16:13.363523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619377+0000","last_change":"2023-06-02T15:30:38.272143+0000","last_active":"2023-06-02T15:31:25.619377+0000","last_peered":"2023-06-02T15:31:25.619377+0000","last_clean":"2023-06-02T15:31:25.619377+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:31:25.619377+0000","last_undegraded":"2023-06-02T15:31:25.619377+0000","last_fullsized":"2023-06-02T15:31:25.619377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.572235+0000","last_change":"2023-06-02T15:30:38.650795+0000","last_active":"2023-06-02T15:31:25.572235+0000","last_peered":"2023-06-02T15:31:25.572235+0000","last_clean":"2023-06-02T15:31:25.572235+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:31:25.572235+0000","last_undegraded":"2023-06-02T15:31:25.572235+0000","last_fullsized":"2023-06-02T15:31:25.572235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579795+0000","last_change":"2023-06-02T15:30:42.706975+0000","last_active":"2023-06-02T15:31:25.579795+0000","last_peered":"2023-06-02T15:31:25.579795+0000","last_clean":"2023-06-02T15:31:25.579795+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:31:25.579795+0000","last_undegraded":"2023-06-02T15:31:25.579795+0000","last_fullsized":"2023-06-02T15:31:25.579795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:32.007544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579181+0000","last_change":"2023-06-02T15:30:38.290129+0000","last_active":"2023-06-02T15:31:25.579181+0000","last_peered":"2023-06-02T15:31:25.579181+0000","last_clean":"2023-06-02T15:31:25.579181+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:31:25.579181+0000","last_undegraded":"2023-06-02T15:31:25.579181+0000","last_fullsized":"2023-06-02T15:31:25.579181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987383+0000","last_change":"2023-06-02T15:30:38.656679+0000","last_active":"2023-06-02T15:31:25.987383+0000","last_peered":"2023-06-02T15:31:25.987383+0000","last_clean":"2023-06-02T15:31:25.987383+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:31:25.987383+0000","last_undegraded":"2023-06-02T15:31:25.987383+0000","last_fullsized":"2023-06-02T15:31:25.987383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987725+0000","last_change":"2023-06-02T15:30:42.705633+0000","last_active":"2023-06-02T15:31:25.987725+0000","last_peered":"2023-06-02T15:31:25.987725+0000","last_clean":"2023-06-02T15:31:25.987725+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:31:25.987725+0000","last_undegraded":"2023-06-02T15:31:25.987725+0000","last_fullsized":"2023-06-02T15:31:25.987725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571269+0000","last_change":"2023-06-02T15:30:38.273154+0000","last_active":"2023-06-02T15:31:25.571269+0000","last_peered":"2023-06-02T15:31:25.571269+0000","last_clean":"2023-06-02T15:31:25.571269+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:31:25.571269+0000","last_undegraded":"2023-06-02T15:31:25.571269+0000","last_fullsized":"2023-06-02T15:31:25.571269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579891+0000","last_change":"2023-06-02T15:30:38.647445+0000","last_active":"2023-06-02T15:31:25.579891+0000","last_peered":"2023-06-02T15:31:25.579891+0000","last_clean":"2023-06-02T15:31:25.579891+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:31:25.579891+0000","last_undegraded":"2023-06-02T15:31:25.579891+0000","last_fullsized":"2023-06-02T15:31:25.579891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:34.366098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571012+0000","last_change":"2023-06-02T15:30:38.650927+0000","last_active":"2023-06-02T15:31:25.571012+0000","last_peered":"2023-06-02T15:31:25.571012+0000","last_clean":"2023-06-02T15:31:25.571012+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:31:25.571012+0000","last_undegraded":"2023-06-02T15:31:25.571012+0000","last_fullsized":"2023-06-02T15:31:25.571012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987597+0000","last_change":"2023-06-02T15:30:38.274472+0000","last_active":"2023-06-02T15:31:25.987597+0000","last_peered":"2023-06-02T15:31:25.987597+0000","last_clean":"2023-06-02T15:31:25.987597+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:31:25.987597+0000","last_undegraded":"2023-06-02T15:31:25.987597+0000","last_fullsized":"2023-06-02T15:31:25.987597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578080+0000","last_change":"2023-06-02T15:30:42.710065+0000","last_active":"2023-06-02T15:31:25.578080+0000","last_peered":"2023-06-02T15:31:25.578080+0000","last_clean":"2023-06-02T15:31:25.578080+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:31:25.578080+0000","last_undegraded":"2023-06-02T15:31:25.578080+0000","last_fullsized":"2023-06-02T15:31:25.578080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571297+0000","last_change":"2023-06-02T15:30:38.656769+0000","last_active":"2023-06-02T15:31:25.571297+0000","last_peered":"2023-06-02T15:31:25.571297+0000","last_clean":"2023-06-02T15:31:25.571297+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:31:25.571297+0000","last_undegraded":"2023-06-02T15:31:25.571297+0000","last_fullsized":"2023-06-02T15:31:25.571297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581474+0000","last_change":"2023-06-02T15:30:38.275134+0000","last_active":"2023-06-02T15:31:25.581474+0000","last_peered":"2023-06-02T15:31:25.581474+0000","last_clean":"2023-06-02T15:31:25.581474+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:31:25.581474+0000","last_undegraded":"2023-06-02T15:31:25.581474+0000","last_fullsized":"2023-06-02T15:31:25.581474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626635+0000","last_change":"2023-06-02T15:30:42.706722+0000","last_active":"2023-06-02T15:31:25.626635+0000","last_peered":"2023-06-02T15:31:25.626635+0000","last_clean":"2023-06-02T15:31:25.626635+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:31:25.626635+0000","last_undegraded":"2023-06-02T15:31:25.626635+0000","last_fullsized":"2023-06-02T15:31:25.626635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628183+0000","last_change":"2023-06-02T15:30:38.289736+0000","last_active":"2023-06-02T15:31:25.628183+0000","last_peered":"2023-06-02T15:31:25.628183+0000","last_clean":"2023-06-02T15:31:25.628183+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:31:25.628183+0000","last_undegraded":"2023-06-02T15:31:25.628183+0000","last_fullsized":"2023-06-02T15:31:25.628183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:43:04.205096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579296+0000","last_change":"2023-06-02T15:30:38.642841+0000","last_active":"2023-06-02T15:31:25.579296+0000","last_peered":"2023-06-02T15:31:25.579296+0000","last_clean":"2023-06-02T15:31:25.579296+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:31:25.579296+0000","last_undegraded":"2023-06-02T15:31:25.579296+0000","last_fullsized":"2023-06-02T15:31:25.579296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571470+0000","last_change":"2023-06-02T15:30:42.720577+0000","last_active":"2023-06-02T15:31:25.571470+0000","last_peered":"2023-06-02T15:31:25.571470+0000","last_clean":"2023-06-02T15:31:25.571470+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:31:25.571470+0000","last_undegraded":"2023-06-02T15:31:25.571470+0000","last_fullsized":"2023-06-02T15:31:25.571470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:48:54.291389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"26'15","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626342+0000","last_change":"2023-06-02T15:30:38.276703+0000","last_active":"2023-06-02T15:31:25.626342+0000","last_peered":"2023-06-02T15:31:25.626342+0000","last_clean":"2023-06-02T15:31:25.626342+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:31:25.626342+0000","last_undegraded":"2023-06-02T15:31:25.626342+0000","last_fullsized":"2023-06-02T15:31:25.626342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4904,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619291+0000","last_change":"2023-06-02T15:30:38.634436+0000","last_active":"2023-06-02T15:31:25.619291+0000","last_peered":"2023-06-02T15:31:25.619291+0000","last_clean":"2023-06-02T15:31:25.619291+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:31:25.619291+0000","last_undegraded":"2023-06-02T15:31:25.619291+0000","last_fullsized":"2023-06-02T15:31:25.619291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579046+0000","last_change":"2023-06-02T15:30:42.707445+0000","last_active":"2023-06-02T15:31:25.579046+0000","last_peered":"2023-06-02T15:31:25.579046+0000","last_clean":"2023-06-02T15:31:25.579046+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:31:25.579046+0000","last_undegraded":"2023-06-02T15:31:25.579046+0000","last_fullsized":"2023-06-02T15:31:25.579046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579355+0000","last_change":"2023-06-02T15:30:38.649326+0000","last_active":"2023-06-02T15:31:25.579355+0000","last_peered":"2023-06-02T15:31:25.579355+0000","last_clean":"2023-06-02T15:31:25.579355+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:31:25.579355+0000","last_undegraded":"2023-06-02T15:31:25.579355+0000","last_fullsized":"2023-06-02T15:31:25.579355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579942+0000","last_change":"2023-06-02T15:30:33.407154+0000","last_active":"2023-06-02T15:31:25.579942+0000","last_peered":"2023-06-02T15:31:25.579942+0000","last_clean":"2023-06-02T15:31:25.579942+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:31:25.579942+0000","last_undegraded":"2023-06-02T15:31:25.579942+0000","last_fullsized":"2023-06-02T15:31:25.579942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581239+0000","last_change":"2023-06-02T15:30:38.279321+0000","last_active":"2023-06-02T15:31:25.581239+0000","last_peered":"2023-06-02T15:31:25.581239+0000","last_clean":"2023-06-02T15:31:25.581239+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:31:25.581239+0000","last_undegraded":"2023-06-02T15:31:25.581239+0000","last_fullsized":"2023-06-02T15:31:25.581239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986692+0000","last_change":"2023-06-02T15:30:42.715780+0000","last_active":"2023-06-02T15:31:25.986692+0000","last_peered":"2023-06-02T15:31:25.986692+0000","last_clean":"2023-06-02T15:31:25.986692+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:31:25.986692+0000","last_undegraded":"2023-06-02T15:31:25.986692+0000","last_fullsized":"2023-06-02T15:31:25.986692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986987+0000","last_change":"2023-06-02T15:30:38.632171+0000","last_active":"2023-06-02T15:31:25.986987+0000","last_peered":"2023-06-02T15:31:25.986987+0000","last_clean":"2023-06-02T15:31:25.986987+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:31:25.986987+0000","last_undegraded":"2023-06-02T15:31:25.986987+0000","last_fullsized":"2023-06-02T15:31:25.986987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579661+0000","last_change":"2023-06-02T15:30:33.655215+0000","last_active":"2023-06-02T15:31:25.579661+0000","last_peered":"2023-06-02T15:31:25.579661+0000","last_clean":"2023-06-02T15:31:25.579661+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:31:25.579661+0000","last_undegraded":"2023-06-02T15:31:25.579661+0000","last_fullsized":"2023-06-02T15:31:25.579661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580143+0000","last_change":"2023-06-02T15:30:38.277096+0000","last_active":"2023-06-02T15:31:25.580143+0000","last_peered":"2023-06-02T15:31:25.580143+0000","last_clean":"2023-06-02T15:31:25.580143+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:31:25.580143+0000","last_undegraded":"2023-06-02T15:31:25.580143+0000","last_fullsized":"2023-06-02T15:31:25.580143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578632+0000","last_change":"2023-06-02T15:30:42.698823+0000","last_active":"2023-06-02T15:31:25.578632+0000","last_peered":"2023-06-02T15:31:25.578632+0000","last_clean":"2023-06-02T15:31:25.578632+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:31:25.578632+0000","last_undegraded":"2023-06-02T15:31:25.578632+0000","last_fullsized":"2023-06-02T15:31:25.578632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571086+0000","last_change":"2023-06-02T15:30:38.656372+0000","last_active":"2023-06-02T15:31:25.571086+0000","last_peered":"2023-06-02T15:31:25.571086+0000","last_clean":"2023-06-02T15:31:25.571086+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:31:25.571086+0000","last_undegraded":"2023-06-02T15:31:25.571086+0000","last_fullsized":"2023-06-02T15:31:25.571086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620264+0000","last_change":"2023-06-02T15:30:33.959737+0000","last_active":"2023-06-02T15:31:25.620264+0000","last_peered":"2023-06-02T15:31:25.620264+0000","last_clean":"2023-06-02T15:31:25.620264+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:31:25.620264+0000","last_undegraded":"2023-06-02T15:31:25.620264+0000","last_fullsized":"2023-06-02T15:31:25.620264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.573996+0000","last_change":"2023-06-02T15:30:38.281667+0000","last_active":"2023-06-02T15:31:25.573996+0000","last_peered":"2023-06-02T15:31:25.573996+0000","last_clean":"2023-06-02T15:31:25.573996+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:31:25.573996+0000","last_undegraded":"2023-06-02T15:31:25.573996+0000","last_fullsized":"2023-06-02T15:31:25.573996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618579+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:31:25.618579+0000","last_peered":"2023-06-02T15:31:25.618579+0000","last_clean":"2023-06-02T15:31:25.618579+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:31:25.618579+0000","last_undegraded":"2023-06-02T15:31:25.618579+0000","last_fullsized":"2023-06-02T15:31:25.618579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:02:01.714482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619050+0000","last_change":"2023-06-02T15:30:38.646642+0000","last_active":"2023-06-02T15:31:25.619050+0000","last_peered":"2023-06-02T15:31:25.619050+0000","last_clean":"2023-06-02T15:31:25.619050+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:31:25.619050+0000","last_undegraded":"2023-06-02T15:31:25.619050+0000","last_fullsized":"2023-06-02T15:31:25.619050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571588+0000","last_change":"2023-06-02T15:30:33.413542+0000","last_active":"2023-06-02T15:31:25.571588+0000","last_peered":"2023-06-02T15:31:25.571588+0000","last_clean":"2023-06-02T15:31:25.571588+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:31:25.571588+0000","last_undegraded":"2023-06-02T15:31:25.571588+0000","last_fullsized":"2023-06-02T15:31:25.571588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987572+0000","last_change":"2023-06-02T15:30:38.270941+0000","last_active":"2023-06-02T15:31:25.987572+0000","last_peered":"2023-06-02T15:31:25.987572+0000","last_clean":"2023-06-02T15:31:25.987572+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:31:25.987572+0000","last_undegraded":"2023-06-02T15:31:25.987572+0000","last_fullsized":"2023-06-02T15:31:25.987572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.570918+0000","last_change":"2023-06-02T15:30:42.702383+0000","last_active":"2023-06-02T15:31:25.570918+0000","last_peered":"2023-06-02T15:31:25.570918+0000","last_clean":"2023-06-02T15:31:25.570918+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:31:25.570918+0000","last_undegraded":"2023-06-02T15:31:25.570918+0000","last_fullsized":"2023-06-02T15:31:25.570918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:49:31.222291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987397+0000","last_change":"2023-06-02T15:30:38.642398+0000","last_active":"2023-06-02T15:31:25.987397+0000","last_peered":"2023-06-02T15:31:25.987397+0000","last_clean":"2023-06-02T15:31:25.987397+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:31:25.987397+0000","last_undegraded":"2023-06-02T15:31:25.987397+0000","last_fullsized":"2023-06-02T15:31:25.987397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986410+0000","last_change":"2023-06-02T15:30:38.263733+0000","last_active":"2023-06-02T15:31:25.986410+0000","last_peered":"2023-06-02T15:31:25.986410+0000","last_clean":"2023-06-02T15:31:25.986410+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:31:25.986410+0000","last_undegraded":"2023-06-02T15:31:25.986410+0000","last_fullsized":"2023-06-02T15:31:25.986410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626859+0000","last_change":"2023-06-02T15:30:34.413807+0000","last_active":"2023-06-02T15:31:25.626859+0000","last_peered":"2023-06-02T15:31:25.626859+0000","last_clean":"2023-06-02T15:31:25.626859+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:31:25.626859+0000","last_undegraded":"2023-06-02T15:31:25.626859+0000","last_fullsized":"2023-06-02T15:31:25.626859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_clean_scrub_stamp":"2023-06-02T15:30:33.390390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:47:50.762629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579897+0000","last_change":"2023-06-02T15:30:33.411973+0000","last_active":"2023-06-02T15:31:25.579897+0000","last_peered":"2023-06-02T15:31:25.579897+0000","last_clean":"2023-06-02T15:31:25.579897+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:31:25.579897+0000","last_undegraded":"2023-06-02T15:31:25.579897+0000","last_fullsized":"2023-06-02T15:31:25.579897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581043+0000","last_change":"2023-06-02T15:30:42.712421+0000","last_active":"2023-06-02T15:31:25.581043+0000","last_peered":"2023-06-02T15:31:25.581043+0000","last_clean":"2023-06-02T15:31:25.581043+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:31:25.581043+0000","last_undegraded":"2023-06-02T15:31:25.581043+0000","last_fullsized":"2023-06-02T15:31:25.581043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:38:29.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580505+0000","last_change":"2023-06-02T15:30:38.653404+0000","last_active":"2023-06-02T15:31:25.580505+0000","last_peered":"2023-06-02T15:31:25.580505+0000","last_clean":"2023-06-02T15:31:25.580505+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:31:25.580505+0000","last_undegraded":"2023-06-02T15:31:25.580505+0000","last_fullsized":"2023-06-02T15:31:25.580505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578842+0000","last_change":"2023-06-02T15:30:38.269833+0000","last_active":"2023-06-02T15:31:25.578842+0000","last_peered":"2023-06-02T15:31:25.578842+0000","last_clean":"2023-06-02T15:31:25.578842+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:31:25.578842+0000","last_undegraded":"2023-06-02T15:31:25.578842+0000","last_fullsized":"2023-06-02T15:31:25.578842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:06:46.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627221+0000","last_change":"2023-06-02T15:30:33.654728+0000","last_active":"2023-06-02T15:31:25.627221+0000","last_peered":"2023-06-02T15:31:25.627221+0000","last_clean":"2023-06-02T15:31:25.627221+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:31:25.627221+0000","last_undegraded":"2023-06-02T15:31:25.627221+0000","last_fullsized":"2023-06-02T15:31:25.627221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:05:26.791938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577627+0000","last_change":"2023-06-02T15:30:42.705191+0000","last_active":"2023-06-02T15:31:25.577627+0000","last_peered":"2023-06-02T15:31:25.577627+0000","last_clean":"2023-06-02T15:31:25.577627+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:31:25.577627+0000","last_undegraded":"2023-06-02T15:31:25.577627+0000","last_fullsized":"2023-06-02T15:31:25.577627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:22.765485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580072+0000","last_change":"2023-06-02T15:30:38.642359+0000","last_active":"2023-06-02T15:31:25.580072+0000","last_peered":"2023-06-02T15:31:25.580072+0000","last_clean":"2023-06-02T15:31:25.580072+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:31:25.580072+0000","last_undegraded":"2023-06-02T15:31:25.580072+0000","last_fullsized":"2023-06-02T15:31:25.580072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619577+0000","last_change":"2023-06-02T15:30:38.257531+0000","last_active":"2023-06-02T15:31:25.619577+0000","last_peered":"2023-06-02T15:31:25.619577+0000","last_clean":"2023-06-02T15:31:25.619577+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:31:25.619577+0000","last_undegraded":"2023-06-02T15:31:25.619577+0000","last_fullsized":"2023-06-02T15:31:25.619577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577955+0000","last_change":"2023-06-02T15:30:33.655250+0000","last_active":"2023-06-02T15:31:25.577955+0000","last_peered":"2023-06-02T15:31:25.577955+0000","last_clean":"2023-06-02T15:31:25.577955+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:31:25.577955+0000","last_undegraded":"2023-06-02T15:31:25.577955+0000","last_fullsized":"2023-06-02T15:31:25.577955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986943+0000","last_change":"2023-06-02T15:30:42.693557+0000","last_active":"2023-06-02T15:31:25.986943+0000","last_peered":"2023-06-02T15:31:25.986943+0000","last_clean":"2023-06-02T15:31:25.986943+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:31:25.986943+0000","last_undegraded":"2023-06-02T15:31:25.986943+0000","last_fullsized":"2023-06-02T15:31:25.986943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579446+0000","last_change":"2023-06-02T15:30:38.645488+0000","last_active":"2023-06-02T15:31:25.579446+0000","last_peered":"2023-06-02T15:31:25.579446+0000","last_clean":"2023-06-02T15:31:25.579446+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:31:25.579446+0000","last_undegraded":"2023-06-02T15:31:25.579446+0000","last_fullsized":"2023-06-02T15:31:25.579446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571801+0000","last_change":"2023-06-02T15:30:38.283390+0000","last_active":"2023-06-02T15:31:25.571801+0000","last_peered":"2023-06-02T15:31:25.571801+0000","last_clean":"2023-06-02T15:31:25.571801+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:31:25.571801+0000","last_undegraded":"2023-06-02T15:31:25.571801+0000","last_fullsized":"2023-06-02T15:31:25.571801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626919+0000","last_change":"2023-06-02T15:30:33.653937+0000","last_active":"2023-06-02T15:31:25.626919+0000","last_peered":"2023-06-02T15:31:25.626919+0000","last_clean":"2023-06-02T15:31:25.626919+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:31:25.626919+0000","last_undegraded":"2023-06-02T15:31:25.626919+0000","last_fullsized":"2023-06-02T15:31:25.626919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627136+0000","last_change":"2023-06-02T15:30:42.723169+0000","last_active":"2023-06-02T15:31:25.627136+0000","last_peered":"2023-06-02T15:31:25.627136+0000","last_clean":"2023-06-02T15:31:25.627136+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:31:25.627136+0000","last_undegraded":"2023-06-02T15:31:25.627136+0000","last_fullsized":"2023-06-02T15:31:25.627136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.760660+0000","last_change":"2023-06-02T15:31:26.759068+0000","last_active":"2023-06-02T15:31:26.760660+0000","last_peered":"2023-06-02T15:31:26.760660+0000","last_clean":"2023-06-02T15:31:26.760660+0000","last_became_active":"2023-06-02T15:31:26.758308+0000","last_became_peered":"2023-06-02T15:31:26.758308+0000","last_unstale":"2023-06-02T15:31:26.760660+0000","last_undegraded":"2023-06-02T15:31:26.760660+0000","last_fullsized":"2023-06-02T15:31:26.760660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:21.714894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571177+0000","last_change":"2023-06-02T15:30:38.281851+0000","last_active":"2023-06-02T15:31:25.571177+0000","last_peered":"2023-06-02T15:31:25.571177+0000","last_clean":"2023-06-02T15:31:25.571177+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:31:25.571177+0000","last_undegraded":"2023-06-02T15:31:25.571177+0000","last_fullsized":"2023-06-02T15:31:25.571177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619892+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:31:25.619892+0000","last_peered":"2023-06-02T15:31:25.619892+0000","last_clean":"2023-06-02T15:31:25.619892+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:31:25.619892+0000","last_undegraded":"2023-06-02T15:31:25.619892+0000","last_fullsized":"2023-06-02T15:31:25.619892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:44.594461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620069+0000","last_change":"2023-06-02T15:30:38.638725+0000","last_active":"2023-06-02T15:31:25.620069+0000","last_peered":"2023-06-02T15:31:25.620069+0000","last_clean":"2023-06-02T15:31:25.620069+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:31:25.620069+0000","last_undegraded":"2023-06-02T15:31:25.620069+0000","last_fullsized":"2023-06-02T15:31:25.620069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619044+0000","last_change":"2023-06-02T15:30:38.269278+0000","last_active":"2023-06-02T15:31:25.619044+0000","last_peered":"2023-06-02T15:31:25.619044+0000","last_clean":"2023-06-02T15:31:25.619044+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:31:25.619044+0000","last_undegraded":"2023-06-02T15:31:25.619044+0000","last_fullsized":"2023-06-02T15:31:25.619044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581072+0000","last_change":"2023-06-02T15:30:42.713071+0000","last_active":"2023-06-02T15:31:25.581072+0000","last_peered":"2023-06-02T15:31:25.581072+0000","last_clean":"2023-06-02T15:31:25.581072+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:31:25.581072+0000","last_undegraded":"2023-06-02T15:31:25.581072+0000","last_fullsized":"2023-06-02T15:31:25.581072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620056+0000","last_change":"2023-06-02T15:30:38.636565+0000","last_active":"2023-06-02T15:31:25.620056+0000","last_peered":"2023-06-02T15:31:25.620056+0000","last_clean":"2023-06-02T15:31:25.620056+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:31:25.620056+0000","last_undegraded":"2023-06-02T15:31:25.620056+0000","last_fullsized":"2023-06-02T15:31:25.620056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:56:18.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578976+0000","last_change":"2023-06-02T15:30:38.277404+0000","last_active":"2023-06-02T15:31:25.578976+0000","last_peered":"2023-06-02T15:31:25.578976+0000","last_clean":"2023-06-02T15:31:25.578976+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:31:25.578976+0000","last_undegraded":"2023-06-02T15:31:25.578976+0000","last_fullsized":"2023-06-02T15:31:25.578976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579937+0000","last_change":"2023-06-02T15:30:42.697724+0000","last_active":"2023-06-02T15:31:25.579937+0000","last_peered":"2023-06-02T15:31:25.579937+0000","last_clean":"2023-06-02T15:31:25.579937+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:31:25.579937+0000","last_undegraded":"2023-06-02T15:31:25.579937+0000","last_fullsized":"2023-06-02T15:31:25.579937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619605+0000","last_change":"2023-06-02T15:30:38.640532+0000","last_active":"2023-06-02T15:31:25.619605+0000","last_peered":"2023-06-02T15:31:25.619605+0000","last_clean":"2023-06-02T15:31:25.619605+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:31:25.619605+0000","last_undegraded":"2023-06-02T15:31:25.619605+0000","last_fullsized":"2023-06-02T15:31:25.619605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.572026+0000","last_change":"2023-06-02T15:30:38.281909+0000","last_active":"2023-06-02T15:31:25.572026+0000","last_peered":"2023-06-02T15:31:25.572026+0000","last_clean":"2023-06-02T15:31:25.572026+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:31:25.572026+0000","last_undegraded":"2023-06-02T15:31:25.572026+0000","last_fullsized":"2023-06-02T15:31:25.572026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576942+0000","last_change":"2023-06-02T15:30:42.716337+0000","last_active":"2023-06-02T15:31:25.576942+0000","last_peered":"2023-06-02T15:31:25.576942+0000","last_clean":"2023-06-02T15:31:25.576942+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:31:25.576942+0000","last_undegraded":"2023-06-02T15:31:25.576942+0000","last_fullsized":"2023-06-02T15:31:25.576942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986836+0000","last_change":"2023-06-02T15:30:38.651270+0000","last_active":"2023-06-02T15:31:25.986836+0000","last_peered":"2023-06-02T15:31:25.986836+0000","last_clean":"2023-06-02T15:31:25.986836+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:31:25.986836+0000","last_undegraded":"2023-06-02T15:31:25.986836+0000","last_fullsized":"2023-06-02T15:31:25.986836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580356+0000","last_change":"2023-06-02T15:30:38.277304+0000","last_active":"2023-06-02T15:31:25.580356+0000","last_peered":"2023-06-02T15:31:25.580356+0000","last_clean":"2023-06-02T15:31:25.580356+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:31:25.580356+0000","last_undegraded":"2023-06-02T15:31:25.580356+0000","last_fullsized":"2023-06-02T15:31:25.580356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576791+0000","last_change":"2023-06-02T15:30:42.692861+0000","last_active":"2023-06-02T15:31:25.576791+0000","last_peered":"2023-06-02T15:31:25.576791+0000","last_clean":"2023-06-02T15:31:25.576791+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:31:25.576791+0000","last_undegraded":"2023-06-02T15:31:25.576791+0000","last_fullsized":"2023-06-02T15:31:25.576791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:29.857375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578802+0000","last_change":"2023-06-02T15:30:38.645534+0000","last_active":"2023-06-02T15:31:25.578802+0000","last_peered":"2023-06-02T15:31:25.578802+0000","last_clean":"2023-06-02T15:31:25.578802+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:31:25.578802+0000","last_undegraded":"2023-06-02T15:31:25.578802+0000","last_fullsized":"2023-06-02T15:31:25.578802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628270+0000","last_change":"2023-06-02T15:30:38.282239+0000","last_active":"2023-06-02T15:31:25.628270+0000","last_peered":"2023-06-02T15:31:25.628270+0000","last_clean":"2023-06-02T15:31:25.628270+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:31:25.628270+0000","last_undegraded":"2023-06-02T15:31:25.628270+0000","last_fullsized":"2023-06-02T15:31:25.628270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:40.807809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576809+0000","last_change":"2023-06-02T15:30:42.720849+0000","last_active":"2023-06-02T15:31:25.576809+0000","last_peered":"2023-06-02T15:31:25.576809+0000","last_clean":"2023-06-02T15:31:25.576809+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:31:25.576809+0000","last_undegraded":"2023-06-02T15:31:25.576809+0000","last_fullsized":"2023-06-02T15:31:25.576809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618839+0000","last_change":"2023-06-02T15:30:38.641746+0000","last_active":"2023-06-02T15:31:25.618839+0000","last_peered":"2023-06-02T15:31:25.618839+0000","last_clean":"2023-06-02T15:31:25.618839+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:31:25.618839+0000","last_undegraded":"2023-06-02T15:31:25.618839+0000","last_fullsized":"2023-06-02T15:31:25.618839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628173+0000","last_change":"2023-06-02T15:30:38.282724+0000","last_active":"2023-06-02T15:31:25.628173+0000","last_peered":"2023-06-02T15:31:25.628173+0000","last_clean":"2023-06-02T15:31:25.628173+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:31:25.628173+0000","last_undegraded":"2023-06-02T15:31:25.628173+0000","last_fullsized":"2023-06-02T15:31:25.628173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:21.387209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576497+0000","last_change":"2023-06-02T15:30:42.697662+0000","last_active":"2023-06-02T15:31:25.576497+0000","last_peered":"2023-06-02T15:31:25.576497+0000","last_clean":"2023-06-02T15:31:25.576497+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:31:25.576497+0000","last_undegraded":"2023-06-02T15:31:25.576497+0000","last_fullsized":"2023-06-02T15:31:25.576497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:19.014996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577702+0000","last_change":"2023-06-02T15:30:38.656950+0000","last_active":"2023-06-02T15:31:25.577702+0000","last_peered":"2023-06-02T15:31:25.577702+0000","last_clean":"2023-06-02T15:31:25.577702+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:31:25.577702+0000","last_undegraded":"2023-06-02T15:31:25.577702+0000","last_fullsized":"2023-06-02T15:31:25.577702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628287+0000","last_change":"2023-06-02T15:30:38.283602+0000","last_active":"2023-06-02T15:31:25.628287+0000","last_peered":"2023-06-02T15:31:25.628287+0000","last_clean":"2023-06-02T15:31:25.628287+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:31:25.628287+0000","last_undegraded":"2023-06-02T15:31:25.628287+0000","last_fullsized":"2023-06-02T15:31:25.628287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:33.362323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627029+0000","last_change":"2023-06-02T15:30:42.722884+0000","last_active":"2023-06-02T15:31:25.627029+0000","last_peered":"2023-06-02T15:31:25.627029+0000","last_clean":"2023-06-02T15:31:25.627029+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:31:25.627029+0000","last_undegraded":"2023-06-02T15:31:25.627029+0000","last_fullsized":"2023-06-02T15:31:25.627029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580952+0000","last_change":"2023-06-02T15:30:42.714188+0000","last_active":"2023-06-02T15:31:25.580952+0000","last_peered":"2023-06-02T15:31:25.580952+0000","last_clean":"2023-06-02T15:31:25.580952+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:31:25.580952+0000","last_undegraded":"2023-06-02T15:31:25.580952+0000","last_fullsized":"2023-06-02T15:31:25.580952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578228+0000","last_change":"2023-06-02T15:30:38.261610+0000","last_active":"2023-06-02T15:31:25.578228+0000","last_peered":"2023-06-02T15:31:25.578228+0000","last_clean":"2023-06-02T15:31:25.578228+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:31:25.578228+0000","last_undegraded":"2023-06-02T15:31:25.578228+0000","last_fullsized":"2023-06-02T15:31:25.578228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.574205+0000","last_change":"2023-06-02T15:30:38.658984+0000","last_active":"2023-06-02T15:31:25.574205+0000","last_peered":"2023-06-02T15:31:25.574205+0000","last_clean":"2023-06-02T15:31:25.574205+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:31:25.574205+0000","last_undegraded":"2023-06-02T15:31:25.574205+0000","last_fullsized":"2023-06-02T15:31:25.574205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571841+0000","last_change":"2023-06-02T15:30:42.705561+0000","last_active":"2023-06-02T15:31:25.571841+0000","last_peered":"2023-06-02T15:31:25.571841+0000","last_clean":"2023-06-02T15:31:25.571841+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:31:25.571841+0000","last_undegraded":"2023-06-02T15:31:25.571841+0000","last_fullsized":"2023-06-02T15:31:25.571841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:39:14.247511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627280+0000","last_change":"2023-06-02T15:30:38.283796+0000","last_active":"2023-06-02T15:31:25.627280+0000","last_peered":"2023-06-02T15:31:25.627280+0000","last_clean":"2023-06-02T15:31:25.627280+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:31:25.627280+0000","last_undegraded":"2023-06-02T15:31:25.627280+0000","last_fullsized":"2023-06-02T15:31:25.627280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987622+0000","last_change":"2023-06-02T15:30:38.644966+0000","last_active":"2023-06-02T15:31:25.987622+0000","last_peered":"2023-06-02T15:31:25.987622+0000","last_clean":"2023-06-02T15:31:25.987622+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:31:25.987622+0000","last_undegraded":"2023-06-02T15:31:25.987622+0000","last_fullsized":"2023-06-02T15:31:25.987622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986672+0000","last_change":"2023-06-02T15:30:38.265398+0000","last_active":"2023-06-02T15:31:25.986672+0000","last_peered":"2023-06-02T15:31:25.986672+0000","last_clean":"2023-06-02T15:31:25.986672+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:31:25.986672+0000","last_undegraded":"2023-06-02T15:31:25.986672+0000","last_fullsized":"2023-06-02T15:31:25.986672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:10:29.479149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580971+0000","last_change":"2023-06-02T15:30:38.657999+0000","last_active":"2023-06-02T15:31:25.580971+0000","last_peered":"2023-06-02T15:31:25.580971+0000","last_clean":"2023-06-02T15:31:25.580971+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:31:25.580971+0000","last_undegraded":"2023-06-02T15:31:25.580971+0000","last_fullsized":"2023-06-02T15:31:25.580971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571454+0000","last_change":"2023-06-02T15:30:42.705725+0000","last_active":"2023-06-02T15:31:25.571454+0000","last_peered":"2023-06-02T15:31:25.571454+0000","last_clean":"2023-06-02T15:31:25.571454+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:31:25.571454+0000","last_undegraded":"2023-06-02T15:31:25.571454+0000","last_fullsized":"2023-06-02T15:31:25.571454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627568+0000","last_change":"2023-06-02T15:30:38.282095+0000","last_active":"2023-06-02T15:31:25.627568+0000","last_peered":"2023-06-02T15:31:25.627568+0000","last_clean":"2023-06-02T15:31:25.627568+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:31:25.627568+0000","last_undegraded":"2023-06-02T15:31:25.627568+0000","last_fullsized":"2023-06-02T15:31:25.627568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.926559+0000","last_change":"2023-06-02T15:31:26.924308+0000","last_active":"2023-06-02T15:31:26.926559+0000","last_peered":"2023-06-02T15:31:26.926559+0000","last_clean":"2023-06-02T15:31:26.926559+0000","last_became_active":"2023-06-02T15:31:26.923733+0000","last_became_peered":"2023-06-02T15:31:26.923733+0000","last_unstale":"2023-06-02T15:31:26.926559+0000","last_undegraded":"2023-06-02T15:31:26.926559+0000","last_fullsized":"2023-06-02T15:31:26.926559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:00:54.244135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580545+0000","last_change":"2023-06-02T15:30:42.702456+0000","last_active":"2023-06-02T15:31:25.580545+0000","last_peered":"2023-06-02T15:31:25.580545+0000","last_clean":"2023-06-02T15:31:25.580545+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:31:25.580545+0000","last_undegraded":"2023-06-02T15:31:25.580545+0000","last_fullsized":"2023-06-02T15:31:25.580545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577812+0000","last_change":"2023-06-02T15:30:38.637380+0000","last_active":"2023-06-02T15:31:25.577812+0000","last_peered":"2023-06-02T15:31:25.577812+0000","last_clean":"2023-06-02T15:31:25.577812+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:31:25.577812+0000","last_undegraded":"2023-06-02T15:31:25.577812+0000","last_fullsized":"2023-06-02T15:31:25.577812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571178+0000","last_change":"2023-06-02T15:30:38.655074+0000","last_active":"2023-06-02T15:31:25.571178+0000","last_peered":"2023-06-02T15:31:25.571178+0000","last_clean":"2023-06-02T15:31:25.571178+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:31:25.571178+0000","last_undegraded":"2023-06-02T15:31:25.571178+0000","last_fullsized":"2023-06-02T15:31:25.571178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619438+0000","last_change":"2023-06-02T15:30:38.637979+0000","last_active":"2023-06-02T15:31:25.619438+0000","last_peered":"2023-06-02T15:31:25.619438+0000","last_clean":"2023-06-02T15:31:25.619438+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:31:25.619438+0000","last_undegraded":"2023-06-02T15:31:25.619438+0000","last_fullsized":"2023-06-02T15:31:25.619438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571856+0000","last_change":"2023-06-02T15:30:38.659430+0000","last_active":"2023-06-02T15:31:25.571856+0000","last_peered":"2023-06-02T15:31:25.571856+0000","last_clean":"2023-06-02T15:31:25.571856+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:31:25.571856+0000","last_undegraded":"2023-06-02T15:31:25.571856+0000","last_fullsized":"2023-06-02T15:31:25.571856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580215+0000","last_change":"2023-06-02T15:30:38.656408+0000","last_active":"2023-06-02T15:31:25.580215+0000","last_peered":"2023-06-02T15:31:25.580215+0000","last_clean":"2023-06-02T15:31:25.580215+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:31:25.580215+0000","last_undegraded":"2023-06-02T15:31:25.580215+0000","last_fullsized":"2023-06-02T15:31:25.580215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580963+0000","last_change":"2023-06-02T15:30:38.658103+0000","last_active":"2023-06-02T15:31:25.580963+0000","last_peered":"2023-06-02T15:31:25.580963+0000","last_clean":"2023-06-02T15:31:25.580963+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:31:25.580963+0000","last_undegraded":"2023-06-02T15:31:25.580963+0000","last_fullsized":"2023-06-02T15:31:25.580963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580377+0000","last_change":"2023-06-02T15:30:38.641657+0000","last_active":"2023-06-02T15:31:25.580377+0000","last_peered":"2023-06-02T15:31:25.580377+0000","last_clean":"2023-06-02T15:31:25.580377+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:31:25.580377+0000","last_undegraded":"2023-06-02T15:31:25.580377+0000","last_fullsized":"2023-06-02T15:31:25.580377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:22.309633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580426+0000","last_change":"2023-06-02T15:30:38.640289+0000","last_active":"2023-06-02T15:31:25.580426+0000","last_peered":"2023-06-02T15:31:25.580426+0000","last_clean":"2023-06-02T15:31:25.580426+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:31:25.580426+0000","last_undegraded":"2023-06-02T15:31:25.580426+0000","last_fullsized":"2023-06-02T15:31:25.580426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626779+0000","last_change":"2023-06-02T15:30:38.656963+0000","last_active":"2023-06-02T15:31:25.626779+0000","last_peered":"2023-06-02T15:31:25.626779+0000","last_clean":"2023-06-02T15:31:25.626779+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:31:25.626779+0000","last_undegraded":"2023-06-02T15:31:25.626779+0000","last_fullsized":"2023-06-02T15:31:25.626779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571080+0000","last_change":"2023-06-02T15:30:38.648546+0000","last_active":"2023-06-02T15:31:25.571080+0000","last_peered":"2023-06-02T15:31:25.571080+0000","last_clean":"2023-06-02T15:31:25.571080+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:31:25.571080+0000","last_undegraded":"2023-06-02T15:31:25.571080+0000","last_fullsized":"2023-06-02T15:31:25.571080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986521+0000","last_change":"2023-06-02T15:30:38.643407+0000","last_active":"2023-06-02T15:31:25.986521+0000","last_peered":"2023-06-02T15:31:25.986521+0000","last_clean":"2023-06-02T15:31:25.986521+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:31:25.986521+0000","last_undegraded":"2023-06-02T15:31:25.986521+0000","last_fullsized":"2023-06-02T15:31:25.986521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627438+0000","last_change":"2023-06-02T15:30:38.657038+0000","last_active":"2023-06-02T15:31:25.627438+0000","last_peered":"2023-06-02T15:31:25.627438+0000","last_clean":"2023-06-02T15:31:25.627438+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:31:25.627438+0000","last_undegraded":"2023-06-02T15:31:25.627438+0000","last_fullsized":"2023-06-02T15:31:25.627438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619678+0000","last_change":"2023-06-02T15:30:38.638594+0000","last_active":"2023-06-02T15:31:25.619678+0000","last_peered":"2023-06-02T15:31:25.619678+0000","last_clean":"2023-06-02T15:31:25.619678+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:31:25.619678+0000","last_undegraded":"2023-06-02T15:31:25.619678+0000","last_fullsized":"2023-06-02T15:31:25.619678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:28.604626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576977+0000","last_change":"2023-06-02T15:30:38.638252+0000","last_active":"2023-06-02T15:31:25.576977+0000","last_peered":"2023-06-02T15:31:25.576977+0000","last_clean":"2023-06-02T15:31:25.576977+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:31:25.576977+0000","last_undegraded":"2023-06-02T15:31:25.576977+0000","last_fullsized":"2023-06-02T15:31:25.576977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:24.550049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619807+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:31:25.619807+0000","last_peered":"2023-06-02T15:31:25.619807+0000","last_clean":"2023-06-02T15:31:25.619807+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:31:25.619807+0000","last_undegraded":"2023-06-02T15:31:25.619807+0000","last_fullsized":"2023-06-02T15:31:25.619807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:14.924133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987375+0000","last_change":"2023-06-02T15:30:38.639262+0000","last_active":"2023-06-02T15:31:25.987375+0000","last_peered":"2023-06-02T15:31:25.987375+0000","last_clean":"2023-06-02T15:31:25.987375+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:31:25.987375+0000","last_undegraded":"2023-06-02T15:31:25.987375+0000","last_fullsized":"2023-06-02T15:31:25.987375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618716+0000","last_change":"2023-06-02T15:30:38.636435+0000","last_active":"2023-06-02T15:31:25.618716+0000","last_peered":"2023-06-02T15:31:25.618716+0000","last_clean":"2023-06-02T15:31:25.618716+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:31:25.618716+0000","last_undegraded":"2023-06-02T15:31:25.618716+0000","last_fullsized":"2023-06-02T15:31:25.618716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:41:54.216725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627147+0000","last_change":"2023-06-02T15:30:38.659341+0000","last_active":"2023-06-02T15:31:25.627147+0000","last_peered":"2023-06-02T15:31:25.627147+0000","last_clean":"2023-06-02T15:31:25.627147+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:31:25.627147+0000","last_undegraded":"2023-06-02T15:31:25.627147+0000","last_fullsized":"2023-06-02T15:31:25.627147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578465+0000","last_change":"2023-06-02T15:30:38.636138+0000","last_active":"2023-06-02T15:31:25.578465+0000","last_peered":"2023-06-02T15:31:25.578465+0000","last_clean":"2023-06-02T15:31:25.578465+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:31:25.578465+0000","last_undegraded":"2023-06-02T15:31:25.578465+0000","last_fullsized":"2023-06-02T15:31:25.578465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576902+0000","last_change":"2023-06-02T15:30:38.645755+0000","last_active":"2023-06-02T15:31:25.576902+0000","last_peered":"2023-06-02T15:31:25.576902+0000","last_clean":"2023-06-02T15:31:25.576902+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:31:25.576902+0000","last_undegraded":"2023-06-02T15:31:25.576902+0000","last_fullsized":"2023-06-02T15:31:25.576902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:40.298901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577266+0000","last_change":"2023-06-02T15:30:38.644641+0000","last_active":"2023-06-02T15:31:25.577266+0000","last_peered":"2023-06-02T15:31:25.577266+0000","last_clean":"2023-06-02T15:31:25.577266+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:31:25.577266+0000","last_undegraded":"2023-06-02T15:31:25.577266+0000","last_fullsized":"2023-06-02T15:31:25.577266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:14.588404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620098+0000","last_change":"2023-06-02T15:30:38.650928+0000","last_active":"2023-06-02T15:31:25.620098+0000","last_peered":"2023-06-02T15:31:25.620098+0000","last_clean":"2023-06-02T15:31:25.620098+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:31:25.620098+0000","last_undegraded":"2023-06-02T15:31:25.620098+0000","last_fullsized":"2023-06-02T15:31:25.620098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581483+0000","last_change":"2023-06-02T15:30:38.640368+0000","last_active":"2023-06-02T15:31:25.581483+0000","last_peered":"2023-06-02T15:31:25.581483+0000","last_clean":"2023-06-02T15:31:25.581483+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:31:25.581483+0000","last_undegraded":"2023-06-02T15:31:25.581483+0000","last_fullsized":"2023-06-02T15:31:25.581483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987146+0000","last_change":"2023-06-02T15:30:38.639440+0000","last_active":"2023-06-02T15:31:25.987146+0000","last_peered":"2023-06-02T15:31:25.987146+0000","last_clean":"2023-06-02T15:31:25.987146+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:31:25.987146+0000","last_undegraded":"2023-06-02T15:31:25.987146+0000","last_fullsized":"2023-06-02T15:31:25.987146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577488+0000","last_change":"2023-06-02T15:30:38.647961+0000","last_active":"2023-06-02T15:31:25.577488+0000","last_peered":"2023-06-02T15:31:25.577488+0000","last_clean":"2023-06-02T15:31:25.577488+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:31:25.577488+0000","last_undegraded":"2023-06-02T15:31:25.577488+0000","last_fullsized":"2023-06-02T15:31:25.577488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627017+0000","last_change":"2023-06-02T15:30:38.659299+0000","last_active":"2023-06-02T15:31:25.627017+0000","last_peered":"2023-06-02T15:31:25.627017+0000","last_clean":"2023-06-02T15:31:25.627017+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:31:25.627017+0000","last_undegraded":"2023-06-02T15:31:25.627017+0000","last_fullsized":"2023-06-02T15:31:25.627017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619150+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:31:25.619150+0000","last_peered":"2023-06-02T15:31:25.619150+0000","last_clean":"2023-06-02T15:31:25.619150+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:31:25.619150+0000","last_undegraded":"2023-06-02T15:31:25.619150+0000","last_fullsized":"2023-06-02T15:31:25.619150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:15:27.850958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987178+0000","last_change":"2023-06-02T15:30:38.639043+0000","last_active":"2023-06-02T15:31:25.987178+0000","last_peered":"2023-06-02T15:31:25.987178+0000","last_clean":"2023-06-02T15:31:25.987178+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:31:25.987178+0000","last_undegraded":"2023-06-02T15:31:25.987178+0000","last_fullsized":"2023-06-02T15:31:25.987178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579235+0000","last_change":"2023-06-02T15:30:38.637413+0000","last_active":"2023-06-02T15:31:25.579235+0000","last_peered":"2023-06-02T15:31:25.579235+0000","last_clean":"2023-06-02T15:31:25.579235+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:31:25.579235+0000","last_undegraded":"2023-06-02T15:31:25.579235+0000","last_fullsized":"2023-06-02T15:31:25.579235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:22.390984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619908+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:31:25.619908+0000","last_peered":"2023-06-02T15:31:25.619908+0000","last_clean":"2023-06-02T15:31:25.619908+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:31:25.619908+0000","last_undegraded":"2023-06-02T15:31:25.619908+0000","last_fullsized":"2023-06-02T15:31:25.619908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:17:55.191725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581242+0000","last_change":"2023-06-02T15:30:38.650591+0000","last_active":"2023-06-02T15:31:25.581242+0000","last_peered":"2023-06-02T15:31:25.581242+0000","last_clean":"2023-06-02T15:31:25.581242+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:31:25.581242+0000","last_undegraded":"2023-06-02T15:31:25.581242+0000","last_fullsized":"2023-06-02T15:31:25.581242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577617+0000","last_change":"2023-06-02T15:30:38.639026+0000","last_active":"2023-06-02T15:31:25.577617+0000","last_peered":"2023-06-02T15:31:25.577617+0000","last_clean":"2023-06-02T15:31:25.577617+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:31:25.577617+0000","last_undegraded":"2023-06-02T15:31:25.577617+0000","last_fullsized":"2023-06-02T15:31:25.577617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:49.394624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5686,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9156,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362684,"statfs":{"total":96636764160,"available":96627388416,"internally_reserved":0,"allocated":389120,"data_stored":719524,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.125}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90700000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8540,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363300,"statfs":{"total":96636764160,"available":96628019200,"internally_reserved":0,"allocated":282624,"data_stored":116541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1439999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":315392,"data_stored":128996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.048}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8604,"kb_used_data":276,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363236,"statfs":{"total":96636764160,"available":96627953664,"internally_reserved":0,"allocated":282624,"data_stored":116981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79700000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.622}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9124,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362716,"statfs":{"total":96636764160,"available":96627421184,"internally_reserved":0,"allocated":356352,"data_stored":714404,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8600,"kb_used_data":272,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363240,"statfs":{"total":96636764160,"available":96627957760,"internally_reserved":0,"allocated":278528,"data_stored":116471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:31:33.020 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-06-02T15:31:33.021 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:31:33.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63b4c75640 1 Processor -- start 2023-06-02T15:31:33.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63b4c75640 1 -- start start 2023-06-02T15:31:33.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63b4c75640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63b014bc60 0x7f63b006a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63b4c75640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63b0071710 0x7f63b006fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63b4c75640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f63b006a940 0x7f63b0151d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63b4c75640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b006ddc0 con 0x7f63b0071710 2023-06-02T15:31:33.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63b4c75640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63b00b6900 con 0x7f63b006a940 2023-06-02T15:31:33.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63b4c75640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00b7910 con 0x7f63b014bc60 2023-06-02T15:31:33.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63add9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63b0071710 0x7f63b006fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63add9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f63b0071710 0x7f63b006fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33408/0 (socket says 172.21.15.78:33408) 2023-06-02T15:31:33.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63add9b640 1 -- 172.21.15.78:0/1931653233 learned_addr learned my addr 172.21.15.78:0/1931653233 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:33.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63aed9d640 1 --2- 172.21.15.78:0/1931653233 >> v2:172.21.15.132:3300/0 conn(0x7f63b006a940 0x7f63b0151d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63ae59c640 1 --2- 172.21.15.78:0/1931653233 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63b014bc60 0x7f63b006a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63add9b640 1 -- 172.21.15.78:0/1931653233 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63b014bc60 msgr2=0x7f63b006a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:33.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63add9b640 1 --2- 172.21.15.78:0/1931653233 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63b014bc60 0x7f63b006a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63add9b640 1 -- 172.21.15.78:0/1931653233 >> v2:172.21.15.132:3300/0 conn(0x7f63b006a940 msgr2=0x7f63b0151d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:33.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63add9b640 1 --2- 172.21.15.78:0/1931653233 >> v2:172.21.15.132:3300/0 conn(0x7f63b006a940 0x7f63b0151d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63add9b640 1 -- 172.21.15.78:0/1931653233 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b006dfa0 con 0x7f63b0071710 2023-06-02T15:31:33.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63add9b640 1 --2- 172.21.15.78:0/1931653233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b0071710 0x7f63b006fe70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f63b006f410 tx=0x7f63a001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b815f0c3f08eaeac server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:33.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63ad59a640 1 -- 172.21.15.78:0/1931653233 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00a5820 con 0x7f63b0071710 2023-06-02T15:31:33.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63ad59a640 1 -- 172.21.15.78:0/1931653233 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a00a5980 con 0x7f63b0071710 2023-06-02T15:31:33.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.166+0000 7f63ad59a640 1 -- 172.21.15.78:0/1931653233 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a00a5d10 con 0x7f63b0071710 2023-06-02T15:31:33.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- 172.21.15.78:0/1931653233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b0071710 msgr2=0x7f63b006fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:33.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 --2- 172.21.15.78:0/1931653233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b0071710 0x7f63b006fe70 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f63b006f410 tx=0x7f63a001c9a0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- 172.21.15.78:0/1931653233 shutdown_connections 2023-06-02T15:31:33.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 --2- 172.21.15.78:0/1931653233 >> v2:172.21.15.132:3300/0 conn(0x7f63b006a940 0x7f63b0151d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 --2- 172.21.15.78:0/1931653233 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b0071710 0x7f63b006fe70 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 --2- 172.21.15.78:0/1931653233 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63b014bc60 0x7f63b006a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- 172.21.15.78:0/1931653233 >> 172.21.15.78:0/1931653233 conn(0x7f63b00698f0 msgr2=0x7f63b0069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:33.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- 172.21.15.78:0/1931653233 shutdown_connections 2023-06-02T15:31:33.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- 172.21.15.78:0/1931653233 wait complete. 2023-06-02T15:31:33.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 Processor -- start 2023-06-02T15:31:33.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- start start 2023-06-02T15:31:33.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63b006a940 0x7f63b00bfda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63b0071710 0x7f63b014b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b014bc60 0x7f63b01416f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0151510 con 0x7f63b014bc60 2023-06-02T15:31:33.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00c02e0 con 0x7f63b006a940 2023-06-02T15:31:33.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b00c07c0 con 0x7f63b0071710 2023-06-02T15:31:33.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63aed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b014bc60 0x7f63b01416f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63aed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b014bc60 0x7f63b01416f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33424/0 (socket says 172.21.15.78:33424) 2023-06-02T15:31:33.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63aed9d640 1 -- 172.21.15.78:0/383076830 learned_addr learned my addr 172.21.15.78:0/383076830 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:33.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63ae59c640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63b006a940 0x7f63b00bfda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63add9b640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63b0071710 0x7f63b014b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63aed9d640 1 -- 172.21.15.78:0/383076830 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63b0071710 msgr2=0x7f63b014b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:33.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63aed9d640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63b0071710 0x7f63b014b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63aed9d640 1 -- 172.21.15.78:0/383076830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63b006a940 msgr2=0x7f63b00bfda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:33.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63aed9d640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63b006a940 0x7f63b00bfda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63aed9d640 1 -- 172.21.15.78:0/383076830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009b30 con 0x7f63b014bc60 2023-06-02T15:31:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63aed9d640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b014bc60 0x7f63b01416f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f63a400d5a0 tx=0x7f63a400da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f639effd640 1 -- 172.21.15.78:0/383076830 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4014620 con 0x7f63b014bc60 2023-06-02T15:31:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f639effd640 1 -- 172.21.15.78:0/383076830 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63a4014780 con 0x7f63b014bc60 2023-06-02T15:31:33.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- 172.21.15.78:0/383076830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b0152a50 con 0x7f63b014bc60 2023-06-02T15:31:33.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f639effd640 1 -- 172.21.15.78:0/383076830 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4014b30 con 0x7f63b014bc60 2023-06-02T15:31:33.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.170+0000 7f63b4c75640 1 -- 172.21.15.78:0/383076830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b0071260 con 0x7f63b014bc60 2023-06-02T15:31:33.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.174+0000 7f63b4c75640 1 -- 172.21.15.78:0/383076830 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b00b7e10 con 0x7f63b014bc60 2023-06-02T15:31:33.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.174+0000 7f639effd640 1 -- 172.21.15.78:0/383076830 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f63a4014c90 con 0x7f63b014bc60 2023-06-02T15:31:33.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.174+0000 7f639effd640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6390065c30 0x7f63900680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.174+0000 7f639effd640 1 -- 172.21.15.78:0/383076830 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f63a4083c70 con 0x7f63b014bc60 2023-06-02T15:31:33.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.174+0000 7f63ae59c640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6390065c30 0x7f63900680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.174+0000 7f63ae59c640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6390065c30 0x7f63900680e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f63a800b9d0 tx=0x7f63a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:33.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.178+0000 7f639effd640 1 -- 172.21.15.78:0/383076830 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f63a40511a0 con 0x7f63b014bc60 2023-06-02T15:31:33.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.314+0000 7f63b4c75640 1 -- 172.21.15.78:0/383076830 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63b0151650 con 0x7f6390065c30 2023-06-02T15:31:33.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.342+0000 7f639effd640 1 -- 172.21.15.78:0/383076830 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+376689 (secure 0 0 0) 0x7f63b0151650 con 0x7f6390065c30 2023-06-02T15:31:33.350 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:33.354 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:31:33.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 -- 172.21.15.78:0/383076830 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6390065c30 msgr2=0x7f63900680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:33.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6390065c30 0x7f63900680e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f63a800b9d0 tx=0x7f63a8008040 comp rx=0 tx=0).stop 2023-06-02T15:31:33.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 -- 172.21.15.78:0/383076830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b014bc60 msgr2=0x7f63b01416f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:33.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b014bc60 0x7f63b01416f0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f63a400d5a0 tx=0x7f63a400da60 comp rx=0 tx=0).stop 2023-06-02T15:31:33.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 -- 172.21.15.78:0/383076830 shutdown_connections 2023-06-02T15:31:33.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6390065c30 0x7f63900680e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63b014bc60 0x7f63b01416f0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f63b0071710 0x7f63b014b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 --2- 172.21.15.78:0/383076830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63b006a940 0x7f63b00bfda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 -- 172.21.15.78:0/383076830 >> 172.21.15.78:0/383076830 conn(0x7f63b00698f0 msgr2=0x7f63b014e800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:33.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 -- 172.21.15.78:0/383076830 shutdown_connections 2023-06-02T15:31:33.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.346+0000 7f63b4c75640 1 -- 172.21.15.78:0/383076830 wait complete. 2023-06-02T15:31:33.372 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2023-06-02T15:31:33.241205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596054,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69792,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":67264,"kb_avail":754904928,"statfs":{"total":773094113280,"available":773022646272,"internally_reserved":0,"allocated":2523136,"data_stored":2182424,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68878336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002865"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578786+0000","last_change":"2023-06-02T15:30:42.711237+0000","last_active":"2023-06-02T15:31:25.578786+0000","last_peered":"2023-06-02T15:31:25.578786+0000","last_clean":"2023-06-02T15:31:25.578786+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:31:25.578786+0000","last_undegraded":"2023-06-02T15:31:25.578786+0000","last_fullsized":"2023-06-02T15:31:25.578786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987457+0000","last_change":"2023-06-02T15:30:38.275721+0000","last_active":"2023-06-02T15:31:25.987457+0000","last_peered":"2023-06-02T15:31:25.987457+0000","last_clean":"2023-06-02T15:31:25.987457+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:31:25.987457+0000","last_undegraded":"2023-06-02T15:31:25.987457+0000","last_fullsized":"2023-06-02T15:31:25.987457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618872+0000","last_change":"2023-06-02T15:30:38.638911+0000","last_active":"2023-06-02T15:31:25.618872+0000","last_peered":"2023-06-02T15:31:25.618872+0000","last_clean":"2023-06-02T15:31:25.618872+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:31:25.618872+0000","last_undegraded":"2023-06-02T15:31:25.618872+0000","last_fullsized":"2023-06-02T15:31:25.618872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618711+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:31:25.618711+0000","last_peered":"2023-06-02T15:31:25.618711+0000","last_clean":"2023-06-02T15:31:25.618711+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:31:25.618711+0000","last_undegraded":"2023-06-02T15:31:25.618711+0000","last_fullsized":"2023-06-02T15:31:25.618711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:23:12.455644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571682+0000","last_change":"2023-06-02T15:30:38.282116+0000","last_active":"2023-06-02T15:31:25.571682+0000","last_peered":"2023-06-02T15:31:25.571682+0000","last_clean":"2023-06-02T15:31:25.571682+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:31:25.571682+0000","last_undegraded":"2023-06-02T15:31:25.571682+0000","last_fullsized":"2023-06-02T15:31:25.571682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571216+0000","last_change":"2023-06-02T15:30:38.638342+0000","last_active":"2023-06-02T15:31:25.571216+0000","last_peered":"2023-06-02T15:31:25.571216+0000","last_clean":"2023-06-02T15:31:25.571216+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:31:25.571216+0000","last_undegraded":"2023-06-02T15:31:25.571216+0000","last_fullsized":"2023-06-02T15:31:25.571216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578935+0000","last_change":"2023-06-02T15:30:42.715416+0000","last_active":"2023-06-02T15:31:25.578935+0000","last_peered":"2023-06-02T15:31:25.578935+0000","last_clean":"2023-06-02T15:31:25.578935+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:31:25.578935+0000","last_undegraded":"2023-06-02T15:31:25.578935+0000","last_fullsized":"2023-06-02T15:31:25.578935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581243+0000","last_change":"2023-06-02T15:30:38.278973+0000","last_active":"2023-06-02T15:31:25.581243+0000","last_peered":"2023-06-02T15:31:25.581243+0000","last_clean":"2023-06-02T15:31:25.581243+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:31:25.581243+0000","last_undegraded":"2023-06-02T15:31:25.581243+0000","last_fullsized":"2023-06-02T15:31:25.581243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619180+0000","last_change":"2023-06-02T15:30:38.644549+0000","last_active":"2023-06-02T15:31:25.619180+0000","last_peered":"2023-06-02T15:31:25.619180+0000","last_clean":"2023-06-02T15:31:25.619180+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:31:25.619180+0000","last_undegraded":"2023-06-02T15:31:25.619180+0000","last_fullsized":"2023-06-02T15:31:25.619180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:26.088195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627207+0000","last_change":"2023-06-02T15:30:42.707090+0000","last_active":"2023-06-02T15:31:25.627207+0000","last_peered":"2023-06-02T15:31:25.627207+0000","last_clean":"2023-06-02T15:31:25.627207+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:31:25.627207+0000","last_undegraded":"2023-06-02T15:31:25.627207+0000","last_fullsized":"2023-06-02T15:31:25.627207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580585+0000","last_change":"2023-06-02T15:30:38.269876+0000","last_active":"2023-06-02T15:31:25.580585+0000","last_peered":"2023-06-02T15:31:25.580585+0000","last_clean":"2023-06-02T15:31:25.580585+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:31:25.580585+0000","last_undegraded":"2023-06-02T15:31:25.580585+0000","last_fullsized":"2023-06-02T15:31:25.580585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619186+0000","last_change":"2023-06-02T15:30:38.639635+0000","last_active":"2023-06-02T15:31:25.619186+0000","last_peered":"2023-06-02T15:31:25.619186+0000","last_clean":"2023-06-02T15:31:25.619186+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:31:25.619186+0000","last_undegraded":"2023-06-02T15:31:25.619186+0000","last_fullsized":"2023-06-02T15:31:25.619186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:56:57.260064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580130+0000","last_change":"2023-06-02T15:30:42.699623+0000","last_active":"2023-06-02T15:31:25.580130+0000","last_peered":"2023-06-02T15:31:25.580130+0000","last_clean":"2023-06-02T15:31:25.580130+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:31:25.580130+0000","last_undegraded":"2023-06-02T15:31:25.580130+0000","last_fullsized":"2023-06-02T15:31:25.580130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:18.327051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987383+0000","last_change":"2023-06-02T15:30:38.263534+0000","last_active":"2023-06-02T15:31:25.987383+0000","last_peered":"2023-06-02T15:31:25.987383+0000","last_clean":"2023-06-02T15:31:25.987383+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:31:25.987383+0000","last_undegraded":"2023-06-02T15:31:25.987383+0000","last_fullsized":"2023-06-02T15:31:25.987383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577341+0000","last_change":"2023-06-02T15:30:38.644102+0000","last_active":"2023-06-02T15:31:25.577341+0000","last_peered":"2023-06-02T15:31:25.577341+0000","last_clean":"2023-06-02T15:31:25.577341+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:31:25.577341+0000","last_undegraded":"2023-06-02T15:31:25.577341+0000","last_fullsized":"2023-06-02T15:31:25.577341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:11.864794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619418+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:31:25.619418+0000","last_peered":"2023-06-02T15:31:25.619418+0000","last_clean":"2023-06-02T15:31:25.619418+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:31:25.619418+0000","last_undegraded":"2023-06-02T15:31:25.619418+0000","last_fullsized":"2023-06-02T15:31:25.619418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:16:13.363523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619377+0000","last_change":"2023-06-02T15:30:38.272143+0000","last_active":"2023-06-02T15:31:25.619377+0000","last_peered":"2023-06-02T15:31:25.619377+0000","last_clean":"2023-06-02T15:31:25.619377+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:31:25.619377+0000","last_undegraded":"2023-06-02T15:31:25.619377+0000","last_fullsized":"2023-06-02T15:31:25.619377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.572235+0000","last_change":"2023-06-02T15:30:38.650795+0000","last_active":"2023-06-02T15:31:25.572235+0000","last_peered":"2023-06-02T15:31:25.572235+0000","last_clean":"2023-06-02T15:31:25.572235+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:31:25.572235+0000","last_undegraded":"2023-06-02T15:31:25.572235+0000","last_fullsized":"2023-06-02T15:31:25.572235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579795+0000","last_change":"2023-06-02T15:30:42.706975+0000","last_active":"2023-06-02T15:31:25.579795+0000","last_peered":"2023-06-02T15:31:25.579795+0000","last_clean":"2023-06-02T15:31:25.579795+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:31:25.579795+0000","last_undegraded":"2023-06-02T15:31:25.579795+0000","last_fullsized":"2023-06-02T15:31:25.579795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:32.007544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579181+0000","last_change":"2023-06-02T15:30:38.290129+0000","last_active":"2023-06-02T15:31:25.579181+0000","last_peered":"2023-06-02T15:31:25.579181+0000","last_clean":"2023-06-02T15:31:25.579181+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:31:25.579181+0000","last_undegraded":"2023-06-02T15:31:25.579181+0000","last_fullsized":"2023-06-02T15:31:25.579181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987383+0000","last_change":"2023-06-02T15:30:38.656679+0000","last_active":"2023-06-02T15:31:25.987383+0000","last_peered":"2023-06-02T15:31:25.987383+0000","last_clean":"2023-06-02T15:31:25.987383+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:31:25.987383+0000","last_undegraded":"2023-06-02T15:31:25.987383+0000","last_fullsized":"2023-06-02T15:31:25.987383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987725+0000","last_change":"2023-06-02T15:30:42.705633+0000","last_active":"2023-06-02T15:31:25.987725+0000","last_peered":"2023-06-02T15:31:25.987725+0000","last_clean":"2023-06-02T15:31:25.987725+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:31:25.987725+0000","last_undegraded":"2023-06-02T15:31:25.987725+0000","last_fullsized":"2023-06-02T15:31:25.987725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571269+0000","last_change":"2023-06-02T15:30:38.273154+0000","last_active":"2023-06-02T15:31:25.571269+0000","last_peered":"2023-06-02T15:31:25.571269+0000","last_clean":"2023-06-02T15:31:25.571269+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:31:25.571269+0000","last_undegraded":"2023-06-02T15:31:25.571269+0000","last_fullsized":"2023-06-02T15:31:25.571269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579891+0000","last_change":"2023-06-02T15:30:38.647445+0000","last_active":"2023-06-02T15:31:25.579891+0000","last_peered":"2023-06-02T15:31:25.579891+0000","last_clean":"2023-06-02T15:31:25.579891+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:31:25.579891+0000","last_undegraded":"2023-06-02T15:31:25.579891+0000","last_fullsized":"2023-06-02T15:31:25.579891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:34.366098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571012+0000","last_change":"2023-06-02T15:30:38.650927+0000","last_active":"2023-06-02T15:31:25.571012+0000","last_peered":"2023-06-02T15:31:25.571012+0000","last_clean":"2023-06-02T15:31:25.571012+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:31:25.571012+0000","last_undegraded":"2023-06-02T15:31:25.571012+0000","last_fullsized":"2023-06-02T15:31:25.571012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987597+0000","last_change":"2023-06-02T15:30:38.274472+0000","last_active":"2023-06-02T15:31:25.987597+0000","last_peered":"2023-06-02T15:31:25.987597+0000","last_clean":"2023-06-02T15:31:25.987597+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:31:25.987597+0000","last_undegraded":"2023-06-02T15:31:25.987597+0000","last_fullsized":"2023-06-02T15:31:25.987597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578080+0000","last_change":"2023-06-02T15:30:42.710065+0000","last_active":"2023-06-02T15:31:25.578080+0000","last_peered":"2023-06-02T15:31:25.578080+0000","last_clean":"2023-06-02T15:31:25.578080+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:31:25.578080+0000","last_undegraded":"2023-06-02T15:31:25.578080+0000","last_fullsized":"2023-06-02T15:31:25.578080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571297+0000","last_change":"2023-06-02T15:30:38.656769+0000","last_active":"2023-06-02T15:31:25.571297+0000","last_peered":"2023-06-02T15:31:25.571297+0000","last_clean":"2023-06-02T15:31:25.571297+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:31:25.571297+0000","last_undegraded":"2023-06-02T15:31:25.571297+0000","last_fullsized":"2023-06-02T15:31:25.571297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581474+0000","last_change":"2023-06-02T15:30:38.275134+0000","last_active":"2023-06-02T15:31:25.581474+0000","last_peered":"2023-06-02T15:31:25.581474+0000","last_clean":"2023-06-02T15:31:25.581474+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:31:25.581474+0000","last_undegraded":"2023-06-02T15:31:25.581474+0000","last_fullsized":"2023-06-02T15:31:25.581474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626635+0000","last_change":"2023-06-02T15:30:42.706722+0000","last_active":"2023-06-02T15:31:25.626635+0000","last_peered":"2023-06-02T15:31:25.626635+0000","last_clean":"2023-06-02T15:31:25.626635+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:31:25.626635+0000","last_undegraded":"2023-06-02T15:31:25.626635+0000","last_fullsized":"2023-06-02T15:31:25.626635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628183+0000","last_change":"2023-06-02T15:30:38.289736+0000","last_active":"2023-06-02T15:31:25.628183+0000","last_peered":"2023-06-02T15:31:25.628183+0000","last_clean":"2023-06-02T15:31:25.628183+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:31:25.628183+0000","last_undegraded":"2023-06-02T15:31:25.628183+0000","last_fullsized":"2023-06-02T15:31:25.628183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:43:04.205096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579296+0000","last_change":"2023-06-02T15:30:38.642841+0000","last_active":"2023-06-02T15:31:25.579296+0000","last_peered":"2023-06-02T15:31:25.579296+0000","last_clean":"2023-06-02T15:31:25.579296+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:31:25.579296+0000","last_undegraded":"2023-06-02T15:31:25.579296+0000","last_fullsized":"2023-06-02T15:31:25.579296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571470+0000","last_change":"2023-06-02T15:30:42.720577+0000","last_active":"2023-06-02T15:31:25.571470+0000","last_peered":"2023-06-02T15:31:25.571470+0000","last_clean":"2023-06-02T15:31:25.571470+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:31:25.571470+0000","last_undegraded":"2023-06-02T15:31:25.571470+0000","last_fullsized":"2023-06-02T15:31:25.571470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:48:54.291389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"26'15","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626342+0000","last_change":"2023-06-02T15:30:38.276703+0000","last_active":"2023-06-02T15:31:25.626342+0000","last_peered":"2023-06-02T15:31:25.626342+0000","last_clean":"2023-06-02T15:31:25.626342+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:31:25.626342+0000","last_undegraded":"2023-06-02T15:31:25.626342+0000","last_fullsized":"2023-06-02T15:31:25.626342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4904,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619291+0000","last_change":"2023-06-02T15:30:38.634436+0000","last_active":"2023-06-02T15:31:25.619291+0000","last_peered":"2023-06-02T15:31:25.619291+0000","last_clean":"2023-06-02T15:31:25.619291+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:31:25.619291+0000","last_undegraded":"2023-06-02T15:31:25.619291+0000","last_fullsized":"2023-06-02T15:31:25.619291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579046+0000","last_change":"2023-06-02T15:30:42.707445+0000","last_active":"2023-06-02T15:31:25.579046+0000","last_peered":"2023-06-02T15:31:25.579046+0000","last_clean":"2023-06-02T15:31:25.579046+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:31:25.579046+0000","last_undegraded":"2023-06-02T15:31:25.579046+0000","last_fullsized":"2023-06-02T15:31:25.579046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579355+0000","last_change":"2023-06-02T15:30:38.649326+0000","last_active":"2023-06-02T15:31:25.579355+0000","last_peered":"2023-06-02T15:31:25.579355+0000","last_clean":"2023-06-02T15:31:25.579355+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:31:25.579355+0000","last_undegraded":"2023-06-02T15:31:25.579355+0000","last_fullsized":"2023-06-02T15:31:25.579355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579942+0000","last_change":"2023-06-02T15:30:33.407154+0000","last_active":"2023-06-02T15:31:25.579942+0000","last_peered":"2023-06-02T15:31:25.579942+0000","last_clean":"2023-06-02T15:31:25.579942+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:31:25.579942+0000","last_undegraded":"2023-06-02T15:31:25.579942+0000","last_fullsized":"2023-06-02T15:31:25.579942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581239+0000","last_change":"2023-06-02T15:30:38.279321+0000","last_active":"2023-06-02T15:31:25.581239+0000","last_peered":"2023-06-02T15:31:25.581239+0000","last_clean":"2023-06-02T15:31:25.581239+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:31:25.581239+0000","last_undegraded":"2023-06-02T15:31:25.581239+0000","last_fullsized":"2023-06-02T15:31:25.581239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986692+0000","last_change":"2023-06-02T15:30:42.715780+0000","last_active":"2023-06-02T15:31:25.986692+0000","last_peered":"2023-06-02T15:31:25.986692+0000","last_clean":"2023-06-02T15:31:25.986692+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:31:25.986692+0000","last_undegraded":"2023-06-02T15:31:25.986692+0000","last_fullsized":"2023-06-02T15:31:25.986692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986987+0000","last_change":"2023-06-02T15:30:38.632171+0000","last_active":"2023-06-02T15:31:25.986987+0000","last_peered":"2023-06-02T15:31:25.986987+0000","last_clean":"2023-06-02T15:31:25.986987+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:31:25.986987+0000","last_undegraded":"2023-06-02T15:31:25.986987+0000","last_fullsized":"2023-06-02T15:31:25.986987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579661+0000","last_change":"2023-06-02T15:30:33.655215+0000","last_active":"2023-06-02T15:31:25.579661+0000","last_peered":"2023-06-02T15:31:25.579661+0000","last_clean":"2023-06-02T15:31:25.579661+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:31:25.579661+0000","last_undegraded":"2023-06-02T15:31:25.579661+0000","last_fullsized":"2023-06-02T15:31:25.579661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580143+0000","last_change":"2023-06-02T15:30:38.277096+0000","last_active":"2023-06-02T15:31:25.580143+0000","last_peered":"2023-06-02T15:31:25.580143+0000","last_clean":"2023-06-02T15:31:25.580143+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:31:25.580143+0000","last_undegraded":"2023-06-02T15:31:25.580143+0000","last_fullsized":"2023-06-02T15:31:25.580143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578632+0000","last_change":"2023-06-02T15:30:42.698823+0000","last_active":"2023-06-02T15:31:25.578632+0000","last_peered":"2023-06-02T15:31:25.578632+0000","last_clean":"2023-06-02T15:31:25.578632+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:31:25.578632+0000","last_undegraded":"2023-06-02T15:31:25.578632+0000","last_fullsized":"2023-06-02T15:31:25.578632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571086+0000","last_change":"2023-06-02T15:30:38.656372+0000","last_active":"2023-06-02T15:31:25.571086+0000","last_peered":"2023-06-02T15:31:25.571086+0000","last_clean":"2023-06-02T15:31:25.571086+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:31:25.571086+0000","last_undegraded":"2023-06-02T15:31:25.571086+0000","last_fullsized":"2023-06-02T15:31:25.571086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620264+0000","last_change":"2023-06-02T15:30:33.959737+0000","last_active":"2023-06-02T15:31:25.620264+0000","last_peered":"2023-06-02T15:31:25.620264+0000","last_clean":"2023-06-02T15:31:25.620264+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:31:25.620264+0000","last_undegraded":"2023-06-02T15:31:25.620264+0000","last_fullsized":"2023-06-02T15:31:25.620264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.573996+0000","last_change":"2023-06-02T15:30:38.281667+0000","last_active":"2023-06-02T15:31:25.573996+0000","last_peered":"2023-06-02T15:31:25.573996+0000","last_clean":"2023-06-02T15:31:25.573996+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:31:25.573996+0000","last_undegraded":"2023-06-02T15:31:25.573996+0000","last_fullsized":"2023-06-02T15:31:25.573996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618579+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:31:25.618579+0000","last_peered":"2023-06-02T15:31:25.618579+0000","last_clean":"2023-06-02T15:31:25.618579+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:31:25.618579+0000","last_undegraded":"2023-06-02T15:31:25.618579+0000","last_fullsized":"2023-06-02T15:31:25.618579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:02:01.714482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619050+0000","last_change":"2023-06-02T15:30:38.646642+0000","last_active":"2023-06-02T15:31:25.619050+0000","last_peered":"2023-06-02T15:31:25.619050+0000","last_clean":"2023-06-02T15:31:25.619050+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:31:25.619050+0000","last_undegraded":"2023-06-02T15:31:25.619050+0000","last_fullsized":"2023-06-02T15:31:25.619050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571588+0000","last_change":"2023-06-02T15:30:33.413542+0000","last_active":"2023-06-02T15:31:25.571588+0000","last_peered":"2023-06-02T15:31:25.571588+0000","last_clean":"2023-06-02T15:31:25.571588+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:31:25.571588+0000","last_undegraded":"2023-06-02T15:31:25.571588+0000","last_fullsized":"2023-06-02T15:31:25.571588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987572+0000","last_change":"2023-06-02T15:30:38.270941+0000","last_active":"2023-06-02T15:31:25.987572+0000","last_peered":"2023-06-02T15:31:25.987572+0000","last_clean":"2023-06-02T15:31:25.987572+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:31:25.987572+0000","last_undegraded":"2023-06-02T15:31:25.987572+0000","last_fullsized":"2023-06-02T15:31:25.987572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.570918+0000","last_change":"2023-06-02T15:30:42.702383+0000","last_active":"2023-06-02T15:31:25.570918+0000","last_peered":"2023-06-02T15:31:25.570918+0000","last_clean":"2023-06-02T15:31:25.570918+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:31:25.570918+0000","last_undegraded":"2023-06-02T15:31:25.570918+0000","last_fullsized":"2023-06-02T15:31:25.570918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:49:31.222291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987397+0000","last_change":"2023-06-02T15:30:38.642398+0000","last_active":"2023-06-02T15:31:25.987397+0000","last_peered":"2023-06-02T15:31:25.987397+0000","last_clean":"2023-06-02T15:31:25.987397+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:31:25.987397+0000","last_undegraded":"2023-06-02T15:31:25.987397+0000","last_fullsized":"2023-06-02T15:31:25.987397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986410+0000","last_change":"2023-06-02T15:30:38.263733+0000","last_active":"2023-06-02T15:31:25.986410+0000","last_peered":"2023-06-02T15:31:25.986410+0000","last_clean":"2023-06-02T15:31:25.986410+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:31:25.986410+0000","last_undegraded":"2023-06-02T15:31:25.986410+0000","last_fullsized":"2023-06-02T15:31:25.986410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626859+0000","last_change":"2023-06-02T15:30:34.413807+0000","last_active":"2023-06-02T15:31:25.626859+0000","last_peered":"2023-06-02T15:31:25.626859+0000","last_clean":"2023-06-02T15:31:25.626859+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:31:25.626859+0000","last_undegraded":"2023-06-02T15:31:25.626859+0000","last_fullsized":"2023-06-02T15:31:25.626859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_clean_scrub_stamp":"2023-06-02T15:30:33.390390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:47:50.762629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579897+0000","last_change":"2023-06-02T15:30:33.411973+0000","last_active":"2023-06-02T15:31:25.579897+0000","last_peered":"2023-06-02T15:31:25.579897+0000","last_clean":"2023-06-02T15:31:25.579897+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:31:25.579897+0000","last_undegraded":"2023-06-02T15:31:25.579897+0000","last_fullsized":"2023-06-02T15:31:25.579897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581043+0000","last_change":"2023-06-02T15:30:42.712421+0000","last_active":"2023-06-02T15:31:25.581043+0000","last_peered":"2023-06-02T15:31:25.581043+0000","last_clean":"2023-06-02T15:31:25.581043+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:31:25.581043+0000","last_undegraded":"2023-06-02T15:31:25.581043+0000","last_fullsized":"2023-06-02T15:31:25.581043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:38:29.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580505+0000","last_change":"2023-06-02T15:30:38.653404+0000","last_active":"2023-06-02T15:31:25.580505+0000","last_peered":"2023-06-02T15:31:25.580505+0000","last_clean":"2023-06-02T15:31:25.580505+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:31:25.580505+0000","last_undegraded":"2023-06-02T15:31:25.580505+0000","last_fullsized":"2023-06-02T15:31:25.580505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578842+0000","last_change":"2023-06-02T15:30:38.269833+0000","last_active":"2023-06-02T15:31:25.578842+0000","last_peered":"2023-06-02T15:31:25.578842+0000","last_clean":"2023-06-02T15:31:25.578842+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:31:25.578842+0000","last_undegraded":"2023-06-02T15:31:25.578842+0000","last_fullsized":"2023-06-02T15:31:25.578842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:06:46.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627221+0000","last_change":"2023-06-02T15:30:33.654728+0000","last_active":"2023-06-02T15:31:25.627221+0000","last_peered":"2023-06-02T15:31:25.627221+0000","last_clean":"2023-06-02T15:31:25.627221+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:31:25.627221+0000","last_undegraded":"2023-06-02T15:31:25.627221+0000","last_fullsized":"2023-06-02T15:31:25.627221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:05:26.791938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577627+0000","last_change":"2023-06-02T15:30:42.705191+0000","last_active":"2023-06-02T15:31:25.577627+0000","last_peered":"2023-06-02T15:31:25.577627+0000","last_clean":"2023-06-02T15:31:25.577627+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:31:25.577627+0000","last_undegraded":"2023-06-02T15:31:25.577627+0000","last_fullsized":"2023-06-02T15:31:25.577627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:22.765485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580072+0000","last_change":"2023-06-02T15:30:38.642359+0000","last_active":"2023-06-02T15:31:25.580072+0000","last_peered":"2023-06-02T15:31:25.580072+0000","last_clean":"2023-06-02T15:31:25.580072+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:31:25.580072+0000","last_undegraded":"2023-06-02T15:31:25.580072+0000","last_fullsized":"2023-06-02T15:31:25.580072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619577+0000","last_change":"2023-06-02T15:30:38.257531+0000","last_active":"2023-06-02T15:31:25.619577+0000","last_peered":"2023-06-02T15:31:25.619577+0000","last_clean":"2023-06-02T15:31:25.619577+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:31:25.619577+0000","last_undegraded":"2023-06-02T15:31:25.619577+0000","last_fullsized":"2023-06-02T15:31:25.619577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577955+0000","last_change":"2023-06-02T15:30:33.655250+0000","last_active":"2023-06-02T15:31:25.577955+0000","last_peered":"2023-06-02T15:31:25.577955+0000","last_clean":"2023-06-02T15:31:25.577955+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:31:25.577955+0000","last_undegraded":"2023-06-02T15:31:25.577955+0000","last_fullsized":"2023-06-02T15:31:25.577955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986943+0000","last_change":"2023-06-02T15:30:42.693557+0000","last_active":"2023-06-02T15:31:25.986943+0000","last_peered":"2023-06-02T15:31:25.986943+0000","last_clean":"2023-06-02T15:31:25.986943+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:31:25.986943+0000","last_undegraded":"2023-06-02T15:31:25.986943+0000","last_fullsized":"2023-06-02T15:31:25.986943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579446+0000","last_change":"2023-06-02T15:30:38.645488+0000","last_active":"2023-06-02T15:31:25.579446+0000","last_peered":"2023-06-02T15:31:25.579446+0000","last_clean":"2023-06-02T15:31:25.579446+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:31:25.579446+0000","last_undegraded":"2023-06-02T15:31:25.579446+0000","last_fullsized":"2023-06-02T15:31:25.579446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571801+0000","last_change":"2023-06-02T15:30:38.283390+0000","last_active":"2023-06-02T15:31:25.571801+0000","last_peered":"2023-06-02T15:31:25.571801+0000","last_clean":"2023-06-02T15:31:25.571801+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:31:25.571801+0000","last_undegraded":"2023-06-02T15:31:25.571801+0000","last_fullsized":"2023-06-02T15:31:25.571801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626919+0000","last_change":"2023-06-02T15:30:33.653937+0000","last_active":"2023-06-02T15:31:25.626919+0000","last_peered":"2023-06-02T15:31:25.626919+0000","last_clean":"2023-06-02T15:31:25.626919+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:31:25.626919+0000","last_undegraded":"2023-06-02T15:31:25.626919+0000","last_fullsized":"2023-06-02T15:31:25.626919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627136+0000","last_change":"2023-06-02T15:30:42.723169+0000","last_active":"2023-06-02T15:31:25.627136+0000","last_peered":"2023-06-02T15:31:25.627136+0000","last_clean":"2023-06-02T15:31:25.627136+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:31:25.627136+0000","last_undegraded":"2023-06-02T15:31:25.627136+0000","last_fullsized":"2023-06-02T15:31:25.627136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.760660+0000","last_change":"2023-06-02T15:31:26.759068+0000","last_active":"2023-06-02T15:31:26.760660+0000","last_peered":"2023-06-02T15:31:26.760660+0000","last_clean":"2023-06-02T15:31:26.760660+0000","last_became_active":"2023-06-02T15:31:26.758308+0000","last_became_peered":"2023-06-02T15:31:26.758308+0000","last_unstale":"2023-06-02T15:31:26.760660+0000","last_undegraded":"2023-06-02T15:31:26.760660+0000","last_fullsized":"2023-06-02T15:31:26.760660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:21.714894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571177+0000","last_change":"2023-06-02T15:30:38.281851+0000","last_active":"2023-06-02T15:31:25.571177+0000","last_peered":"2023-06-02T15:31:25.571177+0000","last_clean":"2023-06-02T15:31:25.571177+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:31:25.571177+0000","last_undegraded":"2023-06-02T15:31:25.571177+0000","last_fullsized":"2023-06-02T15:31:25.571177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619892+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:31:25.619892+0000","last_peered":"2023-06-02T15:31:25.619892+0000","last_clean":"2023-06-02T15:31:25.619892+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:31:25.619892+0000","last_undegraded":"2023-06-02T15:31:25.619892+0000","last_fullsized":"2023-06-02T15:31:25.619892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:44.594461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620069+0000","last_change":"2023-06-02T15:30:38.638725+0000","last_active":"2023-06-02T15:31:25.620069+0000","last_peered":"2023-06-02T15:31:25.620069+0000","last_clean":"2023-06-02T15:31:25.620069+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:31:25.620069+0000","last_undegraded":"2023-06-02T15:31:25.620069+0000","last_fullsized":"2023-06-02T15:31:25.620069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619044+0000","last_change":"2023-06-02T15:30:38.269278+0000","last_active":"2023-06-02T15:31:25.619044+0000","last_peered":"2023-06-02T15:31:25.619044+0000","last_clean":"2023-06-02T15:31:25.619044+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:31:25.619044+0000","last_undegraded":"2023-06-02T15:31:25.619044+0000","last_fullsized":"2023-06-02T15:31:25.619044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581072+0000","last_change":"2023-06-02T15:30:42.713071+0000","last_active":"2023-06-02T15:31:25.581072+0000","last_peered":"2023-06-02T15:31:25.581072+0000","last_clean":"2023-06-02T15:31:25.581072+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:31:25.581072+0000","last_undegraded":"2023-06-02T15:31:25.581072+0000","last_fullsized":"2023-06-02T15:31:25.581072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620056+0000","last_change":"2023-06-02T15:30:38.636565+0000","last_active":"2023-06-02T15:31:25.620056+0000","last_peered":"2023-06-02T15:31:25.620056+0000","last_clean":"2023-06-02T15:31:25.620056+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:31:25.620056+0000","last_undegraded":"2023-06-02T15:31:25.620056+0000","last_fullsized":"2023-06-02T15:31:25.620056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:56:18.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578976+0000","last_change":"2023-06-02T15:30:38.277404+0000","last_active":"2023-06-02T15:31:25.578976+0000","last_peered":"2023-06-02T15:31:25.578976+0000","last_clean":"2023-06-02T15:31:25.578976+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:31:25.578976+0000","last_undegraded":"2023-06-02T15:31:25.578976+0000","last_fullsized":"2023-06-02T15:31:25.578976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579937+0000","last_change":"2023-06-02T15:30:42.697724+0000","last_active":"2023-06-02T15:31:25.579937+0000","last_peered":"2023-06-02T15:31:25.579937+0000","last_clean":"2023-06-02T15:31:25.579937+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:31:25.579937+0000","last_undegraded":"2023-06-02T15:31:25.579937+0000","last_fullsized":"2023-06-02T15:31:25.579937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619605+0000","last_change":"2023-06-02T15:30:38.640532+0000","last_active":"2023-06-02T15:31:25.619605+0000","last_peered":"2023-06-02T15:31:25.619605+0000","last_clean":"2023-06-02T15:31:25.619605+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:31:25.619605+0000","last_undegraded":"2023-06-02T15:31:25.619605+0000","last_fullsized":"2023-06-02T15:31:25.619605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.572026+0000","last_change":"2023-06-02T15:30:38.281909+0000","last_active":"2023-06-02T15:31:25.572026+0000","last_peered":"2023-06-02T15:31:25.572026+0000","last_clean":"2023-06-02T15:31:25.572026+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:31:25.572026+0000","last_undegraded":"2023-06-02T15:31:25.572026+0000","last_fullsized":"2023-06-02T15:31:25.572026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576942+0000","last_change":"2023-06-02T15:30:42.716337+0000","last_active":"2023-06-02T15:31:25.576942+0000","last_peered":"2023-06-02T15:31:25.576942+0000","last_clean":"2023-06-02T15:31:25.576942+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:31:25.576942+0000","last_undegraded":"2023-06-02T15:31:25.576942+0000","last_fullsized":"2023-06-02T15:31:25.576942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986836+0000","last_change":"2023-06-02T15:30:38.651270+0000","last_active":"2023-06-02T15:31:25.986836+0000","last_peered":"2023-06-02T15:31:25.986836+0000","last_clean":"2023-06-02T15:31:25.986836+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:31:25.986836+0000","last_undegraded":"2023-06-02T15:31:25.986836+0000","last_fullsized":"2023-06-02T15:31:25.986836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580356+0000","last_change":"2023-06-02T15:30:38.277304+0000","last_active":"2023-06-02T15:31:25.580356+0000","last_peered":"2023-06-02T15:31:25.580356+0000","last_clean":"2023-06-02T15:31:25.580356+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:31:25.580356+0000","last_undegraded":"2023-06-02T15:31:25.580356+0000","last_fullsized":"2023-06-02T15:31:25.580356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576791+0000","last_change":"2023-06-02T15:30:42.692861+0000","last_active":"2023-06-02T15:31:25.576791+0000","last_peered":"2023-06-02T15:31:25.576791+0000","last_clean":"2023-06-02T15:31:25.576791+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:31:25.576791+0000","last_undegraded":"2023-06-02T15:31:25.576791+0000","last_fullsized":"2023-06-02T15:31:25.576791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:29.857375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578802+0000","last_change":"2023-06-02T15:30:38.645534+0000","last_active":"2023-06-02T15:31:25.578802+0000","last_peered":"2023-06-02T15:31:25.578802+0000","last_clean":"2023-06-02T15:31:25.578802+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:31:25.578802+0000","last_undegraded":"2023-06-02T15:31:25.578802+0000","last_fullsized":"2023-06-02T15:31:25.578802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628270+0000","last_change":"2023-06-02T15:30:38.282239+0000","last_active":"2023-06-02T15:31:25.628270+0000","last_peered":"2023-06-02T15:31:25.628270+0000","last_clean":"2023-06-02T15:31:25.628270+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:31:25.628270+0000","last_undegraded":"2023-06-02T15:31:25.628270+0000","last_fullsized":"2023-06-02T15:31:25.628270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:40.807809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576809+0000","last_change":"2023-06-02T15:30:42.720849+0000","last_active":"2023-06-02T15:31:25.576809+0000","last_peered":"2023-06-02T15:31:25.576809+0000","last_clean":"2023-06-02T15:31:25.576809+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:31:25.576809+0000","last_undegraded":"2023-06-02T15:31:25.576809+0000","last_fullsized":"2023-06-02T15:31:25.576809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618839+0000","last_change":"2023-06-02T15:30:38.641746+0000","last_active":"2023-06-02T15:31:25.618839+0000","last_peered":"2023-06-02T15:31:25.618839+0000","last_clean":"2023-06-02T15:31:25.618839+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:31:25.618839+0000","last_undegraded":"2023-06-02T15:31:25.618839+0000","last_fullsized":"2023-06-02T15:31:25.618839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628173+0000","last_change":"2023-06-02T15:30:38.282724+0000","last_active":"2023-06-02T15:31:25.628173+0000","last_peered":"2023-06-02T15:31:25.628173+0000","last_clean":"2023-06-02T15:31:25.628173+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:31:25.628173+0000","last_undegraded":"2023-06-02T15:31:25.628173+0000","last_fullsized":"2023-06-02T15:31:25.628173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:21.387209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576497+0000","last_change":"2023-06-02T15:30:42.697662+0000","last_active":"2023-06-02T15:31:25.576497+0000","last_peered":"2023-06-02T15:31:25.576497+0000","last_clean":"2023-06-02T15:31:25.576497+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:31:25.576497+0000","last_undegraded":"2023-06-02T15:31:25.576497+0000","last_fullsized":"2023-06-02T15:31:25.576497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:19.014996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577702+0000","last_change":"2023-06-02T15:30:38.656950+0000","last_active":"2023-06-02T15:31:25.577702+0000","last_peered":"2023-06-02T15:31:25.577702+0000","last_clean":"2023-06-02T15:31:25.577702+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:31:25.577702+0000","last_undegraded":"2023-06-02T15:31:25.577702+0000","last_fullsized":"2023-06-02T15:31:25.577702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628287+0000","last_change":"2023-06-02T15:30:38.283602+0000","last_active":"2023-06-02T15:31:25.628287+0000","last_peered":"2023-06-02T15:31:25.628287+0000","last_clean":"2023-06-02T15:31:25.628287+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:31:25.628287+0000","last_undegraded":"2023-06-02T15:31:25.628287+0000","last_fullsized":"2023-06-02T15:31:25.628287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:33.362323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627029+0000","last_change":"2023-06-02T15:30:42.722884+0000","last_active":"2023-06-02T15:31:25.627029+0000","last_peered":"2023-06-02T15:31:25.627029+0000","last_clean":"2023-06-02T15:31:25.627029+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:31:25.627029+0000","last_undegraded":"2023-06-02T15:31:25.627029+0000","last_fullsized":"2023-06-02T15:31:25.627029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580952+0000","last_change":"2023-06-02T15:30:42.714188+0000","last_active":"2023-06-02T15:31:25.580952+0000","last_peered":"2023-06-02T15:31:25.580952+0000","last_clean":"2023-06-02T15:31:25.580952+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:31:25.580952+0000","last_undegraded":"2023-06-02T15:31:25.580952+0000","last_fullsized":"2023-06-02T15:31:25.580952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578228+0000","last_change":"2023-06-02T15:30:38.261610+0000","last_active":"2023-06-02T15:31:25.578228+0000","last_peered":"2023-06-02T15:31:25.578228+0000","last_clean":"2023-06-02T15:31:25.578228+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:31:25.578228+0000","last_undegraded":"2023-06-02T15:31:25.578228+0000","last_fullsized":"2023-06-02T15:31:25.578228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.574205+0000","last_change":"2023-06-02T15:30:38.658984+0000","last_active":"2023-06-02T15:31:25.574205+0000","last_peered":"2023-06-02T15:31:25.574205+0000","last_clean":"2023-06-02T15:31:25.574205+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:31:25.574205+0000","last_undegraded":"2023-06-02T15:31:25.574205+0000","last_fullsized":"2023-06-02T15:31:25.574205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571841+0000","last_change":"2023-06-02T15:30:42.705561+0000","last_active":"2023-06-02T15:31:25.571841+0000","last_peered":"2023-06-02T15:31:25.571841+0000","last_clean":"2023-06-02T15:31:25.571841+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:31:25.571841+0000","last_undegraded":"2023-06-02T15:31:25.571841+0000","last_fullsized":"2023-06-02T15:31:25.571841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:39:14.247511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627280+0000","last_change":"2023-06-02T15:30:38.283796+0000","last_active":"2023-06-02T15:31:25.627280+0000","last_peered":"2023-06-02T15:31:25.627280+0000","last_clean":"2023-06-02T15:31:25.627280+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:31:25.627280+0000","last_undegraded":"2023-06-02T15:31:25.627280+0000","last_fullsized":"2023-06-02T15:31:25.627280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987622+0000","last_change":"2023-06-02T15:30:38.644966+0000","last_active":"2023-06-02T15:31:25.987622+0000","last_peered":"2023-06-02T15:31:25.987622+0000","last_clean":"2023-06-02T15:31:25.987622+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:31:25.987622+0000","last_undegraded":"2023-06-02T15:31:25.987622+0000","last_fullsized":"2023-06-02T15:31:25.987622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986672+0000","last_change":"2023-06-02T15:30:38.265398+0000","last_active":"2023-06-02T15:31:25.986672+0000","last_peered":"2023-06-02T15:31:25.986672+0000","last_clean":"2023-06-02T15:31:25.986672+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:31:25.986672+0000","last_undegraded":"2023-06-02T15:31:25.986672+0000","last_fullsized":"2023-06-02T15:31:25.986672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:10:29.479149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580971+0000","last_change":"2023-06-02T15:30:38.657999+0000","last_active":"2023-06-02T15:31:25.580971+0000","last_peered":"2023-06-02T15:31:25.580971+0000","last_clean":"2023-06-02T15:31:25.580971+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:31:25.580971+0000","last_undegraded":"2023-06-02T15:31:25.580971+0000","last_fullsized":"2023-06-02T15:31:25.580971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571454+0000","last_change":"2023-06-02T15:30:42.705725+0000","last_active":"2023-06-02T15:31:25.571454+0000","last_peered":"2023-06-02T15:31:25.571454+0000","last_clean":"2023-06-02T15:31:25.571454+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:31:25.571454+0000","last_undegraded":"2023-06-02T15:31:25.571454+0000","last_fullsized":"2023-06-02T15:31:25.571454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627568+0000","last_change":"2023-06-02T15:30:38.282095+0000","last_active":"2023-06-02T15:31:25.627568+0000","last_peered":"2023-06-02T15:31:25.627568+0000","last_clean":"2023-06-02T15:31:25.627568+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:31:25.627568+0000","last_undegraded":"2023-06-02T15:31:25.627568+0000","last_fullsized":"2023-06-02T15:31:25.627568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.926559+0000","last_change":"2023-06-02T15:31:26.924308+0000","last_active":"2023-06-02T15:31:26.926559+0000","last_peered":"2023-06-02T15:31:26.926559+0000","last_clean":"2023-06-02T15:31:26.926559+0000","last_became_active":"2023-06-02T15:31:26.923733+0000","last_became_peered":"2023-06-02T15:31:26.923733+0000","last_unstale":"2023-06-02T15:31:26.926559+0000","last_undegraded":"2023-06-02T15:31:26.926559+0000","last_fullsized":"2023-06-02T15:31:26.926559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:00:54.244135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580545+0000","last_change":"2023-06-02T15:30:42.702456+0000","last_active":"2023-06-02T15:31:25.580545+0000","last_peered":"2023-06-02T15:31:25.580545+0000","last_clean":"2023-06-02T15:31:25.580545+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:31:25.580545+0000","last_undegraded":"2023-06-02T15:31:25.580545+0000","last_fullsized":"2023-06-02T15:31:25.580545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577812+0000","last_change":"2023-06-02T15:30:38.637380+0000","last_active":"2023-06-02T15:31:25.577812+0000","last_peered":"2023-06-02T15:31:25.577812+0000","last_clean":"2023-06-02T15:31:25.577812+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:31:25.577812+0000","last_undegraded":"2023-06-02T15:31:25.577812+0000","last_fullsized":"2023-06-02T15:31:25.577812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571178+0000","last_change":"2023-06-02T15:30:38.655074+0000","last_active":"2023-06-02T15:31:25.571178+0000","last_peered":"2023-06-02T15:31:25.571178+0000","last_clean":"2023-06-02T15:31:25.571178+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:31:25.571178+0000","last_undegraded":"2023-06-02T15:31:25.571178+0000","last_fullsized":"2023-06-02T15:31:25.571178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619438+0000","last_change":"2023-06-02T15:30:38.637979+0000","last_active":"2023-06-02T15:31:25.619438+0000","last_peered":"2023-06-02T15:31:25.619438+0000","last_clean":"2023-06-02T15:31:25.619438+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:31:25.619438+0000","last_undegraded":"2023-06-02T15:31:25.619438+0000","last_fullsized":"2023-06-02T15:31:25.619438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571856+0000","last_change":"2023-06-02T15:30:38.659430+0000","last_active":"2023-06-02T15:31:25.571856+0000","last_peered":"2023-06-02T15:31:25.571856+0000","last_clean":"2023-06-02T15:31:25.571856+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:31:25.571856+0000","last_undegraded":"2023-06-02T15:31:25.571856+0000","last_fullsized":"2023-06-02T15:31:25.571856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580215+0000","last_change":"2023-06-02T15:30:38.656408+0000","last_active":"2023-06-02T15:31:25.580215+0000","last_peered":"2023-06-02T15:31:25.580215+0000","last_clean":"2023-06-02T15:31:25.580215+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:31:25.580215+0000","last_undegraded":"2023-06-02T15:31:25.580215+0000","last_fullsized":"2023-06-02T15:31:25.580215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580963+0000","last_change":"2023-06-02T15:30:38.658103+0000","last_active":"2023-06-02T15:31:25.580963+0000","last_peered":"2023-06-02T15:31:25.580963+0000","last_clean":"2023-06-02T15:31:25.580963+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:31:25.580963+0000","last_undegraded":"2023-06-02T15:31:25.580963+0000","last_fullsized":"2023-06-02T15:31:25.580963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580377+0000","last_change":"2023-06-02T15:30:38.641657+0000","last_active":"2023-06-02T15:31:25.580377+0000","last_peered":"2023-06-02T15:31:25.580377+0000","last_clean":"2023-06-02T15:31:25.580377+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:31:25.580377+0000","last_undegraded":"2023-06-02T15:31:25.580377+0000","last_fullsized":"2023-06-02T15:31:25.580377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:22.309633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580426+0000","last_change":"2023-06-02T15:30:38.640289+0000","last_active":"2023-06-02T15:31:25.580426+0000","last_peered":"2023-06-02T15:31:25.580426+0000","last_clean":"2023-06-02T15:31:25.580426+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:31:25.580426+0000","last_undegraded":"2023-06-02T15:31:25.580426+0000","last_fullsized":"2023-06-02T15:31:25.580426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626779+0000","last_change":"2023-06-02T15:30:38.656963+0000","last_active":"2023-06-02T15:31:25.626779+0000","last_peered":"2023-06-02T15:31:25.626779+0000","last_clean":"2023-06-02T15:31:25.626779+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:31:25.626779+0000","last_undegraded":"2023-06-02T15:31:25.626779+0000","last_fullsized":"2023-06-02T15:31:25.626779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571080+0000","last_change":"2023-06-02T15:30:38.648546+0000","last_active":"2023-06-02T15:31:25.571080+0000","last_peered":"2023-06-02T15:31:25.571080+0000","last_clean":"2023-06-02T15:31:25.571080+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:31:25.571080+0000","last_undegraded":"2023-06-02T15:31:25.571080+0000","last_fullsized":"2023-06-02T15:31:25.571080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986521+0000","last_change":"2023-06-02T15:30:38.643407+0000","last_active":"2023-06-02T15:31:25.986521+0000","last_peered":"2023-06-02T15:31:25.986521+0000","last_clean":"2023-06-02T15:31:25.986521+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:31:25.986521+0000","last_undegraded":"2023-06-02T15:31:25.986521+0000","last_fullsized":"2023-06-02T15:31:25.986521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627438+0000","last_change":"2023-06-02T15:30:38.657038+0000","last_active":"2023-06-02T15:31:25.627438+0000","last_peered":"2023-06-02T15:31:25.627438+0000","last_clean":"2023-06-02T15:31:25.627438+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:31:25.627438+0000","last_undegraded":"2023-06-02T15:31:25.627438+0000","last_fullsized":"2023-06-02T15:31:25.627438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619678+0000","last_change":"2023-06-02T15:30:38.638594+0000","last_active":"2023-06-02T15:31:25.619678+0000","last_peered":"2023-06-02T15:31:25.619678+0000","last_clean":"2023-06-02T15:31:25.619678+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:31:25.619678+0000","last_undegraded":"2023-06-02T15:31:25.619678+0000","last_fullsized":"2023-06-02T15:31:25.619678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:28.604626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576977+0000","last_change":"2023-06-02T15:30:38.638252+0000","last_active":"2023-06-02T15:31:25.576977+0000","last_peered":"2023-06-02T15:31:25.576977+0000","last_clean":"2023-06-02T15:31:25.576977+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:31:25.576977+0000","last_undegraded":"2023-06-02T15:31:25.576977+0000","last_fullsized":"2023-06-02T15:31:25.576977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:24.550049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619807+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:31:25.619807+0000","last_peered":"2023-06-02T15:31:25.619807+0000","last_clean":"2023-06-02T15:31:25.619807+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:31:25.619807+0000","last_undegraded":"2023-06-02T15:31:25.619807+0000","last_fullsized":"2023-06-02T15:31:25.619807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:14.924133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987375+0000","last_change":"2023-06-02T15:30:38.639262+0000","last_active":"2023-06-02T15:31:25.987375+0000","last_peered":"2023-06-02T15:31:25.987375+0000","last_clean":"2023-06-02T15:31:25.987375+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:31:25.987375+0000","last_undegraded":"2023-06-02T15:31:25.987375+0000","last_fullsized":"2023-06-02T15:31:25.987375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618716+0000","last_change":"2023-06-02T15:30:38.636435+0000","last_active":"2023-06-02T15:31:25.618716+0000","last_peered":"2023-06-02T15:31:25.618716+0000","last_clean":"2023-06-02T15:31:25.618716+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:31:25.618716+0000","last_undegraded":"2023-06-02T15:31:25.618716+0000","last_fullsized":"2023-06-02T15:31:25.618716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:41:54.216725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627147+0000","last_change":"2023-06-02T15:30:38.659341+0000","last_active":"2023-06-02T15:31:25.627147+0000","last_peered":"2023-06-02T15:31:25.627147+0000","last_clean":"2023-06-02T15:31:25.627147+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:31:25.627147+0000","last_undegraded":"2023-06-02T15:31:25.627147+0000","last_fullsized":"2023-06-02T15:31:25.627147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578465+0000","last_change":"2023-06-02T15:30:38.636138+0000","last_active":"2023-06-02T15:31:25.578465+0000","last_peered":"2023-06-02T15:31:25.578465+0000","last_clean":"2023-06-02T15:31:25.578465+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:31:25.578465+0000","last_undegraded":"2023-06-02T15:31:25.578465+0000","last_fullsized":"2023-06-02T15:31:25.578465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576902+0000","last_change":"2023-06-02T15:30:38.645755+0000","last_active":"2023-06-02T15:31:25.576902+0000","last_peered":"2023-06-02T15:31:25.576902+0000","last_clean":"2023-06-02T15:31:25.576902+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:31:25.576902+0000","last_undegraded":"2023-06-02T15:31:25.576902+0000","last_fullsized":"2023-06-02T15:31:25.576902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:40.298901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577266+0000","last_change":"2023-06-02T15:30:38.644641+0000","last_active":"2023-06-02T15:31:25.577266+0000","last_peered":"2023-06-02T15:31:25.577266+0000","last_clean":"2023-06-02T15:31:25.577266+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:31:25.577266+0000","last_undegraded":"2023-06-02T15:31:25.577266+0000","last_fullsized":"2023-06-02T15:31:25.577266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:14.588404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620098+0000","last_change":"2023-06-02T15:30:38.650928+0000","last_active":"2023-06-02T15:31:25.620098+0000","last_peered":"2023-06-02T15:31:25.620098+0000","last_clean":"2023-06-02T15:31:25.620098+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:31:25.620098+0000","last_undegraded":"2023-06-02T15:31:25.620098+0000","last_fullsized":"2023-06-02T15:31:25.620098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581483+0000","last_change":"2023-06-02T15:30:38.640368+0000","last_active":"2023-06-02T15:31:25.581483+0000","last_peered":"2023-06-02T15:31:25.581483+0000","last_clean":"2023-06-02T15:31:25.581483+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:31:25.581483+0000","last_undegraded":"2023-06-02T15:31:25.581483+0000","last_fullsized":"2023-06-02T15:31:25.581483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987146+0000","last_change":"2023-06-02T15:30:38.639440+0000","last_active":"2023-06-02T15:31:25.987146+0000","last_peered":"2023-06-02T15:31:25.987146+0000","last_clean":"2023-06-02T15:31:25.987146+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:31:25.987146+0000","last_undegraded":"2023-06-02T15:31:25.987146+0000","last_fullsized":"2023-06-02T15:31:25.987146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577488+0000","last_change":"2023-06-02T15:30:38.647961+0000","last_active":"2023-06-02T15:31:25.577488+0000","last_peered":"2023-06-02T15:31:25.577488+0000","last_clean":"2023-06-02T15:31:25.577488+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:31:25.577488+0000","last_undegraded":"2023-06-02T15:31:25.577488+0000","last_fullsized":"2023-06-02T15:31:25.577488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627017+0000","last_change":"2023-06-02T15:30:38.659299+0000","last_active":"2023-06-02T15:31:25.627017+0000","last_peered":"2023-06-02T15:31:25.627017+0000","last_clean":"2023-06-02T15:31:25.627017+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:31:25.627017+0000","last_undegraded":"2023-06-02T15:31:25.627017+0000","last_fullsized":"2023-06-02T15:31:25.627017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619150+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:31:25.619150+0000","last_peered":"2023-06-02T15:31:25.619150+0000","last_clean":"2023-06-02T15:31:25.619150+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:31:25.619150+0000","last_undegraded":"2023-06-02T15:31:25.619150+0000","last_fullsized":"2023-06-02T15:31:25.619150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:15:27.850958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987178+0000","last_change":"2023-06-02T15:30:38.639043+0000","last_active":"2023-06-02T15:31:25.987178+0000","last_peered":"2023-06-02T15:31:25.987178+0000","last_clean":"2023-06-02T15:31:25.987178+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:31:25.987178+0000","last_undegraded":"2023-06-02T15:31:25.987178+0000","last_fullsized":"2023-06-02T15:31:25.987178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579235+0000","last_change":"2023-06-02T15:30:38.637413+0000","last_active":"2023-06-02T15:31:25.579235+0000","last_peered":"2023-06-02T15:31:25.579235+0000","last_clean":"2023-06-02T15:31:25.579235+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:31:25.579235+0000","last_undegraded":"2023-06-02T15:31:25.579235+0000","last_fullsized":"2023-06-02T15:31:25.579235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:22.390984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619908+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:31:25.619908+0000","last_peered":"2023-06-02T15:31:25.619908+0000","last_clean":"2023-06-02T15:31:25.619908+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:31:25.619908+0000","last_undegraded":"2023-06-02T15:31:25.619908+0000","last_fullsized":"2023-06-02T15:31:25.619908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:17:55.191725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581242+0000","last_change":"2023-06-02T15:30:38.650591+0000","last_active":"2023-06-02T15:31:25.581242+0000","last_peered":"2023-06-02T15:31:25.581242+0000","last_clean":"2023-06-02T15:31:25.581242+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:31:25.581242+0000","last_undegraded":"2023-06-02T15:31:25.581242+0000","last_fullsized":"2023-06-02T15:31:25.581242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577617+0000","last_change":"2023-06-02T15:30:38.639026+0000","last_active":"2023-06-02T15:31:25.577617+0000","last_peered":"2023-06-02T15:31:25.577617+0000","last_clean":"2023-06-02T15:31:25.577617+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:31:25.577617+0000","last_undegraded":"2023-06-02T15:31:25.577617+0000","last_fullsized":"2023-06-02T15:31:25.577617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:49.394624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5686,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9156,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362684,"statfs":{"total":96636764160,"available":96627388416,"internally_reserved":0,"allocated":389120,"data_stored":719524,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8552,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363288,"statfs":{"total":96636764160,"available":96628006912,"internally_reserved":0,"allocated":294912,"data_stored":123686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.92400000000000004}]},{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.96699999999999997}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.03}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.236},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1719999999999999}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.0880000000000001}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.119},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.141}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":315392,"data_stored":128996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82999999999999996}]},{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.113}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.91800000000000004}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.089},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.1379999999999999}]},{"osd":5,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.2130000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":294912,"data_stored":124126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9124,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362716,"statfs":{"total":96636764160,"available":96627421184,"internally_reserved":0,"allocated":356352,"data_stored":714404,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8612,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363228,"statfs":{"total":96636764160,"available":96627945472,"internally_reserved":0,"allocated":290816,"data_stored":123616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.85399999999999998}]},{"osd":5,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.101}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.048},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.177}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.228},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.0660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:31:33.380 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:31:33.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7123789640 1 Processor -- start 2023-06-02T15:31:33.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7123789640 1 -- start start 2023-06-02T15:31:33.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7123789640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f711c14f330 0x7f711c14bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7123789640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f711c0a0020 0x7f711c1487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7123789640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f711c14ba90 con 0x7f711c0bc1c0 2023-06-02T15:31:33.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7123789640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711c0a47b0 con 0x7f711c14f330 2023-06-02T15:31:33.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7123789640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c14f7c0 con 0x7f711c0a0020 2023-06-02T15:31:33.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7120d24640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f711c14f330 0x7f711c14bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7120d24640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f711c14f330 0x7f711c14bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33428/0 (socket says 172.21.15.78:33428) 2023-06-02T15:31:33.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7120d24640 1 -- 172.21.15.78:0/3338397287 learned_addr learned my addr 172.21.15.78:0/3338397287 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:33.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7121d26640 1 --2- 172.21.15.78:0/3338397287 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f711c0a0020 0x7f711c1487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7120d24640 1 -- 172.21.15.78:0/3338397287 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f711c0a0020 msgr2=0x7f711c1487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:33.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7120d24640 1 --2- 172.21.15.78:0/3338397287 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f711c0a0020 0x7f711c1487d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7120d24640 1 -- 172.21.15.78:0/3338397287 >> v1:172.21.15.132:6789/0 conn(0x7f711c0bc1c0 legacy=0x7f711c0a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:33.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.522+0000 7f7120d24640 1 -- 172.21.15.78:0/3338397287 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f711c14b440 con 0x7f711c14f330 2023-06-02T15:31:33.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7120d24640 1 --2- 172.21.15.78:0/3338397287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c14f330 0x7f711c14bf20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7110009870 tx=0x7f711001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952be75d96181e15 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:33.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f711bfff640 1 -- 172.21.15.78:0/3338397287 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100ab600 con 0x7f711c14f330 2023-06-02T15:31:33.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f711bfff640 1 -- 172.21.15.78:0/3338397287 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71100a7050 con 0x7f711c14f330 2023-06-02T15:31:33.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f711bfff640 1 -- 172.21.15.78:0/3338397287 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100ab980 con 0x7f711c14f330 2023-06-02T15:31:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 -- 172.21.15.78:0/3338397287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c14f330 msgr2=0x7f711c14bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 --2- 172.21.15.78:0/3338397287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c14f330 0x7f711c14bf20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7110009870 tx=0x7f711001c470 comp rx=0 tx=0).stop 2023-06-02T15:31:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 -- 172.21.15.78:0/3338397287 shutdown_connections 2023-06-02T15:31:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 --2- 172.21.15.78:0/3338397287 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f711c0a0020 0x7f711c1487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 --2- 172.21.15.78:0/3338397287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c14f330 0x7f711c14bf20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 -- 172.21.15.78:0/3338397287 >> 172.21.15.78:0/3338397287 conn(0x7f711c0bcf50 msgr2=0x7f711c0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:33.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 -- 172.21.15.78:0/3338397287 shutdown_connections 2023-06-02T15:31:33.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 -- 172.21.15.78:0/3338397287 wait complete. 2023-06-02T15:31:33.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 Processor -- start 2023-06-02T15:31:33.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 -- start start 2023-06-02T15:31:33.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.526+0000 7f7123789640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f711c0a0020 0x7f711c1e82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7123789640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c0bc1c0 0x7f711c0bebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7123789640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f711c14f330 0x7f711c141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7123789640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c06edf0 con 0x7f711c0bc1c0 2023-06-02T15:31:33.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7123789640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711c06f140 con 0x7f711c0a0020 2023-06-02T15:31:33.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7123789640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711c14ab50 con 0x7f711c14f330 2023-06-02T15:31:33.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7120d24640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c0bc1c0 0x7f711c0bebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7120d24640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c0bc1c0 0x7f711c0bebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33438/0 (socket says 172.21.15.78:33438) 2023-06-02T15:31:33.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7120d24640 1 -- 172.21.15.78:0/2121202886 learned_addr learned my addr 172.21.15.78:0/2121202886 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:33.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7121d26640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f711c14f330 0x7f711c141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7121525640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f711c0a0020 0x7f711c1e82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7120d24640 1 -- 172.21.15.78:0/2121202886 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f711c14f330 msgr2=0x7f711c141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:33.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7120d24640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f711c14f330 0x7f711c141540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7120d24640 1 -- 172.21.15.78:0/2121202886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f711c0a0020 msgr2=0x7f711c1e82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:33.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7120d24640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f711c0a0020 0x7f711c1e82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7120d24640 1 -- 172.21.15.78:0/2121202886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100094d0 con 0x7f711c0bc1c0 2023-06-02T15:31:33.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7121525640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f711c0a0020 0x7f711c1e82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:33.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7120d24640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c0bc1c0 0x7f711c0bebf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f711001c950 tx=0x7f7110019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:33.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7119ffb640 1 -- 172.21.15.78:0/2121202886 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100ac230 con 0x7f711c0bc1c0 2023-06-02T15:31:33.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7119ffb640 1 -- 172.21.15.78:0/2121202886 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71100aa670 con 0x7f711c0bc1c0 2023-06-02T15:31:33.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7123789640 1 -- 172.21.15.78:0/2121202886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711c0bcb90 con 0x7f711c0bc1c0 2023-06-02T15:31:33.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7119ffb640 1 -- 172.21.15.78:0/2121202886 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100aa9e0 con 0x7f711c0bc1c0 2023-06-02T15:31:33.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7123789640 1 -- 172.21.15.78:0/2121202886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f711c0bca00 con 0x7f711c0bc1c0 2023-06-02T15:31:33.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7123789640 1 -- 172.21.15.78:0/2121202886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711c1584d0 con 0x7f711c0bc1c0 2023-06-02T15:31:33.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7119ffb640 1 -- 172.21.15.78:0/2121202886 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f71100b2070 con 0x7f711c0bc1c0 2023-06-02T15:31:33.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7119ffb640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7108065c00 0x7f71080680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:33.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7119ffb640 1 -- 172.21.15.78:0/2121202886 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f711011d200 con 0x7f711c0bc1c0 2023-06-02T15:31:33.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7121525640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7108065c00 0x7f71080680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:33.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.530+0000 7f7121525640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7108065c00 0x7f71080680b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7114007fd0 tx=0x7f7114009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:33.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.534+0000 7f7119ffb640 1 -- 172.21.15.78:0/2121202886 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f71100ea730 con 0x7f711c0bc1c0 2023-06-02T15:31:33.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.694+0000 7f7123789640 1 -- 172.21.15.78:0/2121202886 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f711c073bc0 con 0x7f711c0bc1c0 2023-06-02T15:31:33.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.694+0000 7f7119ffb640 1 -- 172.21.15.78:0/2121202886 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f71100edd50 con 0x7f711c0bc1c0 2023-06-02T15:31:33.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:33.704 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:31:26.567542+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:31:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.694+0000 7f7123789640 1 -- 172.21.15.78:0/2121202886 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7108065c00 msgr2=0x7f71080680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.694+0000 7f7123789640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7108065c00 0x7f71080680b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7114007fd0 tx=0x7f7114009040 comp rx=0 tx=0).stop 2023-06-02T15:31:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.694+0000 7f7123789640 1 -- 172.21.15.78:0/2121202886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c0bc1c0 msgr2=0x7f711c0bebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.694+0000 7f7123789640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c0bc1c0 0x7f711c0bebf0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f711001c950 tx=0x7f7110019210 comp rx=0 tx=0).stop 2023-06-02T15:31:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.694+0000 7f7123789640 1 -- 172.21.15.78:0/2121202886 shutdown_connections 2023-06-02T15:31:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.694+0000 7f7123789640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f711c14f330 0x7f711c141540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.694+0000 7f7123789640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7108065c00 0x7f71080680b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.698+0000 7f7123789640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f711c0bc1c0 0x7f711c0bebf0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.698+0000 7f7123789640 1 --2- 172.21.15.78:0/2121202886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f711c0a0020 0x7f711c1e82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.698+0000 7f7123789640 1 -- 172.21.15.78:0/2121202886 >> 172.21.15.78:0/2121202886 conn(0x7f711c0bcf50 msgr2=0x7f711c1472d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.698+0000 7f7123789640 1 -- 172.21.15.78:0/2121202886 shutdown_connections 2023-06-02T15:31:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:33.698+0000 7f7123789640 1 -- 172.21.15.78:0/2121202886 wait complete. 2023-06-02T15:31:34.723 INFO:tasks.ceph:Scrubbing osd.0 2023-06-02T15:31:34.723 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-06-02T15:31:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12b4ed0640 1 Processor -- start 2023-06-02T15:31:34.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12b4ed0640 1 -- start start 2023-06-02T15:31:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12b4ed0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12b0149d90 0x7f12b01504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12b4ed0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b00baed0 0x7f12b00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12b4ed0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b0150a20 con 0x7f12b00bbc10 2023-06-02T15:31:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12b4ed0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b00bc080 con 0x7f12b0149d90 2023-06-02T15:31:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12b4ed0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00a3b40 con 0x7f12b00baed0 2023-06-02T15:31:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12add9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f12b00bbc10 0x7f12b00a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45458/0 (socket says 172.21.15.78:45458) 2023-06-02T15:31:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12add9b640 1 -- 172.21.15.78:0/3255843872 learned_addr learned my addr 172.21.15.78:0/3255843872 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:34.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12aed9d640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b00baed0 0x7f12b00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:34.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ae59c640 1 --2- 172.21.15.78:0/3255843872 >> v2:172.21.15.132:3300/0 conn(0x7f12b0149d90 0x7f12b01504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:34.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739457041 0 0) 0x7f12a4001120 con 0x7f12b00bbc10 2023-06-02T15:31:34.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1298003530 con 0x7f12b00bbc10 2023-06-02T15:31:34.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3226819578 0 0) 0x7f1298003530 con 0x7f12b00bbc10 2023-06-02T15:31:34.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b00baed0 msgr2=0x7f12b00a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:34.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b00baed0 0x7f12b00a3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:34.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 >> v2:172.21.15.132:3300/0 conn(0x7f12b0149d90 msgr2=0x7f12b01504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:34.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 --2- 172.21.15.78:0/3255843872 >> v2:172.21.15.132:3300/0 conn(0x7f12b0149d90 0x7f12b01504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:34.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00bcd60 con 0x7f12b00bbc10 2023-06-02T15:31:34.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f12a4001810 con 0x7f12b00bbc10 2023-06-02T15:31:34.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 >> v1:172.21.15.78:6789/0 conn(0x7f12b00bbc10 legacy=0x7f12b00a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:34.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b00baed0 0x7f1298003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:34.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1298003f00 0x7f12980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:34.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1298004d10 0x7f1298005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:34.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00bc080 con 0x7f1298003f00 2023-06-02T15:31:34.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00a3b40 con 0x7f1298004d10 2023-06-02T15:31:34.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129800b9c0 con 0x7f12b00baed0 2023-06-02T15:31:34.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12add9b640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1298003f00 0x7f12980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:34.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12ae59c640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b00baed0 0x7f1298003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:34.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12aed9d640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1298004d10 0x7f1298005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:34.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12add9b640 1 -- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b00baed0 msgr2=0x7f1298003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:34.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12add9b640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b00baed0 0x7f1298003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:34.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12add9b640 1 -- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1298004d10 msgr2=0x7f1298005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:34.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12add9b640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1298004d10 0x7f1298005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:34.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12add9b640 1 -- 172.21.15.78:0/3255843872 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1298003530 con 0x7f1298003f00 2023-06-02T15:31:34.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.854+0000 7f12aed9d640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1298004d10 0x7f1298005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:34.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12add9b640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1298003f00 0x7f12980047d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12a400c240 tx=0x7f12a401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f0932412d7a537 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:34.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40a5940 con 0x7f1298003f00 2023-06-02T15:31:34.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a40a5aa0 con 0x7f1298003f00 2023-06-02T15:31:34.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12ad59a640 1 -- 172.21.15.78:0/3255843872 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40058e0 con 0x7f1298003f00 2023-06-02T15:31:34.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12b4ed0640 1 -- 172.21.15.78:0/3255843872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1298003f00 msgr2=0x7f12980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:34.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12b4ed0640 1 --2- 172.21.15.78:0/3255843872 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1298003f00 0x7f12980047d0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12a400c240 tx=0x7f12a401cc40 comp rx=0 tx=0).stop 2023-06-02T15:31:34.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12aed9d640 1 -- 172.21.15.78:0/3255843872 reap_dead start 2023-06-02T15:31:34.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12b4ed0640 1 -- 172.21.15.78:0/3255843872 shutdown_connections 2023-06-02T15:31:34.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12b4ed0640 1 -- 172.21.15.78:0/3255843872 >> 172.21.15.78:0/3255843872 conn(0x7f12b00c04d0 msgr2=0x7f12b00c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:34.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12b4ed0640 1 -- 172.21.15.78:0/3255843872 shutdown_connections 2023-06-02T15:31:34.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12b4ed0640 1 -- 172.21.15.78:0/3255843872 wait complete. 2023-06-02T15:31:34.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12b4ed0640 1 Processor -- start 2023-06-02T15:31:34.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.858+0000 7f12b4ed0640 1 -- start start 2023-06-02T15:31:34.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12b4ed0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1298003f00 0x7f12b014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:34.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12b4ed0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12b0140750 0x7f12b014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:34.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12b4ed0640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b006eca0 0x7f12b01e5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:34.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12b4ed0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01e2a80 con 0x7f12b0140750 2023-06-02T15:31:34.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12b4ed0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01e2fb0 con 0x7f1298003f00 2023-06-02T15:31:34.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12b4ed0640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b0071830 con 0x7f12b006eca0 2023-06-02T15:31:34.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12add9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12b0140750 0x7f12b014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:34.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12add9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12b0140750 0x7f12b014f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47692/0 (socket says 172.21.15.78:47692) 2023-06-02T15:31:34.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12add9b640 1 -- 172.21.15.78:0/1781551080 learned_addr learned my addr 172.21.15.78:0/1781551080 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:34.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12aed9d640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b006eca0 0x7f12b01e5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:34.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12ae59c640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1298003f00 0x7f12b014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:34.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12add9b640 1 -- 172.21.15.78:0/1781551080 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b006eca0 msgr2=0x7f12b01e5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:34.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12add9b640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12b006eca0 0x7f12b01e5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:34.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12add9b640 1 -- 172.21.15.78:0/1781551080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1298003f00 msgr2=0x7f12b014e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:34.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12add9b640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1298003f00 0x7f12b014e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:34.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12add9b640 1 -- 172.21.15.78:0/1781551080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00bc6d0 con 0x7f12b0140750 2023-06-02T15:31:34.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12ae59c640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1298003f00 0x7f12b014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:34.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12add9b640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12b0140750 0x7f12b014f350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f12a400c240 tx=0x7f1298005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:34.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f129effd640 1 -- 172.21.15.78:0/1781551080 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40a5940 con 0x7f12b0140750 2023-06-02T15:31:34.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f129effd640 1 -- 172.21.15.78:0/1781551080 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a4000ee0 con 0x7f12b0140750 2023-06-02T15:31:34.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b014a160 con 0x7f12b0140750 2023-06-02T15:31:34.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f129effd640 1 -- 172.21.15.78:0/1781551080 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a40072f0 con 0x7f12b0140750 2023-06-02T15:31:34.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b00bc290 con 0x7f12b0140750 2023-06-02T15:31:34.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12b004dd40 con 0x7f12b0140750 2023-06-02T15:31:34.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f129effd640 1 -- 172.21.15.78:0/1781551080 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f12a40b5070 con 0x7f12b0140750 2023-06-02T15:31:34.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f129effd640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1290065c00 0x7f12900680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:34.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f129effd640 1 -- 172.21.15.78:0/1781551080 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f12a411d950 con 0x7f12b0140750 2023-06-02T15:31:34.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12ae59c640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1290065c00 0x7f12900680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:34.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f129effd640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] conn(0x7f129006f910 0x7f1290071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:34.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f129effd640 1 -- 172.21.15.78:0/1781551080 --> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1290072450 con 0x7f129006f910 2023-06-02T15:31:34.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f129effd640 1 -- 172.21.15.78:0/1781551080 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12a411dda0 con 0x7f12b0140750 2023-06-02T15:31:34.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12aed9d640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] conn(0x7f129006f910 0x7f1290071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:34.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.862+0000 7f12ae59c640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1290065c00 0x7f12900680b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009a20 tx=0x7f12a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:34.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.866+0000 7f12aed9d640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] conn(0x7f129006f910 0x7f1290071d80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:34.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.866+0000 7f129effd640 1 -- 172.21.15.78:0/1781551080 <== osd.0 v2:172.21.15.78:6800/37134 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f1290072450 con 0x7f129006f910 2023-06-02T15:31:34.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 --> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f12b0150a20 con 0x7f129006f910 2023-06-02T15:31:34.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f129effd640 1 -- 172.21.15.78:0/1781551080 <== osd.0 v2:172.21.15.78:6800/37134 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f12b0150a20 con 0x7f129006f910 2023-06-02T15:31:34.886 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-02T15:31:34.887 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-02T15:31:34.887 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-02T15:31:34.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] conn(0x7f129006f910 msgr2=0x7f1290071d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:34.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:6800/37134,v1:172.21.15.78:6801/37134] conn(0x7f129006f910 0x7f1290071d80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:34.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1290065c00 msgr2=0x7f12900680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:34.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f1290065c00 0x7f12900680b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009a20 tx=0x7f12a0008040 comp rx=0 tx=0).stop 2023-06-02T15:31:34.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12b0140750 msgr2=0x7f12b014f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:34.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 --2- 172.21.15.78:0/1781551080 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12b0140750 0x7f12b014f350 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f12a400c240 tx=0x7f1298005800 comp rx=0 tx=0).stop 2023-06-02T15:31:34.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12aed9d640 1 -- 172.21.15.78:0/1781551080 reap_dead start 2023-06-02T15:31:34.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 shutdown_connections 2023-06-02T15:31:34.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 >> 172.21.15.78:0/1781551080 conn(0x7f12b00c04d0 msgr2=0x7f12b00bd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:34.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 shutdown_connections 2023-06-02T15:31:34.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:34.878+0000 7f12b4ed0640 1 -- 172.21.15.78:0/1781551080 wait complete. 2023-06-02T15:31:34.903 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-06-02T15:31:35.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96bc61a640 1 Processor -- start 2023-06-02T15:31:35.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96bc61a640 1 -- start start 2023-06-02T15:31:35.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96bc61a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b414ef40 0x7f96b40c0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96bc61a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96b4152710 0x7f96b4158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96bc61a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b40bb970 con 0x7f96b406bf70 2023-06-02T15:31:35.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96bc61a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b4151ae0 con 0x7f96b4152710 2023-06-02T15:31:35.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96bc61a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b40bbc50 con 0x7f96b414ef40 2023-06-02T15:31:35.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96babb7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f96b4152710 0x7f96b4158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96b9bb5640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f96b406bf70 0x7f96b4152000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45466/0 (socket says 172.21.15.78:45466) 2023-06-02T15:31:35.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96b9bb5640 1 -- 172.21.15.78:0/505753187 learned_addr learned my addr 172.21.15.78:0/505753187 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:35.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96ba3b6640 1 --2- 172.21.15.78:0/505753187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b414ef40 0x7f96b40c0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96babb7640 1 -- 172.21.15.78:0/505753187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b414ef40 msgr2=0x7f96b40c0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:35.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96babb7640 1 --2- 172.21.15.78:0/505753187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b414ef40 0x7f96b40c0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96babb7640 1 -- 172.21.15.78:0/505753187 >> v1:172.21.15.78:6789/0 conn(0x7f96b406bf70 legacy=0x7f96b4152000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96babb7640 1 -- 172.21.15.78:0/505753187 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b414f310 con 0x7f96b4152710 2023-06-02T15:31:35.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96b93b4640 1 -- 172.21.15.78:0/505753187 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 716134128 0 0) 0x7f96b40bb970 con 0x7f96b406bf70 2023-06-02T15:31:35.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.010+0000 7f96ba3b6640 1 --2- 172.21.15.78:0/505753187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b414ef40 0x7f96b40c0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96babb7640 1 --2- 172.21.15.78:0/505753187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b4152710 0x7f96b4158dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0097c0 tx=0x7f96ac01ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcec0824a47c3a2 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96b93b4640 1 -- 172.21.15.78:0/505753187 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac0a8970 con 0x7f96b4152710 2023-06-02T15:31:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96b93b4640 1 -- 172.21.15.78:0/505753187 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96ac0a8ad0 con 0x7f96b4152710 2023-06-02T15:31:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96b93b4640 1 -- 172.21.15.78:0/505753187 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96ac0a8e60 con 0x7f96b4152710 2023-06-02T15:31:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 -- 172.21.15.78:0/505753187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b4152710 msgr2=0x7f96b4158dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 --2- 172.21.15.78:0/505753187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b4152710 0x7f96b4158dd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0097c0 tx=0x7f96ac01ec70 comp rx=0 tx=0).stop 2023-06-02T15:31:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 -- 172.21.15.78:0/505753187 shutdown_connections 2023-06-02T15:31:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 --2- 172.21.15.78:0/505753187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b4152710 0x7f96b4158dd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 --2- 172.21.15.78:0/505753187 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b414ef40 0x7f96b40c0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 -- 172.21.15.78:0/505753187 >> 172.21.15.78:0/505753187 conn(0x7f96b40a2170 msgr2=0x7f96b40a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:35.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 -- 172.21.15.78:0/505753187 shutdown_connections 2023-06-02T15:31:35.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 -- 172.21.15.78:0/505753187 wait complete. 2023-06-02T15:31:35.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 Processor -- start 2023-06-02T15:31:35.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 -- start start 2023-06-02T15:31:35.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b406bf70 0x7f96b40a1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96b414ef40 0x7f96b40bee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b4152710 0x7f96b40bf360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b406f7b0 con 0x7f96b406bf70 2023-06-02T15:31:35.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b4149bd0 con 0x7f96b414ef40 2023-06-02T15:31:35.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96bc61a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b41e7110 con 0x7f96b4152710 2023-06-02T15:31:35.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.014+0000 7f96ba3b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b406bf70 0x7f96b40a1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96ba3b6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b406bf70 0x7f96b40a1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47724/0 (socket says 172.21.15.78:47724) 2023-06-02T15:31:35.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96ba3b6640 1 -- 172.21.15.78:0/115506269 learned_addr learned my addr 172.21.15.78:0/115506269 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:35.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96ba3b6640 1 -- 172.21.15.78:0/115506269 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b4152710 msgr2=0x7f96b40bf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96babb7640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b4152710 0x7f96b40bf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96b9bb5640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96b414ef40 0x7f96b40bee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96ba3b6640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b4152710 0x7f96b40bf360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96ba3b6640 1 -- 172.21.15.78:0/115506269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96b414ef40 msgr2=0x7f96b40bee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96ba3b6640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96b414ef40 0x7f96b40bee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96ba3b6640 1 -- 172.21.15.78:0/115506269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ac009420 con 0x7f96b406bf70 2023-06-02T15:31:35.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96ba3b6640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b406bf70 0x7f96b40a1150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f96b000cf60 tx=0x7f96b000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96aaffd640 1 -- 172.21.15.78:0/115506269 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b000d840 con 0x7f96b406bf70 2023-06-02T15:31:35.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96aaffd640 1 -- 172.21.15.78:0/115506269 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b000d9a0 con 0x7f96b406bf70 2023-06-02T15:31:35.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96aaffd640 1 -- 172.21.15.78:0/115506269 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b000dd30 con 0x7f96b406bf70 2023-06-02T15:31:35.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96bc61a640 1 -- 172.21.15.78:0/115506269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b406cf10 con 0x7f96b406bf70 2023-06-02T15:31:35.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96bc61a640 1 -- 172.21.15.78:0/115506269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b406cd80 con 0x7f96b406bf70 2023-06-02T15:31:35.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96bc61a640 1 -- 172.21.15.78:0/115506269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b40c0850 con 0x7f96b406bf70 2023-06-02T15:31:35.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96aaffd640 1 -- 172.21.15.78:0/115506269 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f96b0015440 con 0x7f96b406bf70 2023-06-02T15:31:35.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96aaffd640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9698065c00 0x7f96980680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96aaffd640 1 -- 172.21.15.78:0/115506269 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f96b0083f30 con 0x7f96b406bf70 2023-06-02T15:31:35.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96b9bb5640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9698065c00 0x7f96980680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.018+0000 7f96b9bb5640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9698065c00 0x7f96980680b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f96b40bb590 tx=0x7f96a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.022+0000 7f96aaffd640 1 -- 172.21.15.78:0/115506269 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f96b004d6e0 con 0x7f96b406bf70 2023-06-02T15:31:35.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.174+0000 7f96bc61a640 1 -- 172.21.15.78:0/115506269 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f96b4099890 con 0x7f9698065c00 2023-06-02T15:31:35.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.174+0000 7f96aaffd640 1 -- 172.21.15.78:0/115506269 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f96b4099890 con 0x7f9698065c00 2023-06-02T15:31:35.183 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2023-06-02T15:31:35.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 -- 172.21.15.78:0/115506269 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9698065c00 msgr2=0x7f96980680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9698065c00 0x7f96980680b0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f96b40bb590 tx=0x7f96a4009040 comp rx=0 tx=0).stop 2023-06-02T15:31:35.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 -- 172.21.15.78:0/115506269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b406bf70 msgr2=0x7f96b40a1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b406bf70 0x7f96b40a1150 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f96b000cf60 tx=0x7f96b000cf90 comp rx=0 tx=0).stop 2023-06-02T15:31:35.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 -- 172.21.15.78:0/115506269 shutdown_connections 2023-06-02T15:31:35.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f96b4152710 0x7f96b40bf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96b414ef40 0x7f96b40bee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9698065c00 0x7f96980680b0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 --2- 172.21.15.78:0/115506269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f96b406bf70 0x7f96b40a1150 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 -- 172.21.15.78:0/115506269 >> 172.21.15.78:0/115506269 conn(0x7f96b40a2170 msgr2=0x7f96b4150600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:35.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 -- 172.21.15.78:0/115506269 shutdown_connections 2023-06-02T15:31:35.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.178+0000 7f96bc61a640 1 -- 172.21.15.78:0/115506269 wait complete. 2023-06-02T15:31:35.203 INFO:tasks.ceph:Scrubbing osd.1 2023-06-02T15:31:35.203 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-06-02T15:31:35.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4bae00640 1 Processor -- start 2023-06-02T15:31:35.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4bae00640 1 -- start start 2023-06-02T15:31:35.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4bae00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff4b4148b20 0x7ff4b40bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4bae00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b40bc4a0 0x7ff4b40a4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4bae00640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b406cae0 con 0x7ff4b414e8a0 2023-06-02T15:31:35.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4bae00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b414f7f0 con 0x7ff4b4148b20 2023-06-02T15:31:35.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4bae00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40a3c60 con 0x7ff4b40bc4a0 2023-06-02T15:31:35.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b939d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff4b414e8a0 0x7ff4b40a46a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45468/0 (socket says 172.21.15.78:45468) 2023-06-02T15:31:35.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b939d640 1 -- 172.21.15.78:0/2491056262 learned_addr learned my addr 172.21.15.78:0/2491056262 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:35.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b3fff640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b40bc4a0 0x7ff4b40a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b8b9c640 1 --2- 172.21.15.78:0/2491056262 >> v2:172.21.15.132:3300/0 conn(0x7ff4b4148b20 0x7ff4b40bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252026431 0 0) 0x7ff4b406cae0 con 0x7ff4b414e8a0 2023-06-02T15:31:35.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff49c003530 con 0x7ff4b414e8a0 2023-06-02T15:31:35.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 576909611 0 0) 0x7ff49c003530 con 0x7ff4b414e8a0 2023-06-02T15:31:35.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b40bc4a0 msgr2=0x7ff4b40a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:35.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b40bc4a0 0x7ff4b40a4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 >> v2:172.21.15.132:3300/0 conn(0x7ff4b4148b20 msgr2=0x7ff4b40bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:35.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 --2- 172.21.15.78:0/2491056262 >> v2:172.21.15.132:3300/0 conn(0x7ff4b4148b20 0x7ff4b40bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b406c1b0 con 0x7ff4b414e8a0 2023-06-02T15:31:35.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7ff4ac001a00 con 0x7ff4b414e8a0 2023-06-02T15:31:35.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 >> v1:172.21.15.78:6789/0 conn(0x7ff4b414e8a0 legacy=0x7ff4b40a46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b40bc4a0 0x7ff49c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff49c003f00 0x7ff49c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff49c004d10 0x7ff49c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b414f7f0 con 0x7ff49c004d10 2023-06-02T15:31:35.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b40a3c60 con 0x7ff49c003f00 2023-06-02T15:31:35.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff49c00dba0 con 0x7ff4b40bc4a0 2023-06-02T15:31:35.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b939d640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff49c004d10 0x7ff49c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b8b9c640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b40bc4a0 0x7ff49c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b3fff640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff49c003f00 0x7ff49c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b939d640 1 -- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b40bc4a0 msgr2=0x7ff49c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:35.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b939d640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b40bc4a0 0x7ff49c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b939d640 1 -- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff49c003f00 msgr2=0x7ff49c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:35.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b939d640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff49c003f00 0x7ff49c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.318+0000 7ff4b939d640 1 -- 172.21.15.78:0/2491056262 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49c003530 con 0x7ff49c004d10 2023-06-02T15:31:35.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4b939d640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff49c004d10 0x7ff49c005180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00a860 tx=0x7ff4ac01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa8ed159826d2384 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0ad630 con 0x7ff49c004d10 2023-06-02T15:31:35.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac0a8070 con 0x7ff49c004d10 2023-06-02T15:31:35.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4b37fe640 1 -- 172.21.15.78:0/2491056262 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0ada30 con 0x7ff49c004d10 2023-06-02T15:31:35.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 -- 172.21.15.78:0/2491056262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff49c004d10 msgr2=0x7ff49c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 --2- 172.21.15.78:0/2491056262 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff49c004d10 0x7ff49c005180 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00a860 tx=0x7ff4ac01d360 comp rx=0 tx=0).stop 2023-06-02T15:31:35.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4b939d640 1 -- 172.21.15.78:0/2491056262 reap_dead start 2023-06-02T15:31:35.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 -- 172.21.15.78:0/2491056262 shutdown_connections 2023-06-02T15:31:35.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 -- 172.21.15.78:0/2491056262 >> 172.21.15.78:0/2491056262 conn(0x7ff4b40c04d0 msgr2=0x7ff4b40c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:35.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 -- 172.21.15.78:0/2491056262 shutdown_connections 2023-06-02T15:31:35.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 -- 172.21.15.78:0/2491056262 wait complete. 2023-06-02T15:31:35.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 Processor -- start 2023-06-02T15:31:35.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 -- start start 2023-06-02T15:31:35.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bf0f0 0x7ff4b40bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b414bbb0 0x7ff4b40a2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4b413f490 0x7ff4b413ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41421f0 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41e38b0 con 0x7ff4b413f490 2023-06-02T15:31:35.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4bae00640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b41e3b90 con 0x7ff4b414bbb0 2023-06-02T15:31:35.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4b8b9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bf0f0 0x7ff4b40bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4b8b9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bf0f0 0x7ff4b40bf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47728/0 (socket says 172.21.15.78:47728) 2023-06-02T15:31:35.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4b8b9c640 1 -- 172.21.15.78:0/2454158414 learned_addr learned my addr 172.21.15.78:0/2454158414 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:35.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.322+0000 7ff4b3fff640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b414bbb0 0x7ff4b40a2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b939d640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4b413f490 0x7ff4b413ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b8b9c640 1 -- 172.21.15.78:0/2454158414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b414bbb0 msgr2=0x7ff4b40a2110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b8b9c640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff4b414bbb0 0x7ff4b40a2110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b8b9c640 1 -- 172.21.15.78:0/2454158414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4b413f490 msgr2=0x7ff4b413ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b8b9c640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4b413f490 0x7ff4b413ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b8b9c640 1 -- 172.21.15.78:0/2454158414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b406c770 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b8b9c640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bf0f0 0x7ff4b40bf4c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4011660 tx=0x7ff4a4011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b17fa640 1 -- 172.21.15.78:0/2454158414 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400f9c0 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b17fa640 1 -- 172.21.15.78:0/2454158414 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400fb20 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b406c490 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b17fa640 1 -- 172.21.15.78:0/2454158414 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a400fe90 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b406cf70 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4b41e3a20 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b17fa640 1 -- 172.21.15.78:0/2454158414 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7ff4a4015460 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b17fa640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff4a0065c00 0x7ff4a00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b17fa640 1 -- 172.21.15.78:0/2454158414 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff4a4084120 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b3fff640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff4a0065c00 0x7ff4a00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b17fa640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] conn(0x7ff4a006f910 0x7ff4a0071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b17fa640 1 -- 172.21.15.78:0/2454158414 --> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4a0072450 con 0x7ff4a006f910 2023-06-02T15:31:35.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b17fa640 1 -- 172.21.15.78:0/2454158414 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4a4084570 con 0x7ff4b40bf0f0 2023-06-02T15:31:35.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b939d640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] conn(0x7ff4a006f910 0x7ff4a0071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b3fff640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff4a0065c00 0x7ff4a00680b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4b41425b0 tx=0x7ff4a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.326+0000 7ff4b939d640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] conn(0x7ff4a006f910 0x7ff4a0071d80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.330+0000 7ff4b17fa640 1 -- 172.21.15.78:0/2454158414 <== osd.1 v2:172.21.15.78:6824/37135 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff4a0072450 con 0x7ff4a006f910 2023-06-02T15:31:35.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 --> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff4b4142330 con 0x7ff4a006f910 2023-06-02T15:31:35.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4b17fa640 1 -- 172.21.15.78:0/2454158414 <== osd.1 v2:172.21.15.78:6824/37135 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff4ac0011d0 con 0x7ff4a006f910 2023-06-02T15:31:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-02T15:31:35.350 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-02T15:31:35.350 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-02T15:31:35.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] conn(0x7ff4a006f910 msgr2=0x7ff4a0071d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:6824/37135,v1:172.21.15.78:6825/37135] conn(0x7ff4a006f910 0x7ff4a0071d80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff4a0065c00 msgr2=0x7ff4a00680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff4a0065c00 0x7ff4a00680b0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4b41425b0 tx=0x7ff4a8008040 comp rx=0 tx=0).stop 2023-06-02T15:31:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bf0f0 msgr2=0x7ff4b40bf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 --2- 172.21.15.78:0/2454158414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff4b40bf0f0 0x7ff4b40bf4c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4011660 tx=0x7ff4a4011b20 comp rx=0 tx=0).stop 2023-06-02T15:31:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4b939d640 1 -- 172.21.15.78:0/2454158414 reap_dead start 2023-06-02T15:31:35.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 shutdown_connections 2023-06-02T15:31:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 >> 172.21.15.78:0/2454158414 conn(0x7ff4b40c04d0 msgr2=0x7ff4b40a58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 shutdown_connections 2023-06-02T15:31:35.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.342+0000 7ff4bae00640 1 -- 172.21.15.78:0/2454158414 wait complete. 2023-06-02T15:31:35.366 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-06-02T15:31:35.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b7ab4640 1 Processor -- start 2023-06-02T15:31:35.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b7ab4640 1 -- start start 2023-06-02T15:31:35.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b7ab4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75b00c0570 0x7f75b00ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b7ab4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f75b01485c0 0x7f75b0148a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b7ab4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b00a5f30 con 0x7f75b0071780 2023-06-02T15:31:35.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b7ab4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75b00c1100 con 0x7f75b01485c0 2023-06-02T15:31:35.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b7ab4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b014bcc0 con 0x7f75b00c0570 2023-06-02T15:31:35.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b504f640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f75b0071780 0x7f75b00bc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45470/0 (socket says 172.21.15.78:45470) 2023-06-02T15:31:35.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b504f640 1 -- 172.21.15.78:0/1613425806 learned_addr learned my addr 172.21.15.78:0/1613425806 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:35.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b6051640 1 --2- 172.21.15.78:0/1613425806 >> v2:172.21.15.78:3300/0 conn(0x7f75b01485c0 0x7f75b0148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b5850640 1 --2- 172.21.15.78:0/1613425806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75b00c0570 0x7f75b00ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b484e640 1 -- 172.21.15.78:0/1613425806 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2883793312 0 0) 0x7f75b00a5f30 con 0x7f75b0071780 2023-06-02T15:31:35.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b484e640 1 -- 172.21.15.78:0/1613425806 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f759c005740 con 0x7f75b0071780 2023-06-02T15:31:35.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b6051640 1 -- 172.21.15.78:0/1613425806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75b00c0570 msgr2=0x7f75b00ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:35.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b6051640 1 --2- 172.21.15.78:0/1613425806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75b00c0570 0x7f75b00ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b6051640 1 -- 172.21.15.78:0/1613425806 >> v1:172.21.15.78:6789/0 conn(0x7f75b0071780 legacy=0x7f75b00bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.470+0000 7f75b6051640 1 -- 172.21.15.78:0/1613425806 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b014bfa0 con 0x7f75b01485c0 2023-06-02T15:31:35.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b6051640 1 --2- 172.21.15.78:0/1613425806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b01485c0 0x7f75b0148a40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009dc0 tx=0x7f75a801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52dec548f35abdb4 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b484e640 1 -- 172.21.15.78:0/1613425806 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80a6670 con 0x7f75b01485c0 2023-06-02T15:31:35.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b484e640 1 -- 172.21.15.78:0/1613425806 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a80a67d0 con 0x7f75b01485c0 2023-06-02T15:31:35.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b484e640 1 -- 172.21.15.78:0/1613425806 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80a6b60 con 0x7f75b01485c0 2023-06-02T15:31:35.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b7ab4640 1 -- 172.21.15.78:0/1613425806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b01485c0 msgr2=0x7f75b0148a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b7ab4640 1 --2- 172.21.15.78:0/1613425806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b01485c0 0x7f75b0148a40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009dc0 tx=0x7f75a801c8a0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b7ab4640 1 -- 172.21.15.78:0/1613425806 shutdown_connections 2023-06-02T15:31:35.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b7ab4640 1 --2- 172.21.15.78:0/1613425806 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b01485c0 0x7f75b0148a40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b7ab4640 1 --2- 172.21.15.78:0/1613425806 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75b00c0570 0x7f75b00ba640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b7ab4640 1 -- 172.21.15.78:0/1613425806 >> 172.21.15.78:0/1613425806 conn(0x7f75b00a2170 msgr2=0x7f75b00a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:35.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b7ab4640 1 -- 172.21.15.78:0/1613425806 shutdown_connections 2023-06-02T15:31:35.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b7ab4640 1 -- 172.21.15.78:0/1613425806 wait complete. 2023-06-02T15:31:35.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b7ab4640 1 Processor -- start 2023-06-02T15:31:35.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.474+0000 7f75b7ab4640 1 -- start start 2023-06-02T15:31:35.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b7ab4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b0071780 0x7f75b014c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b7ab4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b00c0570 0x7f75b014d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b7ab4640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75b01485c0 0x7f75b01ea7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b7ab4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b013fbb0 con 0x7f75b0071780 2023-06-02T15:31:35.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b7ab4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b013f6f0 con 0x7f75b00c0570 2023-06-02T15:31:35.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b7ab4640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b014eb00 con 0x7f75b01485c0 2023-06-02T15:31:35.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b5850640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b0071780 0x7f75b014c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b5850640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b0071780 0x7f75b014c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47740/0 (socket says 172.21.15.78:47740) 2023-06-02T15:31:35.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b5850640 1 -- 172.21.15.78:0/3631768349 learned_addr learned my addr 172.21.15.78:0/3631768349 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:35.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b5850640 1 -- 172.21.15.78:0/3631768349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75b01485c0 msgr2=0x7f75b01ea7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b5850640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75b01485c0 0x7f75b01ea7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b5850640 1 -- 172.21.15.78:0/3631768349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b00c0570 msgr2=0x7f75b014d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b504f640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b00c0570 0x7f75b014d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b5850640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b00c0570 0x7f75b014d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b5850640 1 -- 172.21.15.78:0/3631768349 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8009a70 con 0x7f75b0071780 2023-06-02T15:31:35.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b504f640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b00c0570 0x7f75b014d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:35.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b5850640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b0071780 0x7f75b014c960 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00d800 tx=0x7f75ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75a67fc640 1 -- 172.21.15.78:0/3631768349 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00b660 con 0x7f75b0071780 2023-06-02T15:31:35.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75a67fc640 1 -- 172.21.15.78:0/3631768349 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac00b7c0 con 0x7f75b0071780 2023-06-02T15:31:35.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b7ab4640 1 -- 172.21.15.78:0/3631768349 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b006c910 con 0x7f75b0071780 2023-06-02T15:31:35.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75a67fc640 1 -- 172.21.15.78:0/3631768349 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00bb30 con 0x7f75b0071780 2023-06-02T15:31:35.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b7ab4640 1 -- 172.21.15.78:0/3631768349 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b006c780 con 0x7f75b0071780 2023-06-02T15:31:35.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b7ab4640 1 -- 172.21.15.78:0/3631768349 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b006caa0 con 0x7f75b0071780 2023-06-02T15:31:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75a67fc640 1 -- 172.21.15.78:0/3631768349 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f75ac00bc90 con 0x7f75b0071780 2023-06-02T15:31:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75a67fc640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7594065c30 0x7f75940680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b504f640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7594065c30 0x7f75940680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75a67fc640 1 -- 172.21.15.78:0/3631768349 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f75ac083ad0 con 0x7f75b0071780 2023-06-02T15:31:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.478+0000 7f75b504f640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7594065c30 0x7f75940680e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f75b0070b40 tx=0x7f75a0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.482+0000 7f75a67fc640 1 -- 172.21.15.78:0/3631768349 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f75ac051000 con 0x7f75b0071780 2023-06-02T15:31:35.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.630+0000 7f75b7ab4640 1 -- 172.21.15.78:0/3631768349 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f75b0073bc0 con 0x7f7594065c30 2023-06-02T15:31:35.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75a67fc640 1 -- 172.21.15.78:0/3631768349 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f75b0073bc0 con 0x7f7594065c30 2023-06-02T15:31:35.642 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2023-06-02T15:31:35.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 -- 172.21.15.78:0/3631768349 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7594065c30 msgr2=0x7f75940680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7594065c30 0x7f75940680e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f75b0070b40 tx=0x7f75a0009040 comp rx=0 tx=0).stop 2023-06-02T15:31:35.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 -- 172.21.15.78:0/3631768349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b0071780 msgr2=0x7f75b014c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b0071780 0x7f75b014c960 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00d800 tx=0x7f75ac00dcc0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 -- 172.21.15.78:0/3631768349 shutdown_connections 2023-06-02T15:31:35.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f75b01485c0 0x7f75b01ea7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b00c0570 0x7f75b014d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f7594065c30 0x7f75940680e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 --2- 172.21.15.78:0/3631768349 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75b0071780 0x7f75b014c960 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 -- 172.21.15.78:0/3631768349 >> 172.21.15.78:0/3631768349 conn(0x7f75b00a2170 msgr2=0x7f75b0149af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:35.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 -- 172.21.15.78:0/3631768349 shutdown_connections 2023-06-02T15:31:35.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.634+0000 7f75b7ab4640 1 -- 172.21.15.78:0/3631768349 wait complete. 2023-06-02T15:31:35.660 INFO:tasks.ceph:Scrubbing osd.2 2023-06-02T15:31:35.660 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-06-02T15:31:35.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff535b6b640 1 Processor -- start 2023-06-02T15:31:35.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff535b6b640 1 -- start start 2023-06-02T15:31:35.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff535b6b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff530149d90 0x7ff5301504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff535b6b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5300bbc10 0x7ff5300a3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff535b6b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff5300baed0 0x7ff5300a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff535b6b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5300bc080 con 0x7ff530149d90 2023-06-02T15:31:35.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff535b6b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff530150a20 con 0x7ff5300baed0 2023-06-02T15:31:35.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff535b6b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5300a3b40 con 0x7ff5300bbc10 2023-06-02T15:31:35.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff52f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff530149d90 0x7ff5301504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff52f7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff530149d90 0x7ff5301504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47754/0 (socket says 172.21.15.78:47754) 2023-06-02T15:31:35.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff52f7fe640 1 -- 172.21.15.78:0/2984952866 learned_addr learned my addr 172.21.15.78:0/2984952866 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:35.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff52effd640 1 --2- 172.21.15.78:0/2984952866 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5300bbc10 0x7ff5300a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff52ffff640 1 --2- 172.21.15.78:0/2984952866 >> v2:172.21.15.132:3300/0 conn(0x7ff5300baed0 0x7ff5300a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff52f7fe640 1 -- 172.21.15.78:0/2984952866 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5300bbc10 msgr2=0x7ff5300a3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff52f7fe640 1 --2- 172.21.15.78:0/2984952866 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5300bbc10 0x7ff5300a3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff52f7fe640 1 -- 172.21.15.78:0/2984952866 >> v2:172.21.15.132:3300/0 conn(0x7ff5300baed0 msgr2=0x7ff5300a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff52f7fe640 1 --2- 172.21.15.78:0/2984952866 >> v2:172.21.15.132:3300/0 conn(0x7ff5300baed0 0x7ff5300a23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.770+0000 7ff52f7fe640 1 -- 172.21.15.78:0/2984952866 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5300bcd60 con 0x7ff530149d90 2023-06-02T15:31:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff52f7fe640 1 --2- 172.21.15.78:0/2984952866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff530149d90 0x7ff5301504e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff53006ec70 tx=0x7ff52801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb164d4b5e03bd9a server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff52e7fc640 1 -- 172.21.15.78:0/2984952866 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5280af400 con 0x7ff530149d90 2023-06-02T15:31:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff52e7fc640 1 -- 172.21.15.78:0/2984952866 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5280ab050 con 0x7ff530149d90 2023-06-02T15:31:35.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff52e7fc640 1 -- 172.21.15.78:0/2984952866 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5280af780 con 0x7ff530149d90 2023-06-02T15:31:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff535b6b640 1 -- 172.21.15.78:0/2984952866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff530149d90 msgr2=0x7ff5301504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff535b6b640 1 --2- 172.21.15.78:0/2984952866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff530149d90 0x7ff5301504e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff53006ec70 tx=0x7ff52801f1c0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff535b6b640 1 -- 172.21.15.78:0/2984952866 shutdown_connections 2023-06-02T15:31:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff535b6b640 1 --2- 172.21.15.78:0/2984952866 >> v2:172.21.15.132:3300/0 conn(0x7ff5300baed0 0x7ff5300a23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff535b6b640 1 --2- 172.21.15.78:0/2984952866 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5300bbc10 0x7ff5300a3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff535b6b640 1 --2- 172.21.15.78:0/2984952866 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff530149d90 0x7ff5301504e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff535b6b640 1 -- 172.21.15.78:0/2984952866 >> 172.21.15.78:0/2984952866 conn(0x7ff5300c04d0 msgr2=0x7ff5300c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:35.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff535b6b640 1 -- 172.21.15.78:0/2984952866 shutdown_connections 2023-06-02T15:31:35.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.774+0000 7ff535b6b640 1 -- 172.21.15.78:0/2984952866 wait complete. 2023-06-02T15:31:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 Processor -- start 2023-06-02T15:31:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 -- start start 2023-06-02T15:31:35.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5300baed0 0x7ff5301e7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5300bbc10 0x7ff5301d92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff530149d90 0x7ff530071440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53006f090 con 0x7ff530149d90 2023-06-02T15:31:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5301e80f0 con 0x7ff5300bbc10 2023-06-02T15:31:35.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5300a0310 con 0x7ff5300baed0 2023-06-02T15:31:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff530149d90 0x7ff530071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff530149d90 0x7ff530071440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47756/0 (socket says 172.21.15.78:47756) 2023-06-02T15:31:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52ffff640 1 -- 172.21.15.78:0/1014564338 learned_addr learned my addr 172.21.15.78:0/1014564338 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52effd640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5300bbc10 0x7ff5301d92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52f7fe640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5300baed0 0x7ff5301e7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52ffff640 1 -- 172.21.15.78:0/1014564338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5300baed0 msgr2=0x7ff5301e7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52ffff640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5300baed0 0x7ff5301e7bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52ffff640 1 -- 172.21.15.78:0/1014564338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5300bbc10 msgr2=0x7ff5301d92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52ffff640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5300bbc10 0x7ff5301d92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52ffff640 1 -- 172.21.15.78:0/1014564338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff528009b30 con 0x7ff530149d90 2023-06-02T15:31:35.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52ffff640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff530149d90 0x7ff530071440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff52000d800 tx=0x7ff52000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff517fff640 1 -- 172.21.15.78:0/1014564338 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52000b6c0 con 0x7ff530149d90 2023-06-02T15:31:35.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff517fff640 1 -- 172.21.15.78:0/1014564338 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff52000b820 con 0x7ff530149d90 2023-06-02T15:31:35.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff517fff640 1 -- 172.21.15.78:0/1014564338 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52000bbd0 con 0x7ff530149d90 2023-06-02T15:31:35.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5300bc6d0 con 0x7ff530149d90 2023-06-02T15:31:35.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53014a160 con 0x7ff530149d90 2023-06-02T15:31:35.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff5300bc290 con 0x7ff530149d90 2023-06-02T15:31:35.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff517fff640 1 -- 172.21.15.78:0/1014564338 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7ff52000bd30 con 0x7ff530149d90 2023-06-02T15:31:35.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff517fff640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff51c065c00 0x7ff51c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff52f7fe640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff51c065c00 0x7ff51c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.778+0000 7ff517fff640 1 -- 172.21.15.78:0/1014564338 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff520084690 con 0x7ff530149d90 2023-06-02T15:31:35.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.782+0000 7ff517fff640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] conn(0x7ff51c06f910 0x7ff51c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.782+0000 7ff517fff640 1 -- 172.21.15.78:0/1014564338 --> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff51c072450 con 0x7ff51c06f910 2023-06-02T15:31:35.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.782+0000 7ff517fff640 1 -- 172.21.15.78:0/1014564338 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff520084ae0 con 0x7ff530149d90 2023-06-02T15:31:35.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.782+0000 7ff52effd640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] conn(0x7ff51c06f910 0x7ff51c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.782+0000 7ff52f7fe640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff51c065c00 0x7ff51c0680b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5280b1000 tx=0x7ff5280aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.782+0000 7ff52effd640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] conn(0x7ff51c06f910 0x7ff51c071d80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.782+0000 7ff517fff640 1 -- 172.21.15.78:0/1014564338 <== osd.2 v2:172.21.15.78:6816/37136 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff51c072450 con 0x7ff51c06f910 2023-06-02T15:31:35.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 --> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5300a04c0 con 0x7ff51c06f910 2023-06-02T15:31:35.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff517fff640 1 -- 172.21.15.78:0/1014564338 <== osd.2 v2:172.21.15.78:6816/37136 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff5300a04c0 con 0x7ff51c06f910 2023-06-02T15:31:35.805 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-02T15:31:35.805 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-02T15:31:35.805 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-02T15:31:35.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] conn(0x7ff51c06f910 msgr2=0x7ff51c071d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:6816/37136,v1:172.21.15.78:6817/37136] conn(0x7ff51c06f910 0x7ff51c071d80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff51c065c00 msgr2=0x7ff51c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff51c065c00 0x7ff51c0680b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff5280b1000 tx=0x7ff5280aa000 comp rx=0 tx=0).stop 2023-06-02T15:31:35.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff530149d90 msgr2=0x7ff530071440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 --2- 172.21.15.78:0/1014564338 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff530149d90 0x7ff530071440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff52000d800 tx=0x7ff52000dcc0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff52ffff640 1 -- 172.21.15.78:0/1014564338 reap_dead start 2023-06-02T15:31:35.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 shutdown_connections 2023-06-02T15:31:35.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 >> 172.21.15.78:0/1014564338 conn(0x7ff5300c04d0 msgr2=0x7ff5300be0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:35.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 shutdown_connections 2023-06-02T15:31:35.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.794+0000 7ff535b6b640 1 -- 172.21.15.78:0/1014564338 wait complete. 2023-06-02T15:31:35.817 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-06-02T15:31:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49b3de640 1 Processor -- start 2023-06-02T15:31:35.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49b3de640 1 -- start start 2023-06-02T15:31:35.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49b3de640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 0x7fd4940718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49b3de640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd49406c250 0x7fd494149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49b3de640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd49414d220 con 0x7fd49406cfc0 2023-06-02T15:31:35.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49b3de640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4940ba640 con 0x7fd49406c250 2023-06-02T15:31:35.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49b3de640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49414cd30 con 0x7fd4940a59e0 2023-06-02T15:31:35.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49997b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd49406c250 0x7fd494149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd498979640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd49406cfc0 0x7fd49414f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45478/0 (socket says 172.21.15.78:45478) 2023-06-02T15:31:35.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd498979640 1 -- 172.21.15.78:0/4016339419 learned_addr learned my addr 172.21.15.78:0/4016339419 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:35.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49917a640 1 --2- 172.21.15.78:0/4016339419 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 0x7fd4940718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49997b640 1 -- 172.21.15.78:0/4016339419 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 msgr2=0x7fd4940718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:35.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49997b640 1 --2- 172.21.15.78:0/4016339419 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 0x7fd4940718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49997b640 1 -- 172.21.15.78:0/4016339419 >> v1:172.21.15.78:6789/0 conn(0x7fd49406cfc0 legacy=0x7fd49414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd48bfff640 1 -- 172.21.15.78:0/4016339419 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592405103 0 0) 0x7fd49414d220 con 0x7fd49406cfc0 2023-06-02T15:31:35.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49997b640 1 -- 172.21.15.78:0/4016339419 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4940ba850 con 0x7fd49406c250 2023-06-02T15:31:35.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.914+0000 7fd49917a640 1 --2- 172.21.15.78:0/4016339419 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 0x7fd4940718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:35.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49997b640 1 --2- 172.21.15.78:0/4016339419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 0x7fd494149660 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009d90 tx=0x7fd48c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b6f0ad660a69bf3 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd48bfff640 1 -- 172.21.15.78:0/4016339419 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0a5860 con 0x7fd49406c250 2023-06-02T15:31:35.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd48bfff640 1 -- 172.21.15.78:0/4016339419 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd48c0a59c0 con 0x7fd49406c250 2023-06-02T15:31:35.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd48bfff640 1 -- 172.21.15.78:0/4016339419 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48c0a5d50 con 0x7fd49406c250 2023-06-02T15:31:35.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 -- 172.21.15.78:0/4016339419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 msgr2=0x7fd494149660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 --2- 172.21.15.78:0/4016339419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 0x7fd494149660 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd48c009d90 tx=0x7fd48c01c890 comp rx=0 tx=0).stop 2023-06-02T15:31:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 -- 172.21.15.78:0/4016339419 shutdown_connections 2023-06-02T15:31:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 --2- 172.21.15.78:0/4016339419 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 0x7fd494149660 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 --2- 172.21.15.78:0/4016339419 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 0x7fd4940718d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 -- 172.21.15.78:0/4016339419 >> 172.21.15.78:0/4016339419 conn(0x7fd4940a2170 msgr2=0x7fd4940a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:35.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 -- 172.21.15.78:0/4016339419 shutdown_connections 2023-06-02T15:31:35.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 -- 172.21.15.78:0/4016339419 wait complete. 2023-06-02T15:31:35.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 Processor -- start 2023-06-02T15:31:35.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 -- start start 2023-06-02T15:31:35.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 0x7fd494145880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd49406cfc0 0x7fd49414eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 0x7fd4940bdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941e7880 con 0x7fd49406c250 2023-06-02T15:31:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4941e7510 con 0x7fd49406cfc0 2023-06-02T15:31:35.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49b3de640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd49414b520 con 0x7fd4940a59e0 2023-06-02T15:31:35.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49917a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 0x7fd494145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49917a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 0x7fd494145880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47778/0 (socket says 172.21.15.78:47778) 2023-06-02T15:31:35.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd49917a640 1 -- 172.21.15.78:0/963941646 learned_addr learned my addr 172.21.15.78:0/963941646 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:35.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.918+0000 7fd498979640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd49406cfc0 0x7fd49414eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49997b640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 0x7fd4940bdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49917a640 1 -- 172.21.15.78:0/963941646 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 msgr2=0x7fd4940bdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49917a640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 0x7fd4940bdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49917a640 1 -- 172.21.15.78:0/963941646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd49406cfc0 msgr2=0x7fd49414eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:35.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49917a640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd49406cfc0 0x7fd49414eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:35.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49917a640 1 -- 172.21.15.78:0/963941646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd48c009a70 con 0x7fd49406c250 2023-06-02T15:31:35.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49997b640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 0x7fd4940bdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:35.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49917a640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 0x7fd494145880 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd48400c7f0 tx=0x7fd48400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd489ffb640 1 -- 172.21.15.78:0/963941646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd48400cea0 con 0x7fd49406c250 2023-06-02T15:31:35.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd489ffb640 1 -- 172.21.15.78:0/963941646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd484007a30 con 0x7fd49406c250 2023-06-02T15:31:35.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49b3de640 1 -- 172.21.15.78:0/963941646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4940a5f40 con 0x7fd49406c250 2023-06-02T15:31:35.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd489ffb640 1 -- 172.21.15.78:0/963941646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd484007de0 con 0x7fd49406c250 2023-06-02T15:31:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49b3de640 1 -- 172.21.15.78:0/963941646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4940a5db0 con 0x7fd49406c250 2023-06-02T15:31:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd49b3de640 1 -- 172.21.15.78:0/963941646 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4941593f0 con 0x7fd49406c250 2023-06-02T15:31:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd489ffb640 1 -- 172.21.15.78:0/963941646 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fd4840113f0 con 0x7fd49406c250 2023-06-02T15:31:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd489ffb640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd478065c00 0x7fd4780680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:35.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd489ffb640 1 -- 172.21.15.78:0/963941646 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd484083740 con 0x7fd49406c250 2023-06-02T15:31:35.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd498979640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd478065c00 0x7fd4780680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:35.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.922+0000 7fd498979640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd478065c00 0x7fd4780680b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd49414fef0 tx=0x7fd490007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:35.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:35.926+0000 7fd489ffb640 1 -- 172.21.15.78:0/963941646 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fd484050c70 con 0x7fd49406c250 2023-06-02T15:31:36.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.066+0000 7fd49b3de640 1 -- 172.21.15.78:0/963941646 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd494073bc0 con 0x7fd478065c00 2023-06-02T15:31:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.066+0000 7fd489ffb640 1 -- 172.21.15.78:0/963941646 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd494073bc0 con 0x7fd478065c00 2023-06-02T15:31:36.076 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2023-06-02T15:31:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 -- 172.21.15.78:0/963941646 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd478065c00 msgr2=0x7fd4780680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd478065c00 0x7fd4780680b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd49414fef0 tx=0x7fd490007c10 comp rx=0 tx=0).stop 2023-06-02T15:31:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 -- 172.21.15.78:0/963941646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 msgr2=0x7fd494145880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 0x7fd494145880 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd48400c7f0 tx=0x7fd48400ccb0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 -- 172.21.15.78:0/963941646 shutdown_connections 2023-06-02T15:31:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd4940a59e0 0x7fd4940bdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd49406cfc0 0x7fd49414eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd478065c00 0x7fd4780680b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 --2- 172.21.15.78:0/963941646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd49406c250 0x7fd494145880 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 -- 172.21.15.78:0/963941646 >> 172.21.15.78:0/963941646 conn(0x7fd4940a2170 msgr2=0x7fd494148730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 -- 172.21.15.78:0/963941646 shutdown_connections 2023-06-02T15:31:36.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.070+0000 7fd49b3de640 1 -- 172.21.15.78:0/963941646 wait complete. 2023-06-02T15:31:36.092 INFO:tasks.ceph:Scrubbing osd.3 2023-06-02T15:31:36.093 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-06-02T15:31:36.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19f5537640 1 Processor -- start 2023-06-02T15:31:36.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19f5537640 1 -- start start 2023-06-02T15:31:36.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19f5537640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19f0148b20 0x7f19f00bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19f5537640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f014e8a0 0x7f19f00a4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19f5537640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19f006cae0 con 0x7f19f00bc4a0 2023-06-02T15:31:36.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19f5537640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19f014f7f0 con 0x7f19f0148b20 2023-06-02T15:31:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19f5537640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00a3c60 con 0x7f19f014e8a0 2023-06-02T15:31:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19eeffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19f0148b20 0x7f19f00bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19eeffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19f0148b20 0x7f19f00bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47780/0 (socket says 172.21.15.78:47780) 2023-06-02T15:31:36.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19eeffd640 1 -- 172.21.15.78:0/1577073530 learned_addr learned my addr 172.21.15.78:0/1577073530 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19ef7fe640 1 --2- 172.21.15.78:0/1577073530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f014e8a0 0x7f19f00a4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2643483011 0 0) 0x7f19f006cae0 con 0x7f19f00bc4a0 2023-06-02T15:31:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19d8003530 con 0x7f19f00bc4a0 2023-06-02T15:31:36.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2618062896 0 0) 0x7f19d8003530 con 0x7f19f00bc4a0 2023-06-02T15:31:36.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f014e8a0 msgr2=0x7f19f00a4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 --2- 172.21.15.78:0/1577073530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f014e8a0 0x7f19f00a4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 >> v2:172.21.15.78:3300/0 conn(0x7f19f0148b20 msgr2=0x7f19f00bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 --2- 172.21.15.78:0/1577073530 >> v2:172.21.15.78:3300/0 conn(0x7f19f0148b20 0x7f19f00bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f006c1b0 con 0x7f19f00bc4a0 2023-06-02T15:31:36.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f19e4001680 con 0x7f19f00bc4a0 2023-06-02T15:31:36.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19eeffd640 1 --2- 172.21.15.78:0/1577073530 >> v2:172.21.15.78:3300/0 conn(0x7f19f0148b20 0x7f19f00bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-06-02T15:31:36.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 >> v1:172.21.15.78:6789/0 conn(0x7f19f00bc4a0 legacy=0x7f19f00a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 --2- 172.21.15.78:0/1577073530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19d8003980 0x7f19d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 --2- 172.21.15.78:0/1577073530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19d80047d0 0x7f19d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 --2- 172.21.15.78:0/1577073530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f014e8a0 0x7f19d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f014f7f0 con 0x7f19d8003980 2023-06-02T15:31:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f00a3c60 con 0x7f19d80047d0 2023-06-02T15:31:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d800b990 con 0x7f19f014e8a0 2023-06-02T15:31:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19eeffd640 1 --2- 172.21.15.78:0/1577073530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19d8003980 0x7f19d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19eeffd640 1 -- 172.21.15.78:0/1577073530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f014e8a0 msgr2=0x7f19d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19eeffd640 1 --2- 172.21.15.78:0/1577073530 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f014e8a0 0x7f19d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19eeffd640 1 -- 172.21.15.78:0/1577073530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19d80047d0 msgr2=0x7f19d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19eeffd640 1 --2- 172.21.15.78:0/1577073530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19d80047d0 0x7f19d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.198+0000 7f19eeffd640 1 -- 172.21.15.78:0/1577073530 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d8003530 con 0x7f19d8003980 2023-06-02T15:31:36.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19eeffd640 1 --2- 172.21.15.78:0/1577073530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19d8003980 0x7f19d8003d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009d90 tx=0x7f19e001cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2933640235089c23 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00a57b0 con 0x7f19d8003980 2023-06-02T15:31:36.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e00a5910 con 0x7f19d8003980 2023-06-02T15:31:36.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19edffb640 1 -- 172.21.15.78:0/1577073530 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e00a5cc0 con 0x7f19d8003980 2023-06-02T15:31:36.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- 172.21.15.78:0/1577073530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19d8003980 msgr2=0x7f19d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 --2- 172.21.15.78:0/1577073530 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19d8003980 0x7f19d8003d90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009d90 tx=0x7f19e001cd10 comp rx=0 tx=0).stop 2023-06-02T15:31:36.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ef7fe640 1 -- 172.21.15.78:0/1577073530 reap_dead start 2023-06-02T15:31:36.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- 172.21.15.78:0/1577073530 shutdown_connections 2023-06-02T15:31:36.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- 172.21.15.78:0/1577073530 >> 172.21.15.78:0/1577073530 conn(0x7f19f00c04d0 msgr2=0x7f19f00c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:36.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- 172.21.15.78:0/1577073530 shutdown_connections 2023-06-02T15:31:36.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- 172.21.15.78:0/1577073530 wait complete. 2023-06-02T15:31:36.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 Processor -- start 2023-06-02T15:31:36.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- start start 2023-06-02T15:31:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19f014d710 0x7f19f01e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f01e8bb0 0x7f19f0150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f0150d50 0x7f19f0139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f01e90d0 con 0x7f19f0150d50 2023-06-02T15:31:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19f0150380 con 0x7f19f014d710 2023-06-02T15:31:36.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19f014fd30 con 0x7f19f01e8bb0 2023-06-02T15:31:36.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f0150d50 0x7f19f0139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ef7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f0150d50 0x7f19f0139a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47798/0 (socket says 172.21.15.78:47798) 2023-06-02T15:31:36.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ef7fe640 1 -- 172.21.15.78:0/3112240382 learned_addr learned my addr 172.21.15.78:0/3112240382 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:36.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19eeffd640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19f014d710 0x7f19f01e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ee7fc640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f01e8bb0 0x7f19f0150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ef7fe640 1 -- 172.21.15.78:0/3112240382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f01e8bb0 msgr2=0x7f19f0150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ef7fe640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f19f01e8bb0 0x7f19f0150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ef7fe640 1 -- 172.21.15.78:0/3112240382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19f014d710 msgr2=0x7f19f01e60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ef7fe640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19f014d710 0x7f19f01e60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ef7fe640 1 -- 172.21.15.78:0/3112240382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f006cf50 con 0x7f19f0150d50 2023-06-02T15:31:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19ef7fe640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f0150d50 0x7f19f0139a30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f19f00a62a0 tx=0x7f19e800ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19d77fe640 1 -- 172.21.15.78:0/3112240382 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8010040 con 0x7f19f0150d50 2023-06-02T15:31:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19d77fe640 1 -- 172.21.15.78:0/3112240382 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e8003ba0 con 0x7f19f0150d50 2023-06-02T15:31:36.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19d77fe640 1 -- 172.21.15.78:0/3112240382 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e8004030 con 0x7f19f0150d50 2023-06-02T15:31:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f00a64e0 con 0x7f19f0150d50 2023-06-02T15:31:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.202+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f0156440 con 0x7f19f0150d50 2023-06-02T15:31:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19f004dd40 con 0x7f19f0150d50 2023-06-02T15:31:36.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19d77fe640 1 -- 172.21.15.78:0/3112240382 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f19e8004190 con 0x7f19f0150d50 2023-06-02T15:31:36.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19d77fe640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f19dc065c30 0x7f19dc0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19d77fe640 1 -- 172.21.15.78:0/3112240382 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f19e8083f70 con 0x7f19f0150d50 2023-06-02T15:31:36.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19eeffd640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f19dc065c30 0x7f19dc0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19d77fe640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] conn(0x7f19dc06f940 0x7f19dc071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19d77fe640 1 -- 172.21.15.78:0/3112240382 --> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19dc072480 con 0x7f19dc06f940 2023-06-02T15:31:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19d77fe640 1 -- 172.21.15.78:0/3112240382 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19e80842e0 con 0x7f19f0150d50 2023-06-02T15:31:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19ee7fc640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] conn(0x7f19dc06f940 0x7f19dc071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19eeffd640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f19dc065c30 0x7f19dc0680e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f19e00af000 tx=0x7f19e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19ee7fc640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] conn(0x7f19dc06f940 0x7f19dc071db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.206+0000 7f19d77fe640 1 -- 172.21.15.78:0/3112240382 <== osd.3 v2:172.21.15.78:6808/37137 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f19dc072480 con 0x7f19dc06f940 2023-06-02T15:31:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 --> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f19f00a3980 con 0x7f19dc06f940 2023-06-02T15:31:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19d77fe640 1 -- 172.21.15.78:0/3112240382 <== osd.3 v2:172.21.15.78:6808/37137 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f19f00a3980 con 0x7f19dc06f940 2023-06-02T15:31:36.230 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-02T15:31:36.230 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-02T15:31:36.230 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-02T15:31:36.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] conn(0x7f19dc06f940 msgr2=0x7f19dc071db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:6808/37137,v1:172.21.15.78:6809/37137] conn(0x7f19dc06f940 0x7f19dc071db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f19dc065c30 msgr2=0x7f19dc0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f19dc065c30 0x7f19dc0680e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f19e00af000 tx=0x7f19e0008040 comp rx=0 tx=0).stop 2023-06-02T15:31:36.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f0150d50 msgr2=0x7f19f0139a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 --2- 172.21.15.78:0/3112240382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19f0150d50 0x7f19f0139a30 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f19f00a62a0 tx=0x7f19e800ede0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19ef7fe640 1 -- 172.21.15.78:0/3112240382 reap_dead start 2023-06-02T15:31:36.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 shutdown_connections 2023-06-02T15:31:36.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 >> 172.21.15.78:0/3112240382 conn(0x7f19f00c04d0 msgr2=0x7f19f0153220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:36.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 shutdown_connections 2023-06-02T15:31:36.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.218+0000 7f19f5537640 1 -- 172.21.15.78:0/3112240382 wait complete. 2023-06-02T15:31:36.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-06-02T15:31:36.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe16611d640 1 Processor -- start 2023-06-02T15:31:36.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe16611d640 1 -- start start 2023-06-02T15:31:36.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe16611d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe16006cfc0 0x7fe1600718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe16611d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe16014d220 con 0x7fe16006c250 2023-06-02T15:31:36.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe16611d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1600ba850 con 0x7fe1600a59e0 2023-06-02T15:31:36.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe16611d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1600ba640 con 0x7fe16006cfc0 2023-06-02T15:31:36.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe15effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe16006cfc0 0x7fe1600718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe15ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe16006c250 0x7fe160149660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45502/0 (socket says 172.21.15.78:45502) 2023-06-02T15:31:36.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe15effd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe16006cfc0 0x7fe1600718d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47804/0 (socket says 172.21.15.78:47804) 2023-06-02T15:31:36.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe15effd640 1 -- 172.21.15.78:0/1634952499 learned_addr learned my addr 172.21.15.78:0/1634952499 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:36.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe15effd640 1 -- 172.21.15.78:0/1634952499 >> v1:172.21.15.132:6789/0 conn(0x7fe1600a59e0 legacy=0x7fe16014f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:36.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe15effd640 1 -- 172.21.15.78:0/1634952499 >> v1:172.21.15.78:6789/0 conn(0x7fe16006c250 legacy=0x7fe160149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.346+0000 7fe15effd640 1 -- 172.21.15.78:0/1634952499 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe16014cf40 con 0x7fe16006cfc0 2023-06-02T15:31:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe15effd640 1 --2- 172.21.15.78:0/1634952499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16006cfc0 0x7fe1600718d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe154009870 tx=0x7fe15401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e87553ab3bd4c07 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe15e7fc640 1 -- 172.21.15.78:0/1634952499 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1540ad680 con 0x7fe16006cfc0 2023-06-02T15:31:36.360 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe15e7fc640 1 -- 172.21.15.78:0/1634952499 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1540ad7e0 con 0x7fe16006cfc0 2023-06-02T15:31:36.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe15e7fc640 1 -- 172.21.15.78:0/1634952499 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1540adb70 con 0x7fe16006cfc0 2023-06-02T15:31:36.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe16611d640 1 -- 172.21.15.78:0/1634952499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16006cfc0 msgr2=0x7fe1600718d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe16611d640 1 --2- 172.21.15.78:0/1634952499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16006cfc0 0x7fe1600718d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe154009870 tx=0x7fe15401c470 comp rx=0 tx=0).stop 2023-06-02T15:31:36.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe16611d640 1 -- 172.21.15.78:0/1634952499 shutdown_connections 2023-06-02T15:31:36.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe16611d640 1 --2- 172.21.15.78:0/1634952499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe16006cfc0 0x7fe1600718d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe16611d640 1 -- 172.21.15.78:0/1634952499 >> 172.21.15.78:0/1634952499 conn(0x7fe1600a2170 msgr2=0x7fe1600a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:36.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe16611d640 1 -- 172.21.15.78:0/1634952499 shutdown_connections 2023-06-02T15:31:36.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe16611d640 1 -- 172.21.15.78:0/1634952499 wait complete. 2023-06-02T15:31:36.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe16611d640 1 Processor -- start 2023-06-02T15:31:36.363 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe16611d640 1 -- start start 2023-06-02T15:31:36.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.350+0000 7fe16611d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe16006c250 0x7fe1601e7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe16611d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe16006cfc0 0x7fe160141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.366 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe16611d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1600a59e0 0x7fe1601465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe16611d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1601475c0 con 0x7fe1600a59e0 2023-06-02T15:31:36.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe16611d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe16014f850 con 0x7fe16006cfc0 2023-06-02T15:31:36.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe16611d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe160147270 con 0x7fe16006c250 2023-06-02T15:31:36.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1600a59e0 0x7fe1601465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1600a59e0 0x7fe1601465f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47814/0 (socket says 172.21.15.78:47814) 2023-06-02T15:31:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15ffff640 1 -- 172.21.15.78:0/2677563817 learned_addr learned my addr 172.21.15.78:0/2677563817 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15effd640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe16006cfc0 0x7fe160141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.369 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15f7fe640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe16006c250 0x7fe1601e7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15ffff640 1 -- 172.21.15.78:0/2677563817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe16006c250 msgr2=0x7fe1601e7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15ffff640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe16006c250 0x7fe1601e7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15ffff640 1 -- 172.21.15.78:0/2677563817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe16006cfc0 msgr2=0x7fe160141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15ffff640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe16006cfc0 0x7fe160141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15ffff640 1 -- 172.21.15.78:0/2677563817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1540094d0 con 0x7fe1600a59e0 2023-06-02T15:31:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15effd640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe16006cfc0 0x7fe160141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:36.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15ffff640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1600a59e0 0x7fe1601465f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe15000c3c0 tx=0x7fe15000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe147fff640 1 -- 172.21.15.78:0/2677563817 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1500074e0 con 0x7fe1600a59e0 2023-06-02T15:31:36.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe147fff640 1 -- 172.21.15.78:0/2677563817 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe150007640 con 0x7fe1600a59e0 2023-06-02T15:31:36.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe16611d640 1 -- 172.21.15.78:0/2677563817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe160149f00 con 0x7fe1600a59e0 2023-06-02T15:31:36.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe147fff640 1 -- 172.21.15.78:0/2677563817 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150004a10 con 0x7fe1600a59e0 2023-06-02T15:31:36.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe16611d640 1 -- 172.21.15.78:0/2677563817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe160149d70 con 0x7fe1600a59e0 2023-06-02T15:31:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe147fff640 1 -- 172.21.15.78:0/2677563817 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fe150004b70 con 0x7fe1600a59e0 2023-06-02T15:31:36.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe16611d640 1 -- 172.21.15.78:0/2677563817 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe16015a400 con 0x7fe1600a59e0 2023-06-02T15:31:36.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe147fff640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe14c065c00 0x7fe14c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe147fff640 1 -- 172.21.15.78:0/2677563817 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe150083060 con 0x7fe1600a59e0 2023-06-02T15:31:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15f7fe640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe14c065c00 0x7fe14c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.354+0000 7fe15f7fe640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe14c065c00 0x7fe14c0680b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe160070640 tx=0x7fe158009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.358+0000 7fe147fff640 1 -- 172.21.15.78:0/2677563817 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fe1500504f0 con 0x7fe1600a59e0 2023-06-02T15:31:36.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.506+0000 7fe16611d640 1 -- 172.21.15.78:0/2677563817 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fe160073bc0 con 0x7fe14c065c00 2023-06-02T15:31:36.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe147fff640 1 -- 172.21.15.78:0/2677563817 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe160073bc0 con 0x7fe14c065c00 2023-06-02T15:31:36.517 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2023-06-02T15:31:36.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 -- 172.21.15.78:0/2677563817 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe14c065c00 msgr2=0x7fe14c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe14c065c00 0x7fe14c0680b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe160070640 tx=0x7fe158009040 comp rx=0 tx=0).stop 2023-06-02T15:31:36.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 -- 172.21.15.78:0/2677563817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1600a59e0 msgr2=0x7fe1601465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1600a59e0 0x7fe1601465f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe15000c3c0 tx=0x7fe15000c880 comp rx=0 tx=0).stop 2023-06-02T15:31:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 -- 172.21.15.78:0/2677563817 shutdown_connections 2023-06-02T15:31:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe14c065c00 0x7fe14c0680b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1600a59e0 0x7fe1601465f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe16006cfc0 0x7fe160141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 --2- 172.21.15.78:0/2677563817 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe16006c250 0x7fe1601e7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 -- 172.21.15.78:0/2677563817 >> 172.21.15.78:0/2677563817 conn(0x7fe1600a2170 msgr2=0x7fe160071880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 -- 172.21.15.78:0/2677563817 shutdown_connections 2023-06-02T15:31:36.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.510+0000 7fe16611d640 1 -- 172.21.15.78:0/2677563817 wait complete. 2023-06-02T15:31:36.535 INFO:tasks.ceph:Scrubbing osd.4 2023-06-02T15:31:36.535 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-06-02T15:31:36.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f600ba05640 1 Processor -- start 2023-06-02T15:31:36.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f600ba05640 1 -- start start 2023-06-02T15:31:36.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f600ba05640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6004149d90 0x7f60041504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f600ba05640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f60040bbc10 0x7f60040a3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f600ba05640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6004150a20 con 0x7f60040baed0 2023-06-02T15:31:36.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f600ba05640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60040bc080 con 0x7f60040bbc10 2023-06-02T15:31:36.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f600ba05640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040a3b40 con 0x7f6004149d90 2023-06-02T15:31:36.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f6008fa0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f60040bbc10 0x7f60040a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f6008fa0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f60040bbc10 0x7f60040a3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47820/0 (socket says 172.21.15.78:47820) 2023-06-02T15:31:36.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f6009fa2640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f60040baed0 0x7f60040a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45516/0 (socket says 172.21.15.78:45516) 2023-06-02T15:31:36.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f6008fa0640 1 -- 172.21.15.78:0/2047893926 learned_addr learned my addr 172.21.15.78:0/2047893926 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:36.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f6008fa0640 1 -- 172.21.15.78:0/2047893926 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6004149d90 msgr2=0x7f60041504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:36.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f6008fa0640 1 --2- 172.21.15.78:0/2047893926 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6004149d90 0x7f60041504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f6008fa0640 1 -- 172.21.15.78:0/2047893926 >> v1:172.21.15.78:6789/0 conn(0x7f60040baed0 legacy=0x7f60040a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.642+0000 7f6008fa0640 1 -- 172.21.15.78:0/2047893926 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60040bcd60 con 0x7f60040bbc10 2023-06-02T15:31:36.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f6008fa0640 1 --2- 172.21.15.78:0/2047893926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60040bbc10 0x7f60040a3600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6000009870 tx=0x7f600001ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a60d983cf4d7f027 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f5ffbfff640 1 -- 172.21.15.78:0/2047893926 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60000a8a30 con 0x7f60040bbc10 2023-06-02T15:31:36.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f5ffbfff640 1 -- 172.21.15.78:0/2047893926 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60000a8b90 con 0x7f60040bbc10 2023-06-02T15:31:36.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f5ffbfff640 1 -- 172.21.15.78:0/2047893926 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60000b0440 con 0x7f60040bbc10 2023-06-02T15:31:36.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- 172.21.15.78:0/2047893926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60040bbc10 msgr2=0x7f60040a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 --2- 172.21.15.78:0/2047893926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60040bbc10 0x7f60040a3600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6000009870 tx=0x7f600001ed30 comp rx=0 tx=0).stop 2023-06-02T15:31:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- 172.21.15.78:0/2047893926 shutdown_connections 2023-06-02T15:31:36.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 --2- 172.21.15.78:0/2047893926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60040bbc10 0x7f60040a3600 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 --2- 172.21.15.78:0/2047893926 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6004149d90 0x7f60041504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- 172.21.15.78:0/2047893926 >> 172.21.15.78:0/2047893926 conn(0x7f60040c04d0 msgr2=0x7f60040c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- 172.21.15.78:0/2047893926 shutdown_connections 2023-06-02T15:31:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- 172.21.15.78:0/2047893926 wait complete. 2023-06-02T15:31:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 Processor -- start 2023-06-02T15:31:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- start start 2023-06-02T15:31:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60040baed0 0x7f600414eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60040bbc10 0x7f60041e1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6004149d90 0x7f60041e1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600414fe70 con 0x7f60040baed0 2023-06-02T15:31:36.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6004070f10 con 0x7f60040bbc10 2023-06-02T15:31:36.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60041e5ad0 con 0x7f6004149d90 2023-06-02T15:31:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f60097a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60040baed0 0x7f600414eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f60097a1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60040baed0 0x7f600414eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47824/0 (socket says 172.21.15.78:47824) 2023-06-02T15:31:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f60097a1640 1 -- 172.21.15.78:0/1046349126 learned_addr learned my addr 172.21.15.78:0/1046349126 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f60097a1640 1 -- 172.21.15.78:0/1046349126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6004149d90 msgr2=0x7f60041e1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f60097a1640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6004149d90 0x7f60041e1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f60097a1640 1 -- 172.21.15.78:0/1046349126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60040bbc10 msgr2=0x7f60041e1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f60097a1640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60040bbc10 0x7f60041e1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f60097a1640 1 -- 172.21.15.78:0/1046349126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60000094d0 con 0x7f60040baed0 2023-06-02T15:31:36.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f60097a1640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60040baed0 0x7f600414eaf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400b410 tx=0x7f5ff400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f5ff9ffb640 1 -- 172.21.15.78:0/1046349126 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4011830 con 0x7f60040baed0 2023-06-02T15:31:36.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f5ff9ffb640 1 -- 172.21.15.78:0/1046349126 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff4011990 con 0x7f60040baed0 2023-06-02T15:31:36.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60040bc6d0 con 0x7f60040baed0 2023-06-02T15:31:36.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f5ff9ffb640 1 -- 172.21.15.78:0/1046349126 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4011d40 con 0x7f60040baed0 2023-06-02T15:31:36.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.646+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600414a160 con 0x7f60040baed0 2023-06-02T15:31:36.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f60040bc290 con 0x7f60040baed0 2023-06-02T15:31:36.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f5ff9ffb640 1 -- 172.21.15.78:0/1046349126 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f5ff401a400 con 0x7f60040baed0 2023-06-02T15:31:36.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f5ff9ffb640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5fe8065c30 0x7f5fe80680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f6008fa0640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5fe8065c30 0x7f5fe80680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f5ff9ffb640 1 -- 172.21.15.78:0/1046349126 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5ff4083f40 con 0x7f60040baed0 2023-06-02T15:31:36.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f5ff9ffb640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] conn(0x7f5fe806f940 0x7f5fe8071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f5ff9ffb640 1 -- 172.21.15.78:0/1046349126 --> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fe8072480 con 0x7f5fe806f940 2023-06-02T15:31:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f5ff9ffb640 1 -- 172.21.15.78:0/1046349126 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ff4084390 con 0x7f60040baed0 2023-06-02T15:31:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f6008fa0640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5fe8065c30 0x7f5fe80680e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f60000b2000 tx=0x7f6000004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f6009fa2640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] conn(0x7f5fe806f940 0x7f5fe8071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.650+0000 7f6009fa2640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] conn(0x7f5fe806f940 0x7f5fe8071db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.654+0000 7f5ff9ffb640 1 -- 172.21.15.78:0/1046349126 <== osd.4 v2:172.21.15.132:6816/37342 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5fe8072480 con 0x7f5fe806f940 2023-06-02T15:31:36.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 --> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f600404dd40 con 0x7f5fe806f940 2023-06-02T15:31:36.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f5ff9ffb640 1 -- 172.21.15.78:0/1046349126 <== osd.4 v2:172.21.15.132:6816/37342 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f600404dd40 con 0x7f5fe806f940 2023-06-02T15:31:36.675 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-02T15:31:36.675 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-02T15:31:36.676 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-02T15:31:36.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 >> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] conn(0x7f5fe806f940 msgr2=0x7f5fe8071db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.132:6816/37342,v1:172.21.15.132:6817/37342] conn(0x7f5fe806f940 0x7f5fe8071db0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5fe8065c30 msgr2=0x7f5fe80680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f5fe8065c30 0x7f5fe80680e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f60000b2000 tx=0x7f6000004740 comp rx=0 tx=0).stop 2023-06-02T15:31:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60040baed0 msgr2=0x7f600414eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 --2- 172.21.15.78:0/1046349126 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f60040baed0 0x7f600414eaf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400b410 tx=0x7f5ff400b8d0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f6009fa2640 1 -- 172.21.15.78:0/1046349126 reap_dead start 2023-06-02T15:31:36.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 shutdown_connections 2023-06-02T15:31:36.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 >> 172.21.15.78:0/1046349126 conn(0x7f60040c04d0 msgr2=0x7f600406c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:36.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 shutdown_connections 2023-06-02T15:31:36.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.666+0000 7f600ba05640 1 -- 172.21.15.78:0/1046349126 wait complete. 2023-06-02T15:31:36.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-06-02T15:31:36.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f47203df640 1 Processor -- start 2023-06-02T15:31:36.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f47203df640 1 -- start start 2023-06-02T15:31:36.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f47203df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47180c0570 0x7f47180ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f47203df640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f47181485c0 0x7f4718148a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f47203df640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47180a5f30 con 0x7f4718071780 2023-06-02T15:31:36.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f47203df640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47180c1100 con 0x7f47181485c0 2023-06-02T15:31:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f47203df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471814bcc0 con 0x7f47180c0570 2023-06-02T15:31:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d97a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4718071780 0x7f47180bc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45522/0 (socket says 172.21.15.78:45522) 2023-06-02T15:31:36.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d97a640 1 -- 172.21.15.78:0/317239999 learned_addr learned my addr 172.21.15.78:0/317239999 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769350402 0 0) 0x7f47180a5f30 con 0x7f4718071780 2023-06-02T15:31:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4704003530 con 0x7f4718071780 2023-06-02T15:31:36.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471e17b640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47180c0570 0x7f47180ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471e97c640 1 --2- 172.21.15.78:0/317239999 >> v2:172.21.15.132:3300/0 conn(0x7f47181485c0 0x7f4718148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1539536980 0 0) 0x7f4704003530 con 0x7f4718071780 2023-06-02T15:31:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47180c0570 msgr2=0x7f47180ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47180c0570 0x7f47180ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 >> v2:172.21.15.132:3300/0 conn(0x7f47181485c0 msgr2=0x7f4718148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 --2- 172.21.15.78:0/317239999 >> v2:172.21.15.132:3300/0 conn(0x7f47181485c0 0x7f4718148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f471814bfa0 con 0x7f4718071780 2023-06-02T15:31:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f4714001680 con 0x7f4718071780 2023-06-02T15:31:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 >> v1:172.21.15.78:6789/0 conn(0x7f4718071780 legacy=0x7f47180bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47180c0570 0x7f47040039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4704004020 0x7f47040047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4704004d10 0x7f4704005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471814bcc0 con 0x7f4704004020 2023-06-02T15:31:36.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470400dd30 con 0x7f4704004d10 2023-06-02T15:31:36.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470400def0 con 0x7f47180c0570 2023-06-02T15:31:36.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d97a640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4704004020 0x7f47040047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471e17b640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47180c0570 0x7f47040039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471e97c640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4704004d10 0x7f4704005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d97a640 1 -- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47180c0570 msgr2=0x7f47040039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:36.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d97a640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47180c0570 0x7f47040039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d97a640 1 -- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4704004d10 msgr2=0x7f4704005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:36.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d97a640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4704004d10 0x7f4704005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471d97a640 1 -- 172.21.15.78:0/317239999 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4704003530 con 0x7f4704004020 2023-06-02T15:31:36.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471e97c640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4704004d10 0x7f4704005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:36.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.794+0000 7f471e17b640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47180c0570 0x7f47040039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:36.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d97a640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4704004020 0x7f47040047d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f471400c1c0 tx=0x7f471401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4eae2547de029a server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714005ae0 con 0x7f4704004020 2023-06-02T15:31:36.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4714005c40 con 0x7f4704004020 2023-06-02T15:31:36.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d179640 1 -- 172.21.15.78:0/317239999 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140072b0 con 0x7f4704004020 2023-06-02T15:31:36.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- 172.21.15.78:0/317239999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4704004020 msgr2=0x7f47040047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 --2- 172.21.15.78:0/317239999 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4704004020 0x7f47040047d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f471400c1c0 tx=0x7f471401cc20 comp rx=0 tx=0).stop 2023-06-02T15:31:36.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471e97c640 1 -- 172.21.15.78:0/317239999 reap_dead start 2023-06-02T15:31:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- 172.21.15.78:0/317239999 shutdown_connections 2023-06-02T15:31:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- 172.21.15.78:0/317239999 >> 172.21.15.78:0/317239999 conn(0x7f47180a2170 msgr2=0x7f47180a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- 172.21.15.78:0/317239999 shutdown_connections 2023-06-02T15:31:36.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- 172.21.15.78:0/317239999 wait complete. 2023-06-02T15:31:36.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 Processor -- start 2023-06-02T15:31:36.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- start start 2023-06-02T15:31:36.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47180b97f0 0x7f47180b9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47180bfb60 0x7f47181e08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47181e0df0 0x7f47181e6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471814d210 con 0x7f47180bfb60 2023-06-02T15:31:36.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47181ea760 con 0x7f47180b97f0 2023-06-02T15:31:36.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47181eaa40 con 0x7f47181e0df0 2023-06-02T15:31:36.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d97a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47180bfb60 0x7f47181e08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d97a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47180bfb60 0x7f47181e08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47846/0 (socket says 172.21.15.78:47846) 2023-06-02T15:31:36.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d97a640 1 -- 172.21.15.78:0/2317290576 learned_addr learned my addr 172.21.15.78:0/2317290576 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471e17b640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47180b97f0 0x7f47180b9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d97a640 1 -- 172.21.15.78:0/2317290576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47181e0df0 msgr2=0x7f47181e6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471e97c640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47181e0df0 0x7f47181e6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d97a640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47181e0df0 0x7f47181e6e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d97a640 1 -- 172.21.15.78:0/2317290576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47180b97f0 msgr2=0x7f47180b9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d97a640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47180b97f0 0x7f47180b9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d97a640 1 -- 172.21.15.78:0/2317290576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47180c0ad0 con 0x7f47180bfb60 2023-06-02T15:31:36.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471e17b640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47180b97f0 0x7f47180b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:36.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f471d97a640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47180bfb60 0x7f47181e08b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f471400c1c0 tx=0x7f4704005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f470effd640 1 -- 172.21.15.78:0/2317290576 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47140b4070 con 0x7f47180bfb60 2023-06-02T15:31:36.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f470effd640 1 -- 172.21.15.78:0/2317290576 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4714000ee0 con 0x7f47180bfb60 2023-06-02T15:31:36.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- 172.21.15.78:0/2317290576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47180c0940 con 0x7f47180bfb60 2023-06-02T15:31:36.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f470effd640 1 -- 172.21.15.78:0/2317290576 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4714001640 con 0x7f47180bfb60 2023-06-02T15:31:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.798+0000 7f47203df640 1 -- 172.21.15.78:0/2317290576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f471806c780 con 0x7f47180bfb60 2023-06-02T15:31:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.802+0000 7f47203df640 1 -- 172.21.15.78:0/2317290576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4718073bc0 con 0x7f47180bfb60 2023-06-02T15:31:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.802+0000 7f470effd640 1 -- 172.21.15.78:0/2317290576 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f47140b7070 con 0x7f47180bfb60 2023-06-02T15:31:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.802+0000 7f470effd640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f46fc065c30 0x7f46fc0680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:36.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.802+0000 7f470effd640 1 -- 172.21.15.78:0/2317290576 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f471411cb70 con 0x7f47180bfb60 2023-06-02T15:31:36.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.802+0000 7f471e17b640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f46fc065c30 0x7f46fc0680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:36.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.802+0000 7f471e17b640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f46fc065c30 0x7f46fc0680e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f47080098a0 tx=0x7f4708008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:36.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.806+0000 7f470effd640 1 -- 172.21.15.78:0/2317290576 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f47140e9f80 con 0x7f47180bfb60 2023-06-02T15:31:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.946+0000 7f47203df640 1 -- 172.21.15.78:0/2317290576 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f47180a4710 con 0x7f46fc065c30 2023-06-02T15:31:36.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.946+0000 7f470effd640 1 -- 172.21.15.78:0/2317290576 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f47180a4710 con 0x7f46fc065c30 2023-06-02T15:31:36.958 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2023-06-02T15:31:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 -- 172.21.15.78:0/2317290576 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f46fc065c30 msgr2=0x7f46fc0680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f46fc065c30 0x7f46fc0680e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f47080098a0 tx=0x7f4708008040 comp rx=0 tx=0).stop 2023-06-02T15:31:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 -- 172.21.15.78:0/2317290576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47180bfb60 msgr2=0x7f47181e08b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:36.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47180bfb60 0x7f47181e08b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f471400c1c0 tx=0x7f4704005800 comp rx=0 tx=0).stop 2023-06-02T15:31:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 -- 172.21.15.78:0/2317290576 shutdown_connections 2023-06-02T15:31:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f47181e0df0 0x7f47181e6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f46fc065c30 0x7f46fc0680e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47180bfb60 0x7f47181e08b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 --2- 172.21.15.78:0/2317290576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47180b97f0 0x7f47180b9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 -- 172.21.15.78:0/2317290576 >> 172.21.15.78:0/2317290576 conn(0x7f47180a2170 msgr2=0x7f4718147cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 -- 172.21.15.78:0/2317290576 shutdown_connections 2023-06-02T15:31:36.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:36.950+0000 7f47203df640 1 -- 172.21.15.78:0/2317290576 wait complete. 2023-06-02T15:31:36.973 INFO:tasks.ceph:Scrubbing osd.5 2023-06-02T15:31:36.974 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-06-02T15:31:37.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.090+0000 7f9da69e7640 1 Processor -- start 2023-06-02T15:31:37.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.090+0000 7f9da69e7640 1 -- start start 2023-06-02T15:31:37.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9da69e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9da01488c0 0x7f9da014bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9da69e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da00a3890 0x7f9da00a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9da69e7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da0148c90 con 0x7f9da00bf370 2023-06-02T15:31:37.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9da69e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9da00bc1d0 con 0x7f9da01488c0 2023-06-02T15:31:37.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9da69e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00bff90 con 0x7f9da00a3890 2023-06-02T15:31:37.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9da00bf370 0x7f9da00bf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45526/0 (socket says 172.21.15.78:45526) 2023-06-02T15:31:37.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9f7fe640 1 -- 172.21.15.78:0/3556478127 learned_addr learned my addr 172.21.15.78:0/3556478127 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:37.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9da4f84640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da00a3890 0x7f9da00a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9ffff640 1 --2- 172.21.15.78:0/3556478127 >> v2:172.21.15.132:3300/0 conn(0x7f9da01488c0 0x7f9da014bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1557395202 0 0) 0x7f9da0148c90 con 0x7f9da00bf370 2023-06-02T15:31:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d88003530 con 0x7f9da00bf370 2023-06-02T15:31:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 701293130 0 0) 0x7f9d88003530 con 0x7f9da00bf370 2023-06-02T15:31:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da00a3890 msgr2=0x7f9da00a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da00a3890 0x7f9da00a3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 >> v2:172.21.15.132:3300/0 conn(0x7f9da01488c0 msgr2=0x7f9da014bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 --2- 172.21.15.78:0/3556478127 >> v2:172.21.15.132:3300/0 conn(0x7f9da01488c0 0x7f9da014bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da00bb650 con 0x7f9da00bf370 2023-06-02T15:31:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f9d94001680 con 0x7f9da00bf370 2023-06-02T15:31:37.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 >> v1:172.21.15.78:6789/0 conn(0x7f9da00bf370 legacy=0x7f9da00bf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 0x7f9d88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880047d0 0x7f9d88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da00a3890 0x7f9d88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00bff90 con 0x7f9d88003980 2023-06-02T15:31:37.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8800b990 con 0x7f9d880047d0 2023-06-02T15:31:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8800bad0 con 0x7f9da00a3890 2023-06-02T15:31:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9ffff640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 0x7f9d88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9da4f84640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da00a3890 0x7f9d88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9f7fe640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880047d0 0x7f9d88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9ffff640 1 -- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da00a3890 msgr2=0x7f9d88005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9ffff640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da00a3890 0x7f9d88005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9ffff640 1 -- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880047d0 msgr2=0x7f9d88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9ffff640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880047d0 0x7f9d88004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.094+0000 7f9d9ffff640 1 -- 172.21.15.78:0/3556478127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d88003530 con 0x7f9d88003980 2023-06-02T15:31:37.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9ffff640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 0x7f9d88003d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009b10 tx=0x7f9d9001ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d6e7e9f2cd16e7 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900a6470 con 0x7f9d88003980 2023-06-02T15:31:37.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d900a65d0 con 0x7f9d88003980 2023-06-02T15:31:37.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9effd640 1 -- 172.21.15.78:0/3556478127 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900a6980 con 0x7f9d88003980 2023-06-02T15:31:37.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- 172.21.15.78:0/3556478127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 msgr2=0x7f9d88003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 --2- 172.21.15.78:0/3556478127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 0x7f9d88003d90 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009b10 tx=0x7f9d9001ca90 comp rx=0 tx=0).stop 2023-06-02T15:31:37.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da4f84640 1 -- 172.21.15.78:0/3556478127 reap_dead start 2023-06-02T15:31:37.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- 172.21.15.78:0/3556478127 shutdown_connections 2023-06-02T15:31:37.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- 172.21.15.78:0/3556478127 >> 172.21.15.78:0/3556478127 conn(0x7f9da006b610 msgr2=0x7f9da00a3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:37.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- 172.21.15.78:0/3556478127 shutdown_connections 2023-06-02T15:31:37.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- 172.21.15.78:0/3556478127 wait complete. 2023-06-02T15:31:37.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 Processor -- start 2023-06-02T15:31:37.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- start start 2023-06-02T15:31:37.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 0x7f9da00a4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da01527e0 0x7f9da0145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da014efd0 0x7f9da0142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0152510 con 0x7f9d88003980 2023-06-02T15:31:37.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da01e5530 con 0x7f9da01527e0 2023-06-02T15:31:37.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0145cd0 con 0x7f9da014efd0 2023-06-02T15:31:37.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 0x7f9da00a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 0x7f9da00a4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47864/0 (socket says 172.21.15.78:47864) 2023-06-02T15:31:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9ffff640 1 -- 172.21.15.78:0/3693166694 learned_addr learned my addr 172.21.15.78:0/3693166694 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9f7fe640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da01527e0 0x7f9da0145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9ffff640 1 -- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da014efd0 msgr2=0x7f9da0142240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da4f84640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da014efd0 0x7f9da0142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9ffff640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9da014efd0 0x7f9da0142240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9ffff640 1 -- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da01527e0 msgr2=0x7f9da0145790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9ffff640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da01527e0 0x7f9da0145790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9ffff640 1 -- 172.21.15.78:0/3693166694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da006e560 con 0x7f9d88003980 2023-06-02T15:31:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9f7fe640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9da01527e0 0x7f9da0145790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9ffff640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 0x7f9da00a4480 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9d9001c8c0 tx=0x7f9d88005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9cff9640 1 -- 172.21.15.78:0/3693166694 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900a6dc0 con 0x7f9d88003980 2023-06-02T15:31:37.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9cff9640 1 -- 172.21.15.78:0/3693166694 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d900bc450 con 0x7f9d88003980 2023-06-02T15:31:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da00a7590 con 0x7f9d88003980 2023-06-02T15:31:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9d9cff9640 1 -- 172.21.15.78:0/3693166694 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900bc7e0 con 0x7f9d88003980 2023-06-02T15:31:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.098+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da00a2dc0 con 0x7f9d88003980 2023-06-02T15:31:37.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9da006f240 con 0x7f9d88003980 2023-06-02T15:31:37.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9d9cff9640 1 -- 172.21.15.78:0/3693166694 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f9d900a7450 con 0x7f9d88003980 2023-06-02T15:31:37.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9d9cff9640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9d8c065c00 0x7f9d8c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9d9f7fe640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9d8c065c00 0x7f9d8c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9d9cff9640 1 -- 172.21.15.78:0/3693166694 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9d9011dcb0 con 0x7f9d88003980 2023-06-02T15:31:37.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9d9cff9640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] conn(0x7f9d8c06f910 0x7f9d8c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9d9cff9640 1 -- 172.21.15.78:0/3693166694 --> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9d8c072450 con 0x7f9d8c06f910 2023-06-02T15:31:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9d9cff9640 1 -- 172.21.15.78:0/3693166694 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9d9011e100 con 0x7f9d88003980 2023-06-02T15:31:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9d9f7fe640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9d8c065c00 0x7f9d8c0680b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9d94000c10 tx=0x7f9d94000f60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9da4f84640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] conn(0x7f9d8c06f910 0x7f9d8c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.102+0000 7f9da4f84640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] conn(0x7f9d8c06f910 0x7f9d8c071d80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.106+0000 7f9d9cff9640 1 -- 172.21.15.78:0/3693166694 <== osd.5 v2:172.21.15.132:6808/37340 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f9d8c072450 con 0x7f9d8c06f910 2023-06-02T15:31:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 --> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f9da0151e00 con 0x7f9d8c06f910 2023-06-02T15:31:37.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9d9cff9640 1 -- 172.21.15.78:0/3693166694 <== osd.5 v2:172.21.15.132:6808/37340 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f9da0151e00 con 0x7f9d8c06f910 2023-06-02T15:31:37.128 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-02T15:31:37.128 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-02T15:31:37.128 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-02T15:31:37.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] conn(0x7f9d8c06f910 msgr2=0x7f9d8c071d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.132:6808/37340,v1:172.21.15.132:6809/37340] conn(0x7f9d8c06f910 0x7f9d8c071d80 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9d8c065c00 msgr2=0x7f9d8c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9d8c065c00 0x7f9d8c0680b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9d94000c10 tx=0x7f9d94000f60 comp rx=0 tx=0).stop 2023-06-02T15:31:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 msgr2=0x7f9da00a4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 --2- 172.21.15.78:0/3693166694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9d88003980 0x7f9da00a4480 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9d9001c8c0 tx=0x7f9d88005800 comp rx=0 tx=0).stop 2023-06-02T15:31:37.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da4f84640 1 -- 172.21.15.78:0/3693166694 reap_dead start 2023-06-02T15:31:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 shutdown_connections 2023-06-02T15:31:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 >> 172.21.15.78:0/3693166694 conn(0x7f9da006b610 msgr2=0x7f9da0147e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 shutdown_connections 2023-06-02T15:31:37.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.118+0000 7f9da69e7640 1 -- 172.21.15.78:0/3693166694 wait complete. 2023-06-02T15:31:37.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-06-02T15:31:37.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ef029640 1 Processor -- start 2023-06-02T15:31:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ef029640 1 -- start start 2023-06-02T15:31:37.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ef029640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd0e80a4c50 0x7fd0e806c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ef029640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e814c000 con 0x7fd0e80a4700 2023-06-02T15:31:37.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ef029640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0e806f150 con 0x7fd0e806bee0 2023-06-02T15:31:37.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ef029640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0e80a5020 con 0x7fd0e80a4c50 2023-06-02T15:31:37.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd0e80a4700 0x7fd0e8156de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45528/0 (socket says 172.21.15.78:45528) 2023-06-02T15:31:37.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e7fff640 1 -- 172.21.15.78:0/1583811482 learned_addr learned my addr 172.21.15.78:0/1583811482 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:37.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3303003043 0 0) 0x7fd0e814c000 con 0x7fd0e80a4700 2023-06-02T15:31:37.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0d0003530 con 0x7fd0e80a4700 2023-06-02T15:31:37.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ed5c6640 1 --2- 172.21.15.78:0/1583811482 >> v2:172.21.15.132:3300/0 conn(0x7fd0e80a4c50 0x7fd0e806c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4263462550 0 0) 0x7fd0d0003530 con 0x7fd0e80a4700 2023-06-02T15:31:37.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 >> v2:172.21.15.132:3300/0 conn(0x7fd0e80a4c50 msgr2=0x7fd0e806c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 --2- 172.21.15.78:0/1583811482 >> v2:172.21.15.132:3300/0 conn(0x7fd0e80a4c50 0x7fd0e806c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 >> v1:172.21.15.132:6789/0 conn(0x7fd0e806bee0 legacy=0x7fd0e814e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e81527b0 con 0x7fd0e80a4700 2023-06-02T15:31:37.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fd0dc001680 con 0x7fd0e80a4700 2023-06-02T15:31:37.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 >> v1:172.21.15.78:6789/0 conn(0x7fd0e80a4700 legacy=0x7fd0e8156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0d00039f0 0x7fd0d0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0d00047d0 0x7fd0d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0d00051f0 0x7fd0d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80a5020 con 0x7fd0d00039f0 2023-06-02T15:31:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d000c120 con 0x7fd0d00051f0 2023-06-02T15:31:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d000c2e0 con 0x7fd0d00047d0 2023-06-02T15:31:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ecdc5640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0d00039f0 0x7fd0d0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ed5c6640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0d00051f0 0x7fd0d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0e7fff640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0d00047d0 0x7fd0d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ecdc5640 1 -- 172.21.15.78:0/1583811482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0d00047d0 msgr2=0x7fd0d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ecdc5640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0d00047d0 0x7fd0d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ecdc5640 1 -- 172.21.15.78:0/1583811482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0d00051f0 msgr2=0x7fd0d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ecdc5640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0d00051f0 0x7fd0d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ed5c6640 1 -- 172.21.15.78:0/1583811482 reap_dead start 2023-06-02T15:31:37.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.246+0000 7fd0ecdc5640 1 -- 172.21.15.78:0/1583811482 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d0003530 con 0x7fd0d00039f0 2023-06-02T15:31:37.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0ecdc5640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0d00039f0 0x7fd0d0003e00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8001780 tx=0x7fd0d801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c800810614ecdd server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d80052d0 con 0x7fd0d00039f0 2023-06-02T15:31:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d80a7050 con 0x7fd0d00039f0 2023-06-02T15:31:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0e77fe640 1 -- 172.21.15.78:0/1583811482 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d8003600 con 0x7fd0d00039f0 2023-06-02T15:31:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0ef029640 1 -- 172.21.15.78:0/1583811482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0d00039f0 msgr2=0x7fd0d0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0ef029640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0d00039f0 0x7fd0d0003e00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8001780 tx=0x7fd0d801c320 comp rx=0 tx=0).stop 2023-06-02T15:31:37.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0ef029640 1 -- 172.21.15.78:0/1583811482 shutdown_connections 2023-06-02T15:31:37.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0ef029640 1 --2- 172.21.15.78:0/1583811482 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0d00039f0 0x7fd0d0003e00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0ef029640 1 -- 172.21.15.78:0/1583811482 >> 172.21.15.78:0/1583811482 conn(0x7fd0e80698f0 msgr2=0x7fd0e8069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:37.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0ef029640 1 -- 172.21.15.78:0/1583811482 shutdown_connections 2023-06-02T15:31:37.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0ef029640 1 -- 172.21.15.78:0/1583811482 wait complete. 2023-06-02T15:31:37.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.250+0000 7fd0ef029640 1 Processor -- start 2023-06-02T15:31:37.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ef029640 1 -- start start 2023-06-02T15:31:37.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ef029640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0d00039f0 0x7fd0e80a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ef029640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80b6760 0x7fd0e81e0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ef029640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0e80b6be0 0x7fd0e81e10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ef029640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80b9c30 con 0x7fd0e80b6be0 2023-06-02T15:31:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ef029640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80b9050 con 0x7fd0e80b6760 2023-06-02T15:31:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ef029640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e80b8db0 con 0x7fd0d00039f0 2023-06-02T15:31:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ed5c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0e80b6be0 0x7fd0e81e10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ed5c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0e80b6be0 0x7fd0e81e10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47880/0 (socket says 172.21.15.78:47880) 2023-06-02T15:31:37.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ed5c6640 1 -- 172.21.15.78:0/3905678418 learned_addr learned my addr 172.21.15.78:0/3905678418 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ecdc5640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0d00039f0 0x7fd0e80a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0e7fff640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80b6760 0x7fd0e81e0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ed5c6640 1 -- 172.21.15.78:0/3905678418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0d00039f0 msgr2=0x7fd0e80a3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ed5c6640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0d00039f0 0x7fd0e80a3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ed5c6640 1 -- 172.21.15.78:0/3905678418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80b6760 msgr2=0x7fd0e81e0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ed5c6640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80b6760 0x7fd0e81e0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ed5c6640 1 -- 172.21.15.78:0/3905678418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e81524a0 con 0x7fd0e80b6be0 2023-06-02T15:31:37.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0e7fff640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80b6760 0x7fd0e81e0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:37.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ecdc5640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0d00039f0 0x7fd0e80a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:37.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ed5c6640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0e80b6be0 0x7fd0e81e10a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80a87e0 tx=0x7fd0e0009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0e57fa640 1 -- 172.21.15.78:0/3905678418 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0014610 con 0x7fd0e80b6be0 2023-06-02T15:31:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0e57fa640 1 -- 172.21.15.78:0/3905678418 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e000f050 con 0x7fd0e80b6be0 2023-06-02T15:31:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0e57fa640 1 -- 172.21.15.78:0/3905678418 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e00149b0 con 0x7fd0e80b6be0 2023-06-02T15:31:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ef029640 1 -- 172.21.15.78:0/3905678418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0e806ec30 con 0x7fd0e80b6be0 2023-06-02T15:31:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ef029640 1 -- 172.21.15.78:0/3905678418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e806e310 con 0x7fd0e80b6be0 2023-06-02T15:31:37.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ef029640 1 -- 172.21.15.78:0/3905678418 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0e81e42b0 con 0x7fd0e80b6be0 2023-06-02T15:31:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0e57fa640 1 -- 172.21.15.78:0/3905678418 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fd0e0014b10 con 0x7fd0e80b6be0 2023-06-02T15:31:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0e57fa640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd0d4065c30 0x7fd0d40680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ecdc5640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd0d4065c30 0x7fd0d40680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0e57fa640 1 -- 172.21.15.78:0/3905678418 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd0e00832d0 con 0x7fd0e80b6be0 2023-06-02T15:31:37.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.254+0000 7fd0ecdc5640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd0d4065c30 0x7fd0d40680e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8001750 tx=0x7fd0d80011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.258+0000 7fd0e57fa640 1 -- 172.21.15.78:0/3905678418 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fd0e81e42b0 con 0x7fd0e80b6be0 2023-06-02T15:31:37.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.398+0000 7fd0ef029640 1 -- 172.21.15.78:0/3905678418 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0e8150880 con 0x7fd0d4065c30 2023-06-02T15:31:37.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.398+0000 7fd0e57fa640 1 -- 172.21.15.78:0/3905678418 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd0e8150880 con 0x7fd0d4065c30 2023-06-02T15:31:37.408 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2023-06-02T15:31:37.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 -- 172.21.15.78:0/3905678418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd0d4065c30 msgr2=0x7fd0d40680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd0d4065c30 0x7fd0d40680e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8001750 tx=0x7fd0d80011a0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 -- 172.21.15.78:0/3905678418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0e80b6be0 msgr2=0x7fd0e81e10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0e80b6be0 0x7fd0e81e10a0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd0e80a87e0 tx=0x7fd0e0009970 comp rx=0 tx=0).stop 2023-06-02T15:31:37.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 -- 172.21.15.78:0/3905678418 shutdown_connections 2023-06-02T15:31:37.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fd0d4065c30 0x7fd0d40680e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0e80b6be0 0x7fd0e81e10a0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0e80b6760 0x7fd0e81e0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 --2- 172.21.15.78:0/3905678418 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fd0d00039f0 0x7fd0e80a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 -- 172.21.15.78:0/3905678418 >> 172.21.15.78:0/3905678418 conn(0x7fd0e80698f0 msgr2=0x7fd0e8070db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:37.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 -- 172.21.15.78:0/3905678418 shutdown_connections 2023-06-02T15:31:37.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.402+0000 7fd0ef029640 1 -- 172.21.15.78:0/3905678418 wait complete. 2023-06-02T15:31:37.425 INFO:tasks.ceph:Scrubbing osd.6 2023-06-02T15:31:37.425 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-06-02T15:31:37.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff52b605640 1 Processor -- start 2023-06-02T15:31:37.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff52b605640 1 -- start start 2023-06-02T15:31:37.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff52b605640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5240c3380 0x7ff5241506c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff52b605640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff52406e210 0x7ff5240a3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff52b605640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff52406f0b0 con 0x7ff5240c2fb0 2023-06-02T15:31:37.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff52b605640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff524150c00 con 0x7ff52406e210 2023-06-02T15:31:37.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff52b605640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240bd200 con 0x7ff5240c3380 2023-06-02T15:31:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff5293a1640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff5240c2fb0 0x7ff52414c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45542/0 (socket says 172.21.15.78:45542) 2023-06-02T15:31:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff5293a1640 1 -- 172.21.15.78:0/1819635723 learned_addr learned my addr 172.21.15.78:0/1819635723 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:37.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff529ba2640 1 --2- 172.21.15.78:0/1819635723 >> v2:172.21.15.132:3300/0 conn(0x7ff52406e210 0x7ff5240a3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.542+0000 7ff528ba0640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5240c3380 0x7ff5241506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144616397 0 0) 0x7ff520001120 con 0x7ff5240c2fb0 2023-06-02T15:31:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff510003530 con 0x7ff5240c2fb0 2023-06-02T15:31:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 521050126 0 0) 0x7ff510003530 con 0x7ff5240c2fb0 2023-06-02T15:31:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5240c3380 msgr2=0x7ff5241506c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5240c3380 0x7ff5241506c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 >> v2:172.21.15.132:3300/0 conn(0x7ff52406e210 msgr2=0x7ff5240a3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 --2- 172.21.15.78:0/1819635723 >> v2:172.21.15.132:3300/0 conn(0x7ff52406e210 0x7ff5240a3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240a4f80 con 0x7ff5240c2fb0 2023-06-02T15:31:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7ff520001810 con 0x7ff5240c2fb0 2023-06-02T15:31:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 >> v1:172.21.15.78:6789/0 conn(0x7ff5240c2fb0 legacy=0x7ff52414c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff510003980 0x7ff510003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5100043b0 0x7ff510004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5240c3380 0x7ff510004f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff524150c00 con 0x7ff510003980 2023-06-02T15:31:37.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240bd200 con 0x7ff5100043b0 2023-06-02T15:31:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51000b990 con 0x7ff5240c3380 2023-06-02T15:31:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff5293a1640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff510003980 0x7ff510003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff528ba0640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5100043b0 0x7ff510004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff529ba2640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5240c3380 0x7ff510004f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff5293a1640 1 -- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5240c3380 msgr2=0x7ff510004f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff5293a1640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff5240c3380 0x7ff510004f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff5293a1640 1 -- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5100043b0 msgr2=0x7ff510004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff5293a1640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5100043b0 0x7ff510004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff5293a1640 1 -- 172.21.15.78:0/1819635723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff510003530 con 0x7ff510003980 2023-06-02T15:31:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff528ba0640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5100043b0 0x7ff510004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:37.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff5293a1640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff510003980 0x7ff510003d90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c1c0 tx=0x7ff52001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98aed3f018ff7b88 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200a58f0 con 0x7ff510003980 2023-06-02T15:31:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5200a5a50 con 0x7ff510003980 2023-06-02T15:31:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff51bfff640 1 -- 172.21.15.78:0/1819635723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5200a5e20 con 0x7ff510003980 2023-06-02T15:31:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff52b605640 1 -- 172.21.15.78:0/1819635723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff510003980 msgr2=0x7ff510003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff52b605640 1 --2- 172.21.15.78:0/1819635723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff510003980 0x7ff510003d90 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff52000c1c0 tx=0x7ff52001cc10 comp rx=0 tx=0).stop 2023-06-02T15:31:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff529ba2640 1 -- 172.21.15.78:0/1819635723 reap_dead start 2023-06-02T15:31:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff52b605640 1 -- 172.21.15.78:0/1819635723 shutdown_connections 2023-06-02T15:31:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff52b605640 1 -- 172.21.15.78:0/1819635723 >> 172.21.15.78:0/1819635723 conn(0x7ff52406a580 msgr2=0x7ff5240c26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff52b605640 1 -- 172.21.15.78:0/1819635723 shutdown_connections 2023-06-02T15:31:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.546+0000 7ff52b605640 1 -- 172.21.15.78:0/1819635723 wait complete. 2023-06-02T15:31:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 Processor -- start 2023-06-02T15:31:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 -- start start 2023-06-02T15:31:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff510003980 0x7ff5240a7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5241496c0 0x7ff5241e67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5241e6cf0 0x7ff52406bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5240a7450 con 0x7ff5241496c0 2023-06-02T15:31:37.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff52406ad40 con 0x7ff5241e6cf0 2023-06-02T15:31:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff52406aaa0 con 0x7ff510003980 2023-06-02T15:31:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff528ba0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5241496c0 0x7ff5241e67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff528ba0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5241496c0 0x7ff5241e67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47886/0 (socket says 172.21.15.78:47886) 2023-06-02T15:31:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff528ba0640 1 -- 172.21.15.78:0/2671032845 learned_addr learned my addr 172.21.15.78:0/2671032845 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff529ba2640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5241e6cf0 0x7ff52406bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff5293a1640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff510003980 0x7ff5240a7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff528ba0640 1 -- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff510003980 msgr2=0x7ff5240a7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff528ba0640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7ff510003980 0x7ff5240a7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff528ba0640 1 -- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5241e6cf0 msgr2=0x7ff52406bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff528ba0640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5241e6cf0 0x7ff52406bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff528ba0640 1 -- 172.21.15.78:0/2671032845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5240be210 con 0x7ff5241496c0 2023-06-02T15:31:37.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff528ba0640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5241496c0 0x7ff5241e67b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff514010890 tx=0x7ff514010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff519ffb640 1 -- 172.21.15.78:0/2671032845 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514004220 con 0x7ff5241496c0 2023-06-02T15:31:37.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff519ffb640 1 -- 172.21.15.78:0/2671032845 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff514004380 con 0x7ff5241496c0 2023-06-02T15:31:37.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5240be080 con 0x7ff5241496c0 2023-06-02T15:31:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff519ffb640 1 -- 172.21.15.78:0/2671032845 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51400eb00 con 0x7ff5241496c0 2023-06-02T15:31:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5240a3fe0 con 0x7ff5241496c0 2023-06-02T15:31:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.550+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff52404dd40 con 0x7ff5241496c0 2023-06-02T15:31:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff519ffb640 1 -- 172.21.15.78:0/2671032845 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7ff51400ec60 con 0x7ff5241496c0 2023-06-02T15:31:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff519ffb640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff508065c00 0x7ff5080680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff519ffb640 1 -- 172.21.15.78:0/2671032845 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff514083e50 con 0x7ff5241496c0 2023-06-02T15:31:37.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff5293a1640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff508065c00 0x7ff5080680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff519ffb640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] conn(0x7ff50806f910 0x7ff508071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff519ffb640 1 -- 172.21.15.78:0/2671032845 --> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff508072450 con 0x7ff50806f910 2023-06-02T15:31:37.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff519ffb640 1 -- 172.21.15.78:0/2671032845 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5140842a0 con 0x7ff5241496c0 2023-06-02T15:31:37.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff529ba2640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] conn(0x7ff50806f910 0x7ff508071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff5293a1640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff508065c00 0x7ff5080680b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5200aa000 tx=0x7ff520001ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff529ba2640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] conn(0x7ff50806f910 0x7ff508071d80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.554+0000 7ff519ffb640 1 -- 172.21.15.78:0/2671032845 <== osd.6 v2:172.21.15.132:6824/37341 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff508072450 con 0x7ff50806f910 2023-06-02T15:31:37.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 --> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff5240a7590 con 0x7ff50806f910 2023-06-02T15:31:37.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff519ffb640 1 -- 172.21.15.78:0/2671032845 <== osd.6 v2:172.21.15.132:6824/37341 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff5240a7590 con 0x7ff50806f910 2023-06-02T15:31:37.578 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-02T15:31:37.578 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-02T15:31:37.578 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-02T15:31:37.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] conn(0x7ff50806f910 msgr2=0x7ff508071d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.132:6824/37341,v1:172.21.15.132:6825/37341] conn(0x7ff50806f910 0x7ff508071d80 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff508065c00 msgr2=0x7ff5080680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7ff508065c00 0x7ff5080680b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff5200aa000 tx=0x7ff520001ba0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5241496c0 msgr2=0x7ff5241e67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 --2- 172.21.15.78:0/2671032845 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5241496c0 0x7ff5241e67b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff514010890 tx=0x7ff514010d50 comp rx=0 tx=0).stop 2023-06-02T15:31:37.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff529ba2640 1 -- 172.21.15.78:0/2671032845 reap_dead start 2023-06-02T15:31:37.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 shutdown_connections 2023-06-02T15:31:37.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 >> 172.21.15.78:0/2671032845 conn(0x7ff52406a580 msgr2=0x7ff5241522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:37.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 shutdown_connections 2023-06-02T15:31:37.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.570+0000 7ff52b605640 1 -- 172.21.15.78:0/2671032845 wait complete. 2023-06-02T15:31:37.593 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-06-02T15:31:37.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.690+0000 7fcaba411640 1 Processor -- start 2023-06-02T15:31:37.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.690+0000 7fcaba411640 1 -- start start 2023-06-02T15:31:37.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.690+0000 7fcaba411640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcab40c0570 0x7fcab40ba640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.690+0000 7fcaba411640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcab41485c0 0x7fcab4148a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.690+0000 7fcaba411640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab40a5f30 con 0x7fcab4071780 2023-06-02T15:31:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.690+0000 7fcaba411640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab40c1100 con 0x7fcab40c0570 2023-06-02T15:31:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.690+0000 7fcaba411640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab414bcc0 con 0x7fcab41485c0 2023-06-02T15:31:37.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.690+0000 7fcab37fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcab4071780 0x7fcab40bc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45556/0 (socket says 172.21.15.78:45556) 2023-06-02T15:31:37.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.690+0000 7fcab37fe640 1 -- 172.21.15.78:0/3996670906 learned_addr learned my addr 172.21.15.78:0/3996670906 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:37.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab3fff640 1 --2- 172.21.15.78:0/3996670906 >> v2:172.21.15.132:3300/0 conn(0x7fcab40c0570 0x7fcab40ba640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab89ae640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcab41485c0 0x7fcab4148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930301130 0 0) 0x7fcab40a5f30 con 0x7fcab4071780 2023-06-02T15:31:37.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca9c003530 con 0x7fcab4071780 2023-06-02T15:31:37.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1331533395 0 0) 0x7fca9c003530 con 0x7fcab4071780 2023-06-02T15:31:37.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcab41485c0 msgr2=0x7fcab4148a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcab41485c0 0x7fcab4148a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 >> v2:172.21.15.132:3300/0 conn(0x7fcab40c0570 msgr2=0x7fcab40ba640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 --2- 172.21.15.78:0/3996670906 >> v2:172.21.15.132:3300/0 conn(0x7fcab40c0570 0x7fcab40ba640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab414bfa0 con 0x7fcab4071780 2023-06-02T15:31:37.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fcaa8001680 con 0x7fcab4071780 2023-06-02T15:31:37.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 >> v1:172.21.15.78:6789/0 conn(0x7fcab4071780 legacy=0x7fcab40bc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca9c0039f0 0x7fca9c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9c0047d0 0x7fca9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcab41485c0 0x7fca9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab414bcc0 con 0x7fca9c0039f0 2023-06-02T15:31:37.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c00b990 con 0x7fca9c0047d0 2023-06-02T15:31:37.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c00bad0 con 0x7fcab41485c0 2023-06-02T15:31:37.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab3fff640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca9c0039f0 0x7fca9c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab37fe640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9c0047d0 0x7fca9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab3fff640 1 -- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcab41485c0 msgr2=0x7fca9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab3fff640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fcab41485c0 0x7fca9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab3fff640 1 -- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9c0047d0 msgr2=0x7fca9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab3fff640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9c0047d0 0x7fca9c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab3fff640 1 -- 172.21.15.78:0/3996670906 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca9c003530 con 0x7fca9c0039f0 2023-06-02T15:31:37.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab37fe640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca9c0047d0 0x7fca9c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:37.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab3fff640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca9c0039f0 0x7fca9c003e00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009ae0 tx=0x7fcaa401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebd9972085777fa server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40a9470 con 0x7fca9c0039f0 2023-06-02T15:31:37.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa40a95d0 con 0x7fca9c0039f0 2023-06-02T15:31:37.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab2ffd640 1 -- 172.21.15.78:0/3996670906 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa40a9980 con 0x7fca9c0039f0 2023-06-02T15:31:37.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcaba411640 1 -- 172.21.15.78:0/3996670906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca9c0039f0 msgr2=0x7fca9c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcaba411640 1 --2- 172.21.15.78:0/3996670906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca9c0039f0 0x7fca9c003e00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcaa4009ae0 tx=0x7fcaa401ca90 comp rx=0 tx=0).stop 2023-06-02T15:31:37.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcab89ae640 1 -- 172.21.15.78:0/3996670906 reap_dead start 2023-06-02T15:31:37.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcaba411640 1 -- 172.21.15.78:0/3996670906 shutdown_connections 2023-06-02T15:31:37.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcaba411640 1 -- 172.21.15.78:0/3996670906 >> 172.21.15.78:0/3996670906 conn(0x7fcab40a2170 msgr2=0x7fcab40a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:37.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcaba411640 1 -- 172.21.15.78:0/3996670906 shutdown_connections 2023-06-02T15:31:37.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.694+0000 7fcaba411640 1 -- 172.21.15.78:0/3996670906 wait complete. 2023-06-02T15:31:37.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 Processor -- start 2023-06-02T15:31:37.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 -- start start 2023-06-02T15:31:37.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca9c0039f0 0x7fcab40be8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcab4156b30 0x7fcab4156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcab40bf260 0x7fcab40bf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab414cef0 con 0x7fcab4156b30 2023-06-02T15:31:37.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab414c970 con 0x7fcab40bf260 2023-06-02T15:31:37.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab414d0c0 con 0x7fca9c0039f0 2023-06-02T15:31:37.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcab4156b30 0x7fcab4156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcab4156b30 0x7fcab4156f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47902/0 (socket says 172.21.15.78:47902) 2023-06-02T15:31:37.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab37fe640 1 -- 172.21.15.78:0/3663265222 learned_addr learned my addr 172.21.15.78:0/3663265222 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:37.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab3fff640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca9c0039f0 0x7fcab40be8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab89ae640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcab40bf260 0x7fcab40bf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab37fe640 1 -- 172.21.15.78:0/3663265222 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca9c0039f0 msgr2=0x7fcab40be8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab37fe640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca9c0039f0 0x7fcab40be8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab37fe640 1 -- 172.21.15.78:0/3663265222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcab40bf260 msgr2=0x7fcab40bf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab37fe640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcab40bf260 0x7fcab40bf6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab37fe640 1 -- 172.21.15.78:0/3663265222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab40c0ad0 con 0x7fcab4156b30 2023-06-02T15:31:37.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab3fff640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca9c0039f0 0x7fcab40be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:37.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab37fe640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcab4156b30 0x7fcab4156f60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8001ec0 tx=0x7fcaa800dc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab0ff9640 1 -- 172.21.15.78:0/3663265222 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80074e0 con 0x7fcab4156b30 2023-06-02T15:31:37.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab0ff9640 1 -- 172.21.15.78:0/3663265222 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa8007640 con 0x7fcab4156b30 2023-06-02T15:31:37.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab0ff9640 1 -- 172.21.15.78:0/3663265222 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa80049f0 con 0x7fcab4156b30 2023-06-02T15:31:37.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 -- 172.21.15.78:0/3663265222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab40c0940 con 0x7fcab4156b30 2023-06-02T15:31:37.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 -- 172.21.15.78:0/3663265222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab406c780 con 0x7fcab4156b30 2023-06-02T15:31:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcaba411640 1 -- 172.21.15.78:0/3663265222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab414c690 con 0x7fcab4156b30 2023-06-02T15:31:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab0ff9640 1 -- 172.21.15.78:0/3663265222 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fcaa8004b50 con 0x7fcab4156b30 2023-06-02T15:31:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab0ff9640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcaa0065c00 0x7fcaa00680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab0ff9640 1 -- 172.21.15.78:0/3663265222 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcaa8083090 con 0x7fcab4156b30 2023-06-02T15:31:37.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.698+0000 7fcab3fff640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcaa0065c00 0x7fcaa00680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.702+0000 7fcab3fff640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcaa0065c00 0x7fcaa00680b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40ae000 tx=0x7fcaa40b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:37.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.702+0000 7fcab0ff9640 1 -- 172.21.15.78:0/3663265222 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fcab414c690 con 0x7fcab4156b30 2023-06-02T15:31:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.854+0000 7fcaba411640 1 -- 172.21.15.78:0/3663265222 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fcab414c690 con 0x7fcaa0065c00 2023-06-02T15:31:37.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcab0ff9640 1 -- 172.21.15.78:0/3663265222 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fcab414c690 con 0x7fcaa0065c00 2023-06-02T15:31:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2023-06-02T15:31:37.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 -- 172.21.15.78:0/3663265222 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcaa0065c00 msgr2=0x7fcaa00680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcaa0065c00 0x7fcaa00680b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40ae000 tx=0x7fcaa40b3040 comp rx=0 tx=0).stop 2023-06-02T15:31:37.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 -- 172.21.15.78:0/3663265222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcab4156b30 msgr2=0x7fcab4156f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:37.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcab4156b30 0x7fcab4156f60 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8001ec0 tx=0x7fcaa800dc70 comp rx=0 tx=0).stop 2023-06-02T15:31:37.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 -- 172.21.15.78:0/3663265222 shutdown_connections 2023-06-02T15:31:37.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcab40bf260 0x7fcab40bf6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fcaa0065c00 0x7fcaa00680b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcab4156b30 0x7fcab4156f60 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 --2- 172.21.15.78:0/3663265222 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fca9c0039f0 0x7fcab40be8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 -- 172.21.15.78:0/3663265222 >> 172.21.15.78:0/3663265222 conn(0x7fcab40a2170 msgr2=0x7fcab4149010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:37.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 -- 172.21.15.78:0/3663265222 shutdown_connections 2023-06-02T15:31:37.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.858+0000 7fcaba411640 1 -- 172.21.15.78:0/3663265222 wait complete. 2023-06-02T15:31:37.883 INFO:tasks.ceph:Scrubbing osd.7 2023-06-02T15:31:37.884 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-06-02T15:31:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed63835640 1 Processor -- start 2023-06-02T15:31:37.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed63835640 1 -- start start 2023-06-02T15:31:37.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed63835640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed5c149d90 0x7fed5c1504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed63835640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed5c0bbc10 0x7fed5c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed63835640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed5c0baed0 0x7fed5c0a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:37.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed63835640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c0bc080 con 0x7fed5c0bbc10 2023-06-02T15:31:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed63835640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed5c150a20 con 0x7fed5c0baed0 2023-06-02T15:31:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed63835640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c0a3b40 con 0x7fed5c149d90 2023-06-02T15:31:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed60dd0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed5c0bbc10 0x7fed5c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed60dd0640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fed5c0bbc10 0x7fed5c0a3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47910/0 (socket says 172.21.15.78:47910) 2023-06-02T15:31:37.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed60dd0640 1 -- 172.21.15.78:0/3234856846 learned_addr learned my addr 172.21.15.78:0/3234856846 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed615d1640 1 --2- 172.21.15.78:0/3234856846 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed5c149d90 0x7fed5c1504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed61dd2640 1 --2- 172.21.15.78:0/3234856846 >> v2:172.21.15.132:3300/0 conn(0x7fed5c0baed0 0x7fed5c0a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed60dd0640 1 -- 172.21.15.78:0/3234856846 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed5c149d90 msgr2=0x7fed5c1504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed60dd0640 1 --2- 172.21.15.78:0/3234856846 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed5c149d90 0x7fed5c1504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:37.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed60dd0640 1 -- 172.21.15.78:0/3234856846 >> v2:172.21.15.132:3300/0 conn(0x7fed5c0baed0 msgr2=0x7fed5c0a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed60dd0640 1 --2- 172.21.15.78:0/3234856846 >> v2:172.21.15.132:3300/0 conn(0x7fed5c0baed0 0x7fed5c0a23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed60dd0640 1 -- 172.21.15.78:0/3234856846 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0bcd60 con 0x7fed5c0bbc10 2023-06-02T15:31:38.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.986+0000 7fed61dd2640 1 --2- 172.21.15.78:0/3234856846 >> v2:172.21.15.132:3300/0 conn(0x7fed5c0baed0 0x7fed5c0a23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed60dd0640 1 --2- 172.21.15.78:0/3234856846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed5c0bbc10 0x7fed5c0a3600 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fed5c06ec70 tx=0x7fed5801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4791bd764415761e server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed53fff640 1 -- 172.21.15.78:0/3234856846 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580a89b0 con 0x7fed5c0bbc10 2023-06-02T15:31:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed53fff640 1 -- 172.21.15.78:0/3234856846 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed580a8b10 con 0x7fed5c0bbc10 2023-06-02T15:31:38.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed53fff640 1 -- 172.21.15.78:0/3234856846 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed580a8ea0 con 0x7fed5c0bbc10 2023-06-02T15:31:38.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 -- 172.21.15.78:0/3234856846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed5c0bbc10 msgr2=0x7fed5c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 --2- 172.21.15.78:0/3234856846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed5c0bbc10 0x7fed5c0a3600 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fed5c06ec70 tx=0x7fed5801ecf0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 -- 172.21.15.78:0/3234856846 shutdown_connections 2023-06-02T15:31:38.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 --2- 172.21.15.78:0/3234856846 >> v2:172.21.15.132:3300/0 conn(0x7fed5c0baed0 0x7fed5c0a23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 --2- 172.21.15.78:0/3234856846 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed5c0bbc10 0x7fed5c0a3600 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 --2- 172.21.15.78:0/3234856846 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed5c149d90 0x7fed5c1504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 -- 172.21.15.78:0/3234856846 >> 172.21.15.78:0/3234856846 conn(0x7fed5c0c04d0 msgr2=0x7fed5c0c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:38.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 -- 172.21.15.78:0/3234856846 shutdown_connections 2023-06-02T15:31:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 -- 172.21.15.78:0/3234856846 wait complete. 2023-06-02T15:31:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 Processor -- start 2023-06-02T15:31:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.990+0000 7fed63835640 1 -- start start 2023-06-02T15:31:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed63835640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed5c0baed0 0x7fed5c14bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed63835640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5c0bbc10 0x7fed5c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed63835640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed5c149d90 0x7fed5c071ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed63835640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c06fcd0 con 0x7fed5c149d90 2023-06-02T15:31:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed63835640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c14f490 con 0x7fed5c0bbc10 2023-06-02T15:31:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed63835640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed5c14c1b0 con 0x7fed5c0baed0 2023-06-02T15:31:38.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed61dd2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed5c149d90 0x7fed5c071ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed61dd2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed5c149d90 0x7fed5c071ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47920/0 (socket says 172.21.15.78:47920) 2023-06-02T15:31:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed61dd2640 1 -- 172.21.15.78:0/3743036370 learned_addr learned my addr 172.21.15.78:0/3743036370 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed615d1640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed5c0baed0 0x7fed5c14bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed60dd0640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5c0bbc10 0x7fed5c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed61dd2640 1 -- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed5c0baed0 msgr2=0x7fed5c14bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed61dd2640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fed5c0baed0 0x7fed5c14bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed61dd2640 1 -- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5c0bbc10 msgr2=0x7fed5c071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed61dd2640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5c0bbc10 0x7fed5c071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed61dd2640 1 -- 172.21.15.78:0/3743036370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed580094d0 con 0x7fed5c149d90 2023-06-02T15:31:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed60dd0640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed5c0bbc10 0x7fed5c071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed61dd2640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed5c149d90 0x7fed5c071ab0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fed5400cef0 tx=0x7fed5400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed51ffb640 1 -- 172.21.15.78:0/3743036370 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400d840 con 0x7fed5c149d90 2023-06-02T15:31:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed51ffb640 1 -- 172.21.15.78:0/3743036370 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5400d9c0 con 0x7fed5c149d90 2023-06-02T15:31:38.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed5c0bc6d0 con 0x7fed5c149d90 2023-06-02T15:31:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed51ffb640 1 -- 172.21.15.78:0/3743036370 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5400dd70 con 0x7fed5c149d90 2023-06-02T15:31:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed5c14a160 con 0x7fed5c149d90 2023-06-02T15:31:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fed5c0bc290 con 0x7fed5c149d90 2023-06-02T15:31:38.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed51ffb640 1 -- 172.21.15.78:0/3743036370 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fed5401e3b0 con 0x7fed5c149d90 2023-06-02T15:31:38.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed51ffb640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fed40065c30 0x7fed400680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed51ffb640 1 -- 172.21.15.78:0/3743036370 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fed540847f0 con 0x7fed5c149d90 2023-06-02T15:31:38.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed615d1640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fed40065c30 0x7fed400680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed51ffb640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] conn(0x7fed4006f940 0x7fed40071db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed51ffb640 1 -- 172.21.15.78:0/3743036370 --> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fed40072480 con 0x7fed4006f940 2023-06-02T15:31:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed51ffb640 1 -- 172.21.15.78:0/3743036370 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed54084c40 con 0x7fed5c149d90 2023-06-02T15:31:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed615d1640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fed40065c30 0x7fed400680e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c870 tx=0x7fed4c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:38.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.994+0000 7fed60dd0640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] conn(0x7fed4006f940 0x7fed40071db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.998+0000 7fed60dd0640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] conn(0x7fed4006f940 0x7fed40071db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:38.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:37.998+0000 7fed51ffb640 1 -- 172.21.15.78:0/3743036370 <== osd.7 v2:172.21.15.132:6800/37343 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fed40072480 con 0x7fed4006f940 2023-06-02T15:31:38.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 --> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fed5c06fe10 con 0x7fed4006f940 2023-06-02T15:31:38.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed51ffb640 1 -- 172.21.15.78:0/3743036370 <== osd.7 v2:172.21.15.132:6800/37343 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fed5c06fe10 con 0x7fed4006f940 2023-06-02T15:31:38.019 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-06-02T15:31:38.020 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-06-02T15:31:38.020 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-06-02T15:31:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] conn(0x7fed4006f940 msgr2=0x7fed40071db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.132:6800/37343,v1:172.21.15.132:6801/37343] conn(0x7fed4006f940 0x7fed40071db0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fed40065c30 msgr2=0x7fed400680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fed40065c30 0x7fed400680e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00c870 tx=0x7fed4c008040 comp rx=0 tx=0).stop 2023-06-02T15:31:38.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed5c149d90 msgr2=0x7fed5c071ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 --2- 172.21.15.78:0/3743036370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fed5c149d90 0x7fed5c071ab0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fed5400cef0 tx=0x7fed5400a710 comp rx=0 tx=0).stop 2023-06-02T15:31:38.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed61dd2640 1 -- 172.21.15.78:0/3743036370 reap_dead start 2023-06-02T15:31:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 shutdown_connections 2023-06-02T15:31:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 >> 172.21.15.78:0/3743036370 conn(0x7fed5c0c04d0 msgr2=0x7fed5c06c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:38.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 shutdown_connections 2023-06-02T15:31:38.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.010+0000 7fed63835640 1 -- 172.21.15.78:0/3743036370 wait complete. 2023-06-02T15:31:38.033 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-06-02T15:31:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea6527640 1 Processor -- start 2023-06-02T15:31:38.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea6527640 1 -- start start 2023-06-02T15:31:38.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea6527640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ea006cfc0 0x7f3ea00718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea6527640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ea006c250 0x7f3ea0149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea6527640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea014d220 con 0x7f3ea00a59e0 2023-06-02T15:31:38.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea6527640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea00ba640 con 0x7f3ea006cfc0 2023-06-02T15:31:38.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea6527640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea014cd30 con 0x7f3ea006c250 2023-06-02T15:31:38.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3ea00a59e0 0x7f3ea014f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45562/0 (socket says 172.21.15.78:45562) 2023-06-02T15:31:38.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9ffff640 1 -- 172.21.15.78:0/4277995894 learned_addr learned my addr 172.21.15.78:0/4277995894 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:38.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea4ac4640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ea006c250 0x7f3ea0149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e977fe640 1 --2- 172.21.15.78:0/4277995894 >> v2:172.21.15.132:3300/0 conn(0x7f3ea006cfc0 0x7f3ea00718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70380968 0 0) 0x7f3ea014d220 con 0x7f3ea00a59e0 2023-06-02T15:31:38.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e8c003530 con 0x7f3ea00a59e0 2023-06-02T15:31:38.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4179573363 0 0) 0x7f3e8c003530 con 0x7f3ea00a59e0 2023-06-02T15:31:38.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ea006c250 msgr2=0x7f3ea0149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:38.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ea006c250 0x7f3ea0149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 >> v2:172.21.15.132:3300/0 conn(0x7f3ea006cfc0 msgr2=0x7f3ea00718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:38.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 --2- 172.21.15.78:0/4277995894 >> v2:172.21.15.132:3300/0 conn(0x7f3ea006cfc0 0x7f3ea00718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea00ba850 con 0x7f3ea00a59e0 2023-06-02T15:31:38.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f3e90001680 con 0x7f3ea00a59e0 2023-06-02T15:31:38.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 >> v1:172.21.15.78:6789/0 conn(0x7f3ea00a59e0 legacy=0x7f3ea014f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e8c0039f0 0x7f3e8c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ea006c250 0x7f3e8c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e8c004d10 0x7f3e8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea00ba640 con 0x7f3e8c004d10 2023-06-02T15:31:38.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea014cd30 con 0x7f3e8c0039f0 2023-06-02T15:31:38.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8c00b9e0 con 0x7f3ea006c250 2023-06-02T15:31:38.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea4ac4640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e8c004d10 0x7f3e8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e977fe640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ea006c250 0x7f3e8c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9ffff640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e8c0039f0 0x7f3e8c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea4ac4640 1 -- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ea006c250 msgr2=0x7f3e8c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:38.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea4ac4640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3ea006c250 0x7f3e8c0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea4ac4640 1 -- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e8c0039f0 msgr2=0x7f3e8c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:38.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea4ac4640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e8c0039f0 0x7f3e8c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3ea4ac4640 1 -- 172.21.15.78:0/4277995894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8c003530 con 0x7f3e8c004d10 2023-06-02T15:31:38.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.130+0000 7f3e9ffff640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e8c0039f0 0x7f3e8c003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:38.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e8c004d10 0x7f3e8c005180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009a30 tx=0x7f3e98021050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b8d2d985538e83 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:38.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e980b0600 con 0x7f3e8c004d10 2023-06-02T15:31:38.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e980ac050 con 0x7f3e8c004d10 2023-06-02T15:31:38.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3e9f7fe640 1 -- 172.21.15.78:0/4277995894 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e980b09a0 con 0x7f3e8c004d10 2023-06-02T15:31:38.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- 172.21.15.78:0/4277995894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e8c004d10 msgr2=0x7f3e8c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 --2- 172.21.15.78:0/4277995894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e8c004d10 0x7f3e8c005180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009a30 tx=0x7f3e98021050 comp rx=0 tx=0).stop 2023-06-02T15:31:38.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 -- 172.21.15.78:0/4277995894 reap_dead start 2023-06-02T15:31:38.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- 172.21.15.78:0/4277995894 shutdown_connections 2023-06-02T15:31:38.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- 172.21.15.78:0/4277995894 >> 172.21.15.78:0/4277995894 conn(0x7f3ea00a2170 msgr2=0x7f3ea00a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:38.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- 172.21.15.78:0/4277995894 shutdown_connections 2023-06-02T15:31:38.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- 172.21.15.78:0/4277995894 wait complete. 2023-06-02T15:31:38.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 Processor -- start 2023-06-02T15:31:38.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- start start 2023-06-02T15:31:38.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e8c004d10 0x7f3ea0143d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea013ec90 0x7f3ea01e26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea0144240 0x7f3ea01df000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea014bcb0 con 0x7f3ea0144240 2023-06-02T15:31:38.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea01e2230 con 0x7f3ea013ec90 2023-06-02T15:31:38.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea014c1e0 con 0x7f3e8c004d10 2023-06-02T15:31:38.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea0144240 0x7f3ea01df000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea0144240 0x7f3ea01df000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47950/0 (socket says 172.21.15.78:47950) 2023-06-02T15:31:38.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 -- 172.21.15.78:0/3795968012 learned_addr learned my addr 172.21.15.78:0/3795968012 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:38.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 -- 172.21.15.78:0/3795968012 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e8c004d10 msgr2=0x7f3ea0143d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e8c004d10 0x7f3ea0143d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 -- 172.21.15.78:0/3795968012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea013ec90 msgr2=0x7f3ea01e26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3e977fe640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea013ec90 0x7f3ea01e26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea013ec90 0x7f3ea01e26c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 -- 172.21.15.78:0/3795968012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea014ff50 con 0x7f3ea0144240 2023-06-02T15:31:38.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea4ac4640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea0144240 0x7f3ea01df000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009f90 tx=0x7f3e98009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:38.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3e9d7fa640 1 -- 172.21.15.78:0/3795968012 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e980b1b20 con 0x7f3ea0144240 2023-06-02T15:31:38.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3e9d7fa640 1 -- 172.21.15.78:0/3795968012 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9800f040 con 0x7f3ea0144240 2023-06-02T15:31:38.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- 172.21.15.78:0/3795968012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea014cf40 con 0x7f3ea0144240 2023-06-02T15:31:38.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3e9d7fa640 1 -- 172.21.15.78:0/3795968012 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e980039a0 con 0x7f3ea0144240 2023-06-02T15:31:38.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.134+0000 7f3ea6527640 1 -- 172.21.15.78:0/3795968012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea00a5db0 con 0x7f3ea0144240 2023-06-02T15:31:38.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.138+0000 7f3ea6527640 1 -- 172.21.15.78:0/3795968012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea01e2020 con 0x7f3ea0144240 2023-06-02T15:31:38.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.138+0000 7f3e9d7fa640 1 -- 172.21.15.78:0/3795968012 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f3e980b7050 con 0x7f3ea0144240 2023-06-02T15:31:38.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.138+0000 7f3e9d7fa640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3e80065c30 0x7f3e800680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.138+0000 7f3e9ffff640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3e80065c30 0x7f3e800680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.138+0000 7f3e9d7fa640 1 -- 172.21.15.78:0/3795968012 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3e98121af0 con 0x7f3ea0144240 2023-06-02T15:31:38.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.138+0000 7f3e9ffff640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3e80065c30 0x7f3e800680e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3e90000fc0 tx=0x7f3e900047f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:38.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.142+0000 7f3e9d7fa640 1 -- 172.21.15.78:0/3795968012 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f3e980ef040 con 0x7f3ea0144240 2023-06-02T15:31:38.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.282+0000 7f3ea6527640 1 -- 172.21.15.78:0/3795968012 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ea01e2370 con 0x7f3e80065c30 2023-06-02T15:31:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.282+0000 7f3e9d7fa640 1 -- 172.21.15.78:0/3795968012 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3ea01e2370 con 0x7f3e80065c30 2023-06-02T15:31:38.291 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2023-06-02T15:31:38.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 -- 172.21.15.78:0/3795968012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3e80065c30 msgr2=0x7f3e800680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3e80065c30 0x7f3e800680e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3e90000fc0 tx=0x7f3e900047f0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 -- 172.21.15.78:0/3795968012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea0144240 msgr2=0x7f3ea01df000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea0144240 0x7f3ea01df000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3e98009f90 tx=0x7f3e98009750 comp rx=0 tx=0).stop 2023-06-02T15:31:38.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 -- 172.21.15.78:0/3795968012 shutdown_connections 2023-06-02T15:31:38.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f3e80065c30 0x7f3e800680e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ea0144240 0x7f3ea01df000 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ea013ec90 0x7f3ea01e26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 --2- 172.21.15.78:0/3795968012 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f3e8c004d10 0x7f3ea0143d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 -- 172.21.15.78:0/3795968012 >> 172.21.15.78:0/3795968012 conn(0x7f3ea00a2170 msgr2=0x7f3ea00bdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 -- 172.21.15.78:0/3795968012 shutdown_connections 2023-06-02T15:31:38.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.286+0000 7f3ea6527640 1 -- 172.21.15.78:0/3795968012 wait complete. 2023-06-02T15:31:38.308 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:31:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33fd5f6640 1 Processor -- start 2023-06-02T15:31:38.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33fd5f6640 1 -- start start 2023-06-02T15:31:38.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33fd5f6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33f80bf2b0 0x7f33f80bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33fd5f6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f80c0730 con 0x7f33f806bd00 2023-06-02T15:31:38.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33fd5f6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f80c0b20 con 0x7f33f80b7fc0 2023-06-02T15:31:38.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33fd5f6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f806b5f0 con 0x7f33f80bf2b0 2023-06-02T15:31:38.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f6ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f33f806bd00 0x7f33f8069f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:45576/0 (socket says 172.21.15.78:45576) 2023-06-02T15:31:38.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f6ffd640 1 -- 172.21.15.78:0/167401934 learned_addr learned my addr 172.21.15.78:0/167401934 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:38.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3238410366 0 0) 0x7f33f80c0730 con 0x7f33f806bd00 2023-06-02T15:31:38.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e0003530 con 0x7f33f806bd00 2023-06-02T15:31:38.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f67fc640 1 --2- 172.21.15.78:0/167401934 >> v2:172.21.15.132:3300/0 conn(0x7f33f80bf2b0 0x7f33f80bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1431199234 0 0) 0x7f33e0003530 con 0x7f33f806bd00 2023-06-02T15:31:38.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 >> v2:172.21.15.132:3300/0 conn(0x7f33f80bf2b0 msgr2=0x7f33f80bff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:38.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 --2- 172.21.15.78:0/167401934 >> v2:172.21.15.132:3300/0 conn(0x7f33f80bf2b0 0x7f33f80bff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 >> v1:172.21.15.132:6789/0 conn(0x7f33f80b7fc0 legacy=0x7f33f81521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f80aa880 con 0x7f33f806bd00 2023-06-02T15:31:38.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f33f0001680 con 0x7f33f806bd00 2023-06-02T15:31:38.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 >> v1:172.21.15.78:6789/0 conn(0x7f33f806bd00 legacy=0x7f33f8069f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e0003980 0x7f33e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33e00047d0 0x7f33e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e000bfb0 con 0x7f33e0005180 2023-06-02T15:31:38.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e000c120 con 0x7f33e0003980 2023-06-02T15:31:38.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e000c2e0 con 0x7f33e00047d0 2023-06-02T15:31:38.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f77fe640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f6ffd640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e0003980 0x7f33e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f67fc640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33e00047d0 0x7f33e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f77fe640 1 -- 172.21.15.78:0/167401934 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33e00047d0 msgr2=0x7f33e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:38.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f77fe640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33e00047d0 0x7f33e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f77fe640 1 -- 172.21.15.78:0/167401934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e0003980 msgr2=0x7f33e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:38.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f77fe640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e0003980 0x7f33e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.418+0000 7f33f77fe640 1 -- 172.21.15.78:0/167401934 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e0003530 con 0x7f33e0005180 2023-06-02T15:31:38.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f77fe640 1 -- 172.21.15.78:0/167401934 reap_dead start 2023-06-02T15:31:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f77fe640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33e000b990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f33e8001e70 tx=0x7f33e801c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e13d75d18f2e319 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8003b80 con 0x7f33e0005180 2023-06-02T15:31:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e8003d20 con 0x7f33e0005180 2023-06-02T15:31:38.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f5ffb640 1 -- 172.21.15.78:0/167401934 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e8005260 con 0x7f33e0005180 2023-06-02T15:31:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 -- 172.21.15.78:0/167401934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 msgr2=0x7f33e000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33e000b990 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f33e8001e70 tx=0x7f33e801c760 comp rx=0 tx=0).stop 2023-06-02T15:31:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 -- 172.21.15.78:0/167401934 shutdown_connections 2023-06-02T15:31:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 --2- 172.21.15.78:0/167401934 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33e000b990 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 -- 172.21.15.78:0/167401934 >> 172.21.15.78:0/167401934 conn(0x7f33f80a6480 msgr2=0x7f33f80a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 -- 172.21.15.78:0/167401934 shutdown_connections 2023-06-02T15:31:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 -- 172.21.15.78:0/167401934 wait complete. 2023-06-02T15:31:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 Processor -- start 2023-06-02T15:31:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 -- start start 2023-06-02T15:31:38.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33f81e41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80bb400 0x7f33f80bdba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33f80b8460 0x7f33f80bccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80b9990 con 0x7f33e0005180 2023-06-02T15:31:38.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f81d4310 con 0x7f33f80bb400 2023-06-02T15:31:38.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33fd5f6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f80be750 con 0x7f33f80b8460 2023-06-02T15:31:38.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33f81e41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33f81e41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47954/0 (socket says 172.21.15.78:47954) 2023-06-02T15:31:38.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f6ffd640 1 -- 172.21.15.78:0/3693861855 learned_addr learned my addr 172.21.15.78:0/3693861855 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:38.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f67fc640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80bb400 0x7f33f80bdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f77fe640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33f80b8460 0x7f33f80bccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f6ffd640 1 -- 172.21.15.78:0/3693861855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33f80b8460 msgr2=0x7f33f80bccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f6ffd640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33f80b8460 0x7f33f80bccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f6ffd640 1 -- 172.21.15.78:0/3693861855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80bb400 msgr2=0x7f33f80bdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f6ffd640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80bb400 0x7f33f80bdba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f6ffd640 1 -- 172.21.15.78:0/3693861855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f80c1310 con 0x7f33e0005180 2023-06-02T15:31:38.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f77fe640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33f80b8460 0x7f33f80bccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:31:38.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.422+0000 7f33f6ffd640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33f81e41d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f33f0007290 tx=0x7f33f0007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:38.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33df7fe640 1 -- 172.21.15.78:0/3693861855 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f000f940 con 0x7f33e0005180 2023-06-02T15:31:38.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33df7fe640 1 -- 172.21.15.78:0/3693861855 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f000fac0 con 0x7f33e0005180 2023-06-02T15:31:38.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33fd5f6640 1 -- 172.21.15.78:0/3693861855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f80c0d70 con 0x7f33e0005180 2023-06-02T15:31:38.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33df7fe640 1 -- 172.21.15.78:0/3693861855 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f000fe70 con 0x7f33e0005180 2023-06-02T15:31:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33fd5f6640 1 -- 172.21.15.78:0/3693861855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f806c0d0 con 0x7f33e0005180 2023-06-02T15:31:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33fd5f6640 1 -- 172.21.15.78:0/3693861855 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f80be5b0 con 0x7f33e0005180 2023-06-02T15:31:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33df7fe640 1 -- 172.21.15.78:0/3693861855 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f33f001d460 con 0x7f33e0005180 2023-06-02T15:31:38.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33df7fe640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f33e4065c00 0x7f33e40680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:38.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33f67fc640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f33e4065c00 0x7f33e40680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:38.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33df7fe640 1 -- 172.21.15.78:0/3693861855 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f33f0083880 con 0x7f33e0005180 2023-06-02T15:31:38.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.426+0000 7f33f67fc640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f33e4065c00 0x7f33e40680b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33f80c26e0 tx=0x7f33ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:38.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.430+0000 7f33df7fe640 1 -- 172.21.15.78:0/3693861855 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f33f80be5b0 con 0x7f33e0005180 2023-06-02T15:31:38.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.566+0000 7f33fd5f6640 1 -- 172.21.15.78:0/3693861855 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33f80be5b0 con 0x7f33e4065c00 2023-06-02T15:31:38.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.590+0000 7f33df7fe640 1 -- 172.21.15.78:0/3693861855 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+376690 (secure 0 0 0) 0x7f33f80be5b0 con 0x7f33e4065c00 2023-06-02T15:31:38.600 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:38.603 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:31:38.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 -- 172.21.15.78:0/3693861855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f33e4065c00 msgr2=0x7f33e40680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f33e4065c00 0x7f33e40680b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f33f80c26e0 tx=0x7f33ec008040 comp rx=0 tx=0).stop 2023-06-02T15:31:38.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 -- 172.21.15.78:0/3693861855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 msgr2=0x7f33f81e41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:38.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33f81e41d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f33f0007290 tx=0x7f33f0007750 comp rx=0 tx=0).stop 2023-06-02T15:31:38.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 -- 172.21.15.78:0/3693861855 shutdown_connections 2023-06-02T15:31:38.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f33f80b8460 0x7f33f80bccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f80bb400 0x7f33f80bdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f33e4065c00 0x7f33e40680b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 --2- 172.21.15.78:0/3693861855 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f33e0005180 0x7f33f81e41d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:38.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 -- 172.21.15.78:0/3693861855 >> 172.21.15.78:0/3693861855 conn(0x7f33f80a6480 msgr2=0x7f33f8069f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:38.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 -- 172.21.15.78:0/3693861855 shutdown_connections 2023-06-02T15:31:38.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:38.594+0000 7f33fd5f6640 1 -- 172.21.15.78:0/3693861855 wait complete. 2023-06-02T15:31:38.619 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-06-02T15:31:37.242650+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596054,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69792,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":67264,"kb_avail":754904928,"statfs":{"total":773094113280,"available":773022646272,"internally_reserved":0,"allocated":2523136,"data_stored":2182424,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":68878336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.664410"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578786+0000","last_change":"2023-06-02T15:30:42.711237+0000","last_active":"2023-06-02T15:31:25.578786+0000","last_peered":"2023-06-02T15:31:25.578786+0000","last_clean":"2023-06-02T15:31:25.578786+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:31:25.578786+0000","last_undegraded":"2023-06-02T15:31:25.578786+0000","last_fullsized":"2023-06-02T15:31:25.578786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987457+0000","last_change":"2023-06-02T15:30:38.275721+0000","last_active":"2023-06-02T15:31:25.987457+0000","last_peered":"2023-06-02T15:31:25.987457+0000","last_clean":"2023-06-02T15:31:25.987457+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:31:25.987457+0000","last_undegraded":"2023-06-02T15:31:25.987457+0000","last_fullsized":"2023-06-02T15:31:25.987457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618872+0000","last_change":"2023-06-02T15:30:38.638911+0000","last_active":"2023-06-02T15:31:25.618872+0000","last_peered":"2023-06-02T15:31:25.618872+0000","last_clean":"2023-06-02T15:31:25.618872+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:31:25.618872+0000","last_undegraded":"2023-06-02T15:31:25.618872+0000","last_fullsized":"2023-06-02T15:31:25.618872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618711+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:31:25.618711+0000","last_peered":"2023-06-02T15:31:25.618711+0000","last_clean":"2023-06-02T15:31:25.618711+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:31:25.618711+0000","last_undegraded":"2023-06-02T15:31:25.618711+0000","last_fullsized":"2023-06-02T15:31:25.618711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:23:12.455644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571682+0000","last_change":"2023-06-02T15:30:38.282116+0000","last_active":"2023-06-02T15:31:25.571682+0000","last_peered":"2023-06-02T15:31:25.571682+0000","last_clean":"2023-06-02T15:31:25.571682+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:31:25.571682+0000","last_undegraded":"2023-06-02T15:31:25.571682+0000","last_fullsized":"2023-06-02T15:31:25.571682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571216+0000","last_change":"2023-06-02T15:30:38.638342+0000","last_active":"2023-06-02T15:31:25.571216+0000","last_peered":"2023-06-02T15:31:25.571216+0000","last_clean":"2023-06-02T15:31:25.571216+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:31:25.571216+0000","last_undegraded":"2023-06-02T15:31:25.571216+0000","last_fullsized":"2023-06-02T15:31:25.571216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578935+0000","last_change":"2023-06-02T15:30:42.715416+0000","last_active":"2023-06-02T15:31:25.578935+0000","last_peered":"2023-06-02T15:31:25.578935+0000","last_clean":"2023-06-02T15:31:25.578935+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:31:25.578935+0000","last_undegraded":"2023-06-02T15:31:25.578935+0000","last_fullsized":"2023-06-02T15:31:25.578935+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:55:43.273093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581243+0000","last_change":"2023-06-02T15:30:38.278973+0000","last_active":"2023-06-02T15:31:25.581243+0000","last_peered":"2023-06-02T15:31:25.581243+0000","last_clean":"2023-06-02T15:31:25.581243+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:31:25.581243+0000","last_undegraded":"2023-06-02T15:31:25.581243+0000","last_fullsized":"2023-06-02T15:31:25.581243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619180+0000","last_change":"2023-06-02T15:30:38.644549+0000","last_active":"2023-06-02T15:31:25.619180+0000","last_peered":"2023-06-02T15:31:25.619180+0000","last_clean":"2023-06-02T15:31:25.619180+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:31:25.619180+0000","last_undegraded":"2023-06-02T15:31:25.619180+0000","last_fullsized":"2023-06-02T15:31:25.619180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:26.088195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627207+0000","last_change":"2023-06-02T15:30:42.707090+0000","last_active":"2023-06-02T15:31:25.627207+0000","last_peered":"2023-06-02T15:31:25.627207+0000","last_clean":"2023-06-02T15:31:25.627207+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:31:25.627207+0000","last_undegraded":"2023-06-02T15:31:25.627207+0000","last_fullsized":"2023-06-02T15:31:25.627207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580585+0000","last_change":"2023-06-02T15:30:38.269876+0000","last_active":"2023-06-02T15:31:25.580585+0000","last_peered":"2023-06-02T15:31:25.580585+0000","last_clean":"2023-06-02T15:31:25.580585+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:31:25.580585+0000","last_undegraded":"2023-06-02T15:31:25.580585+0000","last_fullsized":"2023-06-02T15:31:25.580585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619186+0000","last_change":"2023-06-02T15:30:38.639635+0000","last_active":"2023-06-02T15:31:25.619186+0000","last_peered":"2023-06-02T15:31:25.619186+0000","last_clean":"2023-06-02T15:31:25.619186+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:31:25.619186+0000","last_undegraded":"2023-06-02T15:31:25.619186+0000","last_fullsized":"2023-06-02T15:31:25.619186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:56:57.260064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580130+0000","last_change":"2023-06-02T15:30:42.699623+0000","last_active":"2023-06-02T15:31:25.580130+0000","last_peered":"2023-06-02T15:31:25.580130+0000","last_clean":"2023-06-02T15:31:25.580130+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:31:25.580130+0000","last_undegraded":"2023-06-02T15:31:25.580130+0000","last_fullsized":"2023-06-02T15:31:25.580130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:18.327051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987383+0000","last_change":"2023-06-02T15:30:38.263534+0000","last_active":"2023-06-02T15:31:25.987383+0000","last_peered":"2023-06-02T15:31:25.987383+0000","last_clean":"2023-06-02T15:31:25.987383+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:31:25.987383+0000","last_undegraded":"2023-06-02T15:31:25.987383+0000","last_fullsized":"2023-06-02T15:31:25.987383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577341+0000","last_change":"2023-06-02T15:30:38.644102+0000","last_active":"2023-06-02T15:31:25.577341+0000","last_peered":"2023-06-02T15:31:25.577341+0000","last_clean":"2023-06-02T15:31:25.577341+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:31:25.577341+0000","last_undegraded":"2023-06-02T15:31:25.577341+0000","last_fullsized":"2023-06-02T15:31:25.577341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:11.864794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619418+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:31:25.619418+0000","last_peered":"2023-06-02T15:31:25.619418+0000","last_clean":"2023-06-02T15:31:25.619418+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:31:25.619418+0000","last_undegraded":"2023-06-02T15:31:25.619418+0000","last_fullsized":"2023-06-02T15:31:25.619418+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:16:13.363523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619377+0000","last_change":"2023-06-02T15:30:38.272143+0000","last_active":"2023-06-02T15:31:25.619377+0000","last_peered":"2023-06-02T15:31:25.619377+0000","last_clean":"2023-06-02T15:31:25.619377+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:31:25.619377+0000","last_undegraded":"2023-06-02T15:31:25.619377+0000","last_fullsized":"2023-06-02T15:31:25.619377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.572235+0000","last_change":"2023-06-02T15:30:38.650795+0000","last_active":"2023-06-02T15:31:25.572235+0000","last_peered":"2023-06-02T15:31:25.572235+0000","last_clean":"2023-06-02T15:31:25.572235+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:31:25.572235+0000","last_undegraded":"2023-06-02T15:31:25.572235+0000","last_fullsized":"2023-06-02T15:31:25.572235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579795+0000","last_change":"2023-06-02T15:30:42.706975+0000","last_active":"2023-06-02T15:31:25.579795+0000","last_peered":"2023-06-02T15:31:25.579795+0000","last_clean":"2023-06-02T15:31:25.579795+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:31:25.579795+0000","last_undegraded":"2023-06-02T15:31:25.579795+0000","last_fullsized":"2023-06-02T15:31:25.579795+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:32.007544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579181+0000","last_change":"2023-06-02T15:30:38.290129+0000","last_active":"2023-06-02T15:31:25.579181+0000","last_peered":"2023-06-02T15:31:25.579181+0000","last_clean":"2023-06-02T15:31:25.579181+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:31:25.579181+0000","last_undegraded":"2023-06-02T15:31:25.579181+0000","last_fullsized":"2023-06-02T15:31:25.579181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987383+0000","last_change":"2023-06-02T15:30:38.656679+0000","last_active":"2023-06-02T15:31:25.987383+0000","last_peered":"2023-06-02T15:31:25.987383+0000","last_clean":"2023-06-02T15:31:25.987383+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:31:25.987383+0000","last_undegraded":"2023-06-02T15:31:25.987383+0000","last_fullsized":"2023-06-02T15:31:25.987383+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987725+0000","last_change":"2023-06-02T15:30:42.705633+0000","last_active":"2023-06-02T15:31:25.987725+0000","last_peered":"2023-06-02T15:31:25.987725+0000","last_clean":"2023-06-02T15:31:25.987725+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:31:25.987725+0000","last_undegraded":"2023-06-02T15:31:25.987725+0000","last_fullsized":"2023-06-02T15:31:25.987725+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571269+0000","last_change":"2023-06-02T15:30:38.273154+0000","last_active":"2023-06-02T15:31:25.571269+0000","last_peered":"2023-06-02T15:31:25.571269+0000","last_clean":"2023-06-02T15:31:25.571269+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:31:25.571269+0000","last_undegraded":"2023-06-02T15:31:25.571269+0000","last_fullsized":"2023-06-02T15:31:25.571269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:48.390850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579891+0000","last_change":"2023-06-02T15:30:38.647445+0000","last_active":"2023-06-02T15:31:25.579891+0000","last_peered":"2023-06-02T15:31:25.579891+0000","last_clean":"2023-06-02T15:31:25.579891+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:31:25.579891+0000","last_undegraded":"2023-06-02T15:31:25.579891+0000","last_fullsized":"2023-06-02T15:31:25.579891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:34.366098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571012+0000","last_change":"2023-06-02T15:30:38.650927+0000","last_active":"2023-06-02T15:31:25.571012+0000","last_peered":"2023-06-02T15:31:25.571012+0000","last_clean":"2023-06-02T15:31:25.571012+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:31:25.571012+0000","last_undegraded":"2023-06-02T15:31:25.571012+0000","last_fullsized":"2023-06-02T15:31:25.571012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987597+0000","last_change":"2023-06-02T15:30:38.274472+0000","last_active":"2023-06-02T15:31:25.987597+0000","last_peered":"2023-06-02T15:31:25.987597+0000","last_clean":"2023-06-02T15:31:25.987597+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:31:25.987597+0000","last_undegraded":"2023-06-02T15:31:25.987597+0000","last_fullsized":"2023-06-02T15:31:25.987597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578080+0000","last_change":"2023-06-02T15:30:42.710065+0000","last_active":"2023-06-02T15:31:25.578080+0000","last_peered":"2023-06-02T15:31:25.578080+0000","last_clean":"2023-06-02T15:31:25.578080+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:31:25.578080+0000","last_undegraded":"2023-06-02T15:31:25.578080+0000","last_fullsized":"2023-06-02T15:31:25.578080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571297+0000","last_change":"2023-06-02T15:30:38.656769+0000","last_active":"2023-06-02T15:31:25.571297+0000","last_peered":"2023-06-02T15:31:25.571297+0000","last_clean":"2023-06-02T15:31:25.571297+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:31:25.571297+0000","last_undegraded":"2023-06-02T15:31:25.571297+0000","last_fullsized":"2023-06-02T15:31:25.571297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:26:10.020133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581474+0000","last_change":"2023-06-02T15:30:38.275134+0000","last_active":"2023-06-02T15:31:25.581474+0000","last_peered":"2023-06-02T15:31:25.581474+0000","last_clean":"2023-06-02T15:31:25.581474+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:31:25.581474+0000","last_undegraded":"2023-06-02T15:31:25.581474+0000","last_fullsized":"2023-06-02T15:31:25.581474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626635+0000","last_change":"2023-06-02T15:30:42.706722+0000","last_active":"2023-06-02T15:31:25.626635+0000","last_peered":"2023-06-02T15:31:25.626635+0000","last_clean":"2023-06-02T15:31:25.626635+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:31:25.626635+0000","last_undegraded":"2023-06-02T15:31:25.626635+0000","last_fullsized":"2023-06-02T15:31:25.626635+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628183+0000","last_change":"2023-06-02T15:30:38.289736+0000","last_active":"2023-06-02T15:31:25.628183+0000","last_peered":"2023-06-02T15:31:25.628183+0000","last_clean":"2023-06-02T15:31:25.628183+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:31:25.628183+0000","last_undegraded":"2023-06-02T15:31:25.628183+0000","last_fullsized":"2023-06-02T15:31:25.628183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:43:04.205096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579296+0000","last_change":"2023-06-02T15:30:38.642841+0000","last_active":"2023-06-02T15:31:25.579296+0000","last_peered":"2023-06-02T15:31:25.579296+0000","last_clean":"2023-06-02T15:31:25.579296+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:31:25.579296+0000","last_undegraded":"2023-06-02T15:31:25.579296+0000","last_fullsized":"2023-06-02T15:31:25.579296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571470+0000","last_change":"2023-06-02T15:30:42.720577+0000","last_active":"2023-06-02T15:31:25.571470+0000","last_peered":"2023-06-02T15:31:25.571470+0000","last_clean":"2023-06-02T15:31:25.571470+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:31:25.571470+0000","last_undegraded":"2023-06-02T15:31:25.571470+0000","last_fullsized":"2023-06-02T15:31:25.571470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:48:54.291389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"26'15","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626342+0000","last_change":"2023-06-02T15:30:38.276703+0000","last_active":"2023-06-02T15:31:25.626342+0000","last_peered":"2023-06-02T15:31:25.626342+0000","last_clean":"2023-06-02T15:31:25.626342+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:31:25.626342+0000","last_undegraded":"2023-06-02T15:31:25.626342+0000","last_fullsized":"2023-06-02T15:31:25.626342+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4904,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619291+0000","last_change":"2023-06-02T15:30:38.634436+0000","last_active":"2023-06-02T15:31:25.619291+0000","last_peered":"2023-06-02T15:31:25.619291+0000","last_clean":"2023-06-02T15:31:25.619291+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:31:25.619291+0000","last_undegraded":"2023-06-02T15:31:25.619291+0000","last_fullsized":"2023-06-02T15:31:25.619291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:19.362567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579046+0000","last_change":"2023-06-02T15:30:42.707445+0000","last_active":"2023-06-02T15:31:25.579046+0000","last_peered":"2023-06-02T15:31:25.579046+0000","last_clean":"2023-06-02T15:31:25.579046+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:31:25.579046+0000","last_undegraded":"2023-06-02T15:31:25.579046+0000","last_fullsized":"2023-06-02T15:31:25.579046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579355+0000","last_change":"2023-06-02T15:30:38.649326+0000","last_active":"2023-06-02T15:31:25.579355+0000","last_peered":"2023-06-02T15:31:25.579355+0000","last_clean":"2023-06-02T15:31:25.579355+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:31:25.579355+0000","last_undegraded":"2023-06-02T15:31:25.579355+0000","last_fullsized":"2023-06-02T15:31:25.579355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579942+0000","last_change":"2023-06-02T15:30:33.407154+0000","last_active":"2023-06-02T15:31:25.579942+0000","last_peered":"2023-06-02T15:31:25.579942+0000","last_clean":"2023-06-02T15:31:25.579942+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:31:25.579942+0000","last_undegraded":"2023-06-02T15:31:25.579942+0000","last_fullsized":"2023-06-02T15:31:25.579942+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581239+0000","last_change":"2023-06-02T15:30:38.279321+0000","last_active":"2023-06-02T15:31:25.581239+0000","last_peered":"2023-06-02T15:31:25.581239+0000","last_clean":"2023-06-02T15:31:25.581239+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:31:25.581239+0000","last_undegraded":"2023-06-02T15:31:25.581239+0000","last_fullsized":"2023-06-02T15:31:25.581239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986692+0000","last_change":"2023-06-02T15:30:42.715780+0000","last_active":"2023-06-02T15:31:25.986692+0000","last_peered":"2023-06-02T15:31:25.986692+0000","last_clean":"2023-06-02T15:31:25.986692+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:31:25.986692+0000","last_undegraded":"2023-06-02T15:31:25.986692+0000","last_fullsized":"2023-06-02T15:31:25.986692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:44:37.470424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986987+0000","last_change":"2023-06-02T15:30:38.632171+0000","last_active":"2023-06-02T15:31:25.986987+0000","last_peered":"2023-06-02T15:31:25.986987+0000","last_clean":"2023-06-02T15:31:25.986987+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:31:25.986987+0000","last_undegraded":"2023-06-02T15:31:25.986987+0000","last_fullsized":"2023-06-02T15:31:25.986987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579661+0000","last_change":"2023-06-02T15:30:33.655215+0000","last_active":"2023-06-02T15:31:25.579661+0000","last_peered":"2023-06-02T15:31:25.579661+0000","last_clean":"2023-06-02T15:31:25.579661+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:31:25.579661+0000","last_undegraded":"2023-06-02T15:31:25.579661+0000","last_fullsized":"2023-06-02T15:31:25.579661+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580143+0000","last_change":"2023-06-02T15:30:38.277096+0000","last_active":"2023-06-02T15:31:25.580143+0000","last_peered":"2023-06-02T15:31:25.580143+0000","last_clean":"2023-06-02T15:31:25.580143+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:31:25.580143+0000","last_undegraded":"2023-06-02T15:31:25.580143+0000","last_fullsized":"2023-06-02T15:31:25.580143+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578632+0000","last_change":"2023-06-02T15:30:42.698823+0000","last_active":"2023-06-02T15:31:25.578632+0000","last_peered":"2023-06-02T15:31:25.578632+0000","last_clean":"2023-06-02T15:31:25.578632+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:31:25.578632+0000","last_undegraded":"2023-06-02T15:31:25.578632+0000","last_fullsized":"2023-06-02T15:31:25.578632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571086+0000","last_change":"2023-06-02T15:30:38.656372+0000","last_active":"2023-06-02T15:31:25.571086+0000","last_peered":"2023-06-02T15:31:25.571086+0000","last_clean":"2023-06-02T15:31:25.571086+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:31:25.571086+0000","last_undegraded":"2023-06-02T15:31:25.571086+0000","last_fullsized":"2023-06-02T15:31:25.571086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620264+0000","last_change":"2023-06-02T15:30:33.959737+0000","last_active":"2023-06-02T15:31:25.620264+0000","last_peered":"2023-06-02T15:31:25.620264+0000","last_clean":"2023-06-02T15:31:25.620264+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:31:25.620264+0000","last_undegraded":"2023-06-02T15:31:25.620264+0000","last_fullsized":"2023-06-02T15:31:25.620264+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.573996+0000","last_change":"2023-06-02T15:30:38.281667+0000","last_active":"2023-06-02T15:31:25.573996+0000","last_peered":"2023-06-02T15:31:25.573996+0000","last_clean":"2023-06-02T15:31:25.573996+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:31:25.573996+0000","last_undegraded":"2023-06-02T15:31:25.573996+0000","last_fullsized":"2023-06-02T15:31:25.573996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:39.295127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618579+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:31:25.618579+0000","last_peered":"2023-06-02T15:31:25.618579+0000","last_clean":"2023-06-02T15:31:25.618579+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:31:25.618579+0000","last_undegraded":"2023-06-02T15:31:25.618579+0000","last_fullsized":"2023-06-02T15:31:25.618579+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:02:01.714482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619050+0000","last_change":"2023-06-02T15:30:38.646642+0000","last_active":"2023-06-02T15:31:25.619050+0000","last_peered":"2023-06-02T15:31:25.619050+0000","last_clean":"2023-06-02T15:31:25.619050+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:31:25.619050+0000","last_undegraded":"2023-06-02T15:31:25.619050+0000","last_fullsized":"2023-06-02T15:31:25.619050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571588+0000","last_change":"2023-06-02T15:30:33.413542+0000","last_active":"2023-06-02T15:31:25.571588+0000","last_peered":"2023-06-02T15:31:25.571588+0000","last_clean":"2023-06-02T15:31:25.571588+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:31:25.571588+0000","last_undegraded":"2023-06-02T15:31:25.571588+0000","last_fullsized":"2023-06-02T15:31:25.571588+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"25'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987572+0000","last_change":"2023-06-02T15:30:38.270941+0000","last_active":"2023-06-02T15:31:25.987572+0000","last_peered":"2023-06-02T15:31:25.987572+0000","last_clean":"2023-06-02T15:31:25.987572+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:31:25.987572+0000","last_undegraded":"2023-06-02T15:31:25.987572+0000","last_fullsized":"2023-06-02T15:31:25.987572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.570918+0000","last_change":"2023-06-02T15:30:42.702383+0000","last_active":"2023-06-02T15:31:25.570918+0000","last_peered":"2023-06-02T15:31:25.570918+0000","last_clean":"2023-06-02T15:31:25.570918+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:31:25.570918+0000","last_undegraded":"2023-06-02T15:31:25.570918+0000","last_fullsized":"2023-06-02T15:31:25.570918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:49:31.222291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987397+0000","last_change":"2023-06-02T15:30:38.642398+0000","last_active":"2023-06-02T15:31:25.987397+0000","last_peered":"2023-06-02T15:31:25.987397+0000","last_clean":"2023-06-02T15:31:25.987397+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:31:25.987397+0000","last_undegraded":"2023-06-02T15:31:25.987397+0000","last_fullsized":"2023-06-02T15:31:25.987397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:42:20.213964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986410+0000","last_change":"2023-06-02T15:30:38.263733+0000","last_active":"2023-06-02T15:31:25.986410+0000","last_peered":"2023-06-02T15:31:25.986410+0000","last_clean":"2023-06-02T15:31:25.986410+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:31:25.986410+0000","last_undegraded":"2023-06-02T15:31:25.986410+0000","last_fullsized":"2023-06-02T15:31:25.986410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626859+0000","last_change":"2023-06-02T15:30:34.413807+0000","last_active":"2023-06-02T15:31:25.626859+0000","last_peered":"2023-06-02T15:31:25.626859+0000","last_clean":"2023-06-02T15:31:25.626859+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:31:25.626859+0000","last_undegraded":"2023-06-02T15:31:25.626859+0000","last_fullsized":"2023-06-02T15:31:25.626859+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_clean_scrub_stamp":"2023-06-02T15:30:33.390390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:47:50.762629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579897+0000","last_change":"2023-06-02T15:30:33.411973+0000","last_active":"2023-06-02T15:31:25.579897+0000","last_peered":"2023-06-02T15:31:25.579897+0000","last_clean":"2023-06-02T15:31:25.579897+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:31:25.579897+0000","last_undegraded":"2023-06-02T15:31:25.579897+0000","last_fullsized":"2023-06-02T15:31:25.579897+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:01:43.823162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581043+0000","last_change":"2023-06-02T15:30:42.712421+0000","last_active":"2023-06-02T15:31:25.581043+0000","last_peered":"2023-06-02T15:31:25.581043+0000","last_clean":"2023-06-02T15:31:25.581043+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:31:25.581043+0000","last_undegraded":"2023-06-02T15:31:25.581043+0000","last_fullsized":"2023-06-02T15:31:25.581043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:38:29.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580505+0000","last_change":"2023-06-02T15:30:38.653404+0000","last_active":"2023-06-02T15:31:25.580505+0000","last_peered":"2023-06-02T15:31:25.580505+0000","last_clean":"2023-06-02T15:31:25.580505+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:31:25.580505+0000","last_undegraded":"2023-06-02T15:31:25.580505+0000","last_fullsized":"2023-06-02T15:31:25.580505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578842+0000","last_change":"2023-06-02T15:30:38.269833+0000","last_active":"2023-06-02T15:31:25.578842+0000","last_peered":"2023-06-02T15:31:25.578842+0000","last_clean":"2023-06-02T15:31:25.578842+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:31:25.578842+0000","last_undegraded":"2023-06-02T15:31:25.578842+0000","last_fullsized":"2023-06-02T15:31:25.578842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:06:46.468867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627221+0000","last_change":"2023-06-02T15:30:33.654728+0000","last_active":"2023-06-02T15:31:25.627221+0000","last_peered":"2023-06-02T15:31:25.627221+0000","last_clean":"2023-06-02T15:31:25.627221+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:31:25.627221+0000","last_undegraded":"2023-06-02T15:31:25.627221+0000","last_fullsized":"2023-06-02T15:31:25.627221+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:05:26.791938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577627+0000","last_change":"2023-06-02T15:30:42.705191+0000","last_active":"2023-06-02T15:31:25.577627+0000","last_peered":"2023-06-02T15:31:25.577627+0000","last_clean":"2023-06-02T15:31:25.577627+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:31:25.577627+0000","last_undegraded":"2023-06-02T15:31:25.577627+0000","last_fullsized":"2023-06-02T15:31:25.577627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:33:22.765485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580072+0000","last_change":"2023-06-02T15:30:38.642359+0000","last_active":"2023-06-02T15:31:25.580072+0000","last_peered":"2023-06-02T15:31:25.580072+0000","last_clean":"2023-06-02T15:31:25.580072+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:31:25.580072+0000","last_undegraded":"2023-06-02T15:31:25.580072+0000","last_fullsized":"2023-06-02T15:31:25.580072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:40:35.357443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619577+0000","last_change":"2023-06-02T15:30:38.257531+0000","last_active":"2023-06-02T15:31:25.619577+0000","last_peered":"2023-06-02T15:31:25.619577+0000","last_clean":"2023-06-02T15:31:25.619577+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:31:25.619577+0000","last_undegraded":"2023-06-02T15:31:25.619577+0000","last_fullsized":"2023-06-02T15:31:25.619577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577955+0000","last_change":"2023-06-02T15:30:33.655250+0000","last_active":"2023-06-02T15:31:25.577955+0000","last_peered":"2023-06-02T15:31:25.577955+0000","last_clean":"2023-06-02T15:31:25.577955+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:31:25.577955+0000","last_undegraded":"2023-06-02T15:31:25.577955+0000","last_fullsized":"2023-06-02T15:31:25.577955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:20:48.900943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986943+0000","last_change":"2023-06-02T15:30:42.693557+0000","last_active":"2023-06-02T15:31:25.986943+0000","last_peered":"2023-06-02T15:31:25.986943+0000","last_clean":"2023-06-02T15:31:25.986943+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:31:25.986943+0000","last_undegraded":"2023-06-02T15:31:25.986943+0000","last_fullsized":"2023-06-02T15:31:25.986943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579446+0000","last_change":"2023-06-02T15:30:38.645488+0000","last_active":"2023-06-02T15:31:25.579446+0000","last_peered":"2023-06-02T15:31:25.579446+0000","last_clean":"2023-06-02T15:31:25.579446+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:31:25.579446+0000","last_undegraded":"2023-06-02T15:31:25.579446+0000","last_fullsized":"2023-06-02T15:31:25.579446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:13:56.784401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571801+0000","last_change":"2023-06-02T15:30:38.283390+0000","last_active":"2023-06-02T15:31:25.571801+0000","last_peered":"2023-06-02T15:31:25.571801+0000","last_clean":"2023-06-02T15:31:25.571801+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:31:25.571801+0000","last_undegraded":"2023-06-02T15:31:25.571801+0000","last_fullsized":"2023-06-02T15:31:25.571801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626919+0000","last_change":"2023-06-02T15:30:33.653937+0000","last_active":"2023-06-02T15:31:25.626919+0000","last_peered":"2023-06-02T15:31:25.626919+0000","last_clean":"2023-06-02T15:31:25.626919+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:31:25.626919+0000","last_undegraded":"2023-06-02T15:31:25.626919+0000","last_fullsized":"2023-06-02T15:31:25.626919+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:47:05.381438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627136+0000","last_change":"2023-06-02T15:30:42.723169+0000","last_active":"2023-06-02T15:31:25.627136+0000","last_peered":"2023-06-02T15:31:25.627136+0000","last_clean":"2023-06-02T15:31:25.627136+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:31:25.627136+0000","last_undegraded":"2023-06-02T15:31:25.627136+0000","last_fullsized":"2023-06-02T15:31:25.627136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.760660+0000","last_change":"2023-06-02T15:31:26.759068+0000","last_active":"2023-06-02T15:31:26.760660+0000","last_peered":"2023-06-02T15:31:26.760660+0000","last_clean":"2023-06-02T15:31:26.760660+0000","last_became_active":"2023-06-02T15:31:26.758308+0000","last_became_peered":"2023-06-02T15:31:26.758308+0000","last_unstale":"2023-06-02T15:31:26.760660+0000","last_undegraded":"2023-06-02T15:31:26.760660+0000","last_fullsized":"2023-06-02T15:31:26.760660+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:21.714894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571177+0000","last_change":"2023-06-02T15:30:38.281851+0000","last_active":"2023-06-02T15:31:25.571177+0000","last_peered":"2023-06-02T15:31:25.571177+0000","last_clean":"2023-06-02T15:31:25.571177+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:31:25.571177+0000","last_undegraded":"2023-06-02T15:31:25.571177+0000","last_fullsized":"2023-06-02T15:31:25.571177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:04:10.861020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619892+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:31:25.619892+0000","last_peered":"2023-06-02T15:31:25.619892+0000","last_clean":"2023-06-02T15:31:25.619892+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:31:25.619892+0000","last_undegraded":"2023-06-02T15:31:25.619892+0000","last_fullsized":"2023-06-02T15:31:25.619892+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:44.594461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620069+0000","last_change":"2023-06-02T15:30:38.638725+0000","last_active":"2023-06-02T15:31:25.620069+0000","last_peered":"2023-06-02T15:31:25.620069+0000","last_clean":"2023-06-02T15:31:25.620069+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:31:25.620069+0000","last_undegraded":"2023-06-02T15:31:25.620069+0000","last_fullsized":"2023-06-02T15:31:25.620069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:26.581542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619044+0000","last_change":"2023-06-02T15:30:38.269278+0000","last_active":"2023-06-02T15:31:25.619044+0000","last_peered":"2023-06-02T15:31:25.619044+0000","last_clean":"2023-06-02T15:31:25.619044+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:31:25.619044+0000","last_undegraded":"2023-06-02T15:31:25.619044+0000","last_fullsized":"2023-06-02T15:31:25.619044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:40:24.868722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581072+0000","last_change":"2023-06-02T15:30:42.713071+0000","last_active":"2023-06-02T15:31:25.581072+0000","last_peered":"2023-06-02T15:31:25.581072+0000","last_clean":"2023-06-02T15:31:25.581072+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:31:25.581072+0000","last_undegraded":"2023-06-02T15:31:25.581072+0000","last_fullsized":"2023-06-02T15:31:25.581072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620056+0000","last_change":"2023-06-02T15:30:38.636565+0000","last_active":"2023-06-02T15:31:25.620056+0000","last_peered":"2023-06-02T15:31:25.620056+0000","last_clean":"2023-06-02T15:31:25.620056+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:31:25.620056+0000","last_undegraded":"2023-06-02T15:31:25.620056+0000","last_fullsized":"2023-06-02T15:31:25.620056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:56:18.833882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578976+0000","last_change":"2023-06-02T15:30:38.277404+0000","last_active":"2023-06-02T15:31:25.578976+0000","last_peered":"2023-06-02T15:31:25.578976+0000","last_clean":"2023-06-02T15:31:25.578976+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:31:25.578976+0000","last_undegraded":"2023-06-02T15:31:25.578976+0000","last_fullsized":"2023-06-02T15:31:25.578976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579937+0000","last_change":"2023-06-02T15:30:42.697724+0000","last_active":"2023-06-02T15:31:25.579937+0000","last_peered":"2023-06-02T15:31:25.579937+0000","last_clean":"2023-06-02T15:31:25.579937+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:31:25.579937+0000","last_undegraded":"2023-06-02T15:31:25.579937+0000","last_fullsized":"2023-06-02T15:31:25.579937+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:37:29.491113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619605+0000","last_change":"2023-06-02T15:30:38.640532+0000","last_active":"2023-06-02T15:31:25.619605+0000","last_peered":"2023-06-02T15:31:25.619605+0000","last_clean":"2023-06-02T15:31:25.619605+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:31:25.619605+0000","last_undegraded":"2023-06-02T15:31:25.619605+0000","last_fullsized":"2023-06-02T15:31:25.619605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.572026+0000","last_change":"2023-06-02T15:30:38.281909+0000","last_active":"2023-06-02T15:31:25.572026+0000","last_peered":"2023-06-02T15:31:25.572026+0000","last_clean":"2023-06-02T15:31:25.572026+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:31:25.572026+0000","last_undegraded":"2023-06-02T15:31:25.572026+0000","last_fullsized":"2023-06-02T15:31:25.572026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:13.584630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576942+0000","last_change":"2023-06-02T15:30:42.716337+0000","last_active":"2023-06-02T15:31:25.576942+0000","last_peered":"2023-06-02T15:31:25.576942+0000","last_clean":"2023-06-02T15:31:25.576942+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:31:25.576942+0000","last_undegraded":"2023-06-02T15:31:25.576942+0000","last_fullsized":"2023-06-02T15:31:25.576942+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:16:29.984460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986836+0000","last_change":"2023-06-02T15:30:38.651270+0000","last_active":"2023-06-02T15:31:25.986836+0000","last_peered":"2023-06-02T15:31:25.986836+0000","last_clean":"2023-06-02T15:31:25.986836+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:31:25.986836+0000","last_undegraded":"2023-06-02T15:31:25.986836+0000","last_fullsized":"2023-06-02T15:31:25.986836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580356+0000","last_change":"2023-06-02T15:30:38.277304+0000","last_active":"2023-06-02T15:31:25.580356+0000","last_peered":"2023-06-02T15:31:25.580356+0000","last_clean":"2023-06-02T15:31:25.580356+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:31:25.580356+0000","last_undegraded":"2023-06-02T15:31:25.580356+0000","last_fullsized":"2023-06-02T15:31:25.580356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576791+0000","last_change":"2023-06-02T15:30:42.692861+0000","last_active":"2023-06-02T15:31:25.576791+0000","last_peered":"2023-06-02T15:31:25.576791+0000","last_clean":"2023-06-02T15:31:25.576791+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:31:25.576791+0000","last_undegraded":"2023-06-02T15:31:25.576791+0000","last_fullsized":"2023-06-02T15:31:25.576791+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:29.857375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578802+0000","last_change":"2023-06-02T15:30:38.645534+0000","last_active":"2023-06-02T15:31:25.578802+0000","last_peered":"2023-06-02T15:31:25.578802+0000","last_clean":"2023-06-02T15:31:25.578802+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:31:25.578802+0000","last_undegraded":"2023-06-02T15:31:25.578802+0000","last_fullsized":"2023-06-02T15:31:25.578802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628270+0000","last_change":"2023-06-02T15:30:38.282239+0000","last_active":"2023-06-02T15:31:25.628270+0000","last_peered":"2023-06-02T15:31:25.628270+0000","last_clean":"2023-06-02T15:31:25.628270+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:31:25.628270+0000","last_undegraded":"2023-06-02T15:31:25.628270+0000","last_fullsized":"2023-06-02T15:31:25.628270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:40.807809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576809+0000","last_change":"2023-06-02T15:30:42.720849+0000","last_active":"2023-06-02T15:31:25.576809+0000","last_peered":"2023-06-02T15:31:25.576809+0000","last_clean":"2023-06-02T15:31:25.576809+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:31:25.576809+0000","last_undegraded":"2023-06-02T15:31:25.576809+0000","last_fullsized":"2023-06-02T15:31:25.576809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:09.977709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618839+0000","last_change":"2023-06-02T15:30:38.641746+0000","last_active":"2023-06-02T15:31:25.618839+0000","last_peered":"2023-06-02T15:31:25.618839+0000","last_clean":"2023-06-02T15:31:25.618839+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:31:25.618839+0000","last_undegraded":"2023-06-02T15:31:25.618839+0000","last_fullsized":"2023-06-02T15:31:25.618839+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628173+0000","last_change":"2023-06-02T15:30:38.282724+0000","last_active":"2023-06-02T15:31:25.628173+0000","last_peered":"2023-06-02T15:31:25.628173+0000","last_clean":"2023-06-02T15:31:25.628173+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:31:25.628173+0000","last_undegraded":"2023-06-02T15:31:25.628173+0000","last_fullsized":"2023-06-02T15:31:25.628173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:21.387209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576497+0000","last_change":"2023-06-02T15:30:42.697662+0000","last_active":"2023-06-02T15:31:25.576497+0000","last_peered":"2023-06-02T15:31:25.576497+0000","last_clean":"2023-06-02T15:31:25.576497+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:31:25.576497+0000","last_undegraded":"2023-06-02T15:31:25.576497+0000","last_fullsized":"2023-06-02T15:31:25.576497+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:19.014996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577702+0000","last_change":"2023-06-02T15:30:38.656950+0000","last_active":"2023-06-02T15:31:25.577702+0000","last_peered":"2023-06-02T15:31:25.577702+0000","last_clean":"2023-06-02T15:31:25.577702+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:31:25.577702+0000","last_undegraded":"2023-06-02T15:31:25.577702+0000","last_fullsized":"2023-06-02T15:31:25.577702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:43:40.400254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.628287+0000","last_change":"2023-06-02T15:30:38.283602+0000","last_active":"2023-06-02T15:31:25.628287+0000","last_peered":"2023-06-02T15:31:25.628287+0000","last_clean":"2023-06-02T15:31:25.628287+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:31:25.628287+0000","last_undegraded":"2023-06-02T15:31:25.628287+0000","last_fullsized":"2023-06-02T15:31:25.628287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:45:33.362323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627029+0000","last_change":"2023-06-02T15:30:42.722884+0000","last_active":"2023-06-02T15:31:25.627029+0000","last_peered":"2023-06-02T15:31:25.627029+0000","last_clean":"2023-06-02T15:31:25.627029+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:31:25.627029+0000","last_undegraded":"2023-06-02T15:31:25.627029+0000","last_fullsized":"2023-06-02T15:31:25.627029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:25:27.433514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580952+0000","last_change":"2023-06-02T15:30:42.714188+0000","last_active":"2023-06-02T15:31:25.580952+0000","last_peered":"2023-06-02T15:31:25.580952+0000","last_clean":"2023-06-02T15:31:25.580952+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:31:25.580952+0000","last_undegraded":"2023-06-02T15:31:25.580952+0000","last_fullsized":"2023-06-02T15:31:25.580952+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:09:27.641290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578228+0000","last_change":"2023-06-02T15:30:38.261610+0000","last_active":"2023-06-02T15:31:25.578228+0000","last_peered":"2023-06-02T15:31:25.578228+0000","last_clean":"2023-06-02T15:31:25.578228+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:31:25.578228+0000","last_undegraded":"2023-06-02T15:31:25.578228+0000","last_fullsized":"2023-06-02T15:31:25.578228+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:23.546275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.574205+0000","last_change":"2023-06-02T15:30:38.658984+0000","last_active":"2023-06-02T15:31:25.574205+0000","last_peered":"2023-06-02T15:31:25.574205+0000","last_clean":"2023-06-02T15:31:25.574205+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:31:25.574205+0000","last_undegraded":"2023-06-02T15:31:25.574205+0000","last_fullsized":"2023-06-02T15:31:25.574205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571841+0000","last_change":"2023-06-02T15:30:42.705561+0000","last_active":"2023-06-02T15:31:25.571841+0000","last_peered":"2023-06-02T15:31:25.571841+0000","last_clean":"2023-06-02T15:31:25.571841+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:31:25.571841+0000","last_undegraded":"2023-06-02T15:31:25.571841+0000","last_fullsized":"2023-06-02T15:31:25.571841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:39:14.247511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627280+0000","last_change":"2023-06-02T15:30:38.283796+0000","last_active":"2023-06-02T15:31:25.627280+0000","last_peered":"2023-06-02T15:31:25.627280+0000","last_clean":"2023-06-02T15:31:25.627280+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:31:25.627280+0000","last_undegraded":"2023-06-02T15:31:25.627280+0000","last_fullsized":"2023-06-02T15:31:25.627280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:49.246025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987622+0000","last_change":"2023-06-02T15:30:38.644966+0000","last_active":"2023-06-02T15:31:25.987622+0000","last_peered":"2023-06-02T15:31:25.987622+0000","last_clean":"2023-06-02T15:31:25.987622+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:31:25.987622+0000","last_undegraded":"2023-06-02T15:31:25.987622+0000","last_fullsized":"2023-06-02T15:31:25.987622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986672+0000","last_change":"2023-06-02T15:30:38.265398+0000","last_active":"2023-06-02T15:31:25.986672+0000","last_peered":"2023-06-02T15:31:25.986672+0000","last_clean":"2023-06-02T15:31:25.986672+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:31:25.986672+0000","last_undegraded":"2023-06-02T15:31:25.986672+0000","last_fullsized":"2023-06-02T15:31:25.986672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:10:29.479149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580971+0000","last_change":"2023-06-02T15:30:38.657999+0000","last_active":"2023-06-02T15:31:25.580971+0000","last_peered":"2023-06-02T15:31:25.580971+0000","last_clean":"2023-06-02T15:31:25.580971+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:31:25.580971+0000","last_undegraded":"2023-06-02T15:31:25.580971+0000","last_fullsized":"2023-06-02T15:31:25.580971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571454+0000","last_change":"2023-06-02T15:30:42.705725+0000","last_active":"2023-06-02T15:31:25.571454+0000","last_peered":"2023-06-02T15:31:25.571454+0000","last_clean":"2023-06-02T15:31:25.571454+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:31:25.571454+0000","last_undegraded":"2023-06-02T15:31:25.571454+0000","last_fullsized":"2023-06-02T15:31:25.571454+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:40:13.682277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627568+0000","last_change":"2023-06-02T15:30:38.282095+0000","last_active":"2023-06-02T15:31:25.627568+0000","last_peered":"2023-06-02T15:31:25.627568+0000","last_clean":"2023-06-02T15:31:25.627568+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:31:25.627568+0000","last_undegraded":"2023-06-02T15:31:25.627568+0000","last_fullsized":"2023-06-02T15:31:25.627568+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:22:49.070583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.926559+0000","last_change":"2023-06-02T15:31:26.924308+0000","last_active":"2023-06-02T15:31:26.926559+0000","last_peered":"2023-06-02T15:31:26.926559+0000","last_clean":"2023-06-02T15:31:26.926559+0000","last_became_active":"2023-06-02T15:31:26.923733+0000","last_became_peered":"2023-06-02T15:31:26.923733+0000","last_unstale":"2023-06-02T15:31:26.926559+0000","last_undegraded":"2023-06-02T15:31:26.926559+0000","last_fullsized":"2023-06-02T15:31:26.926559+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:00:54.244135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580545+0000","last_change":"2023-06-02T15:30:42.702456+0000","last_active":"2023-06-02T15:31:25.580545+0000","last_peered":"2023-06-02T15:31:25.580545+0000","last_clean":"2023-06-02T15:31:25.580545+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:31:25.580545+0000","last_undegraded":"2023-06-02T15:31:25.580545+0000","last_fullsized":"2023-06-02T15:31:25.580545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:29:41.334909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577812+0000","last_change":"2023-06-02T15:30:38.637380+0000","last_active":"2023-06-02T15:31:25.577812+0000","last_peered":"2023-06-02T15:31:25.577812+0000","last_clean":"2023-06-02T15:31:25.577812+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:31:25.577812+0000","last_undegraded":"2023-06-02T15:31:25.577812+0000","last_fullsized":"2023-06-02T15:31:25.577812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:10:41.811583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571178+0000","last_change":"2023-06-02T15:30:38.655074+0000","last_active":"2023-06-02T15:31:25.571178+0000","last_peered":"2023-06-02T15:31:25.571178+0000","last_clean":"2023-06-02T15:31:25.571178+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:31:25.571178+0000","last_undegraded":"2023-06-02T15:31:25.571178+0000","last_fullsized":"2023-06-02T15:31:25.571178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619438+0000","last_change":"2023-06-02T15:30:38.637979+0000","last_active":"2023-06-02T15:31:25.619438+0000","last_peered":"2023-06-02T15:31:25.619438+0000","last_clean":"2023-06-02T15:31:25.619438+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:31:25.619438+0000","last_undegraded":"2023-06-02T15:31:25.619438+0000","last_fullsized":"2023-06-02T15:31:25.619438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:32:06.574791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571856+0000","last_change":"2023-06-02T15:30:38.659430+0000","last_active":"2023-06-02T15:31:25.571856+0000","last_peered":"2023-06-02T15:31:25.571856+0000","last_clean":"2023-06-02T15:31:25.571856+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:31:25.571856+0000","last_undegraded":"2023-06-02T15:31:25.571856+0000","last_fullsized":"2023-06-02T15:31:25.571856+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580215+0000","last_change":"2023-06-02T15:30:38.656408+0000","last_active":"2023-06-02T15:31:25.580215+0000","last_peered":"2023-06-02T15:31:25.580215+0000","last_clean":"2023-06-02T15:31:25.580215+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:31:25.580215+0000","last_undegraded":"2023-06-02T15:31:25.580215+0000","last_fullsized":"2023-06-02T15:31:25.580215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580963+0000","last_change":"2023-06-02T15:30:38.658103+0000","last_active":"2023-06-02T15:31:25.580963+0000","last_peered":"2023-06-02T15:31:25.580963+0000","last_clean":"2023-06-02T15:31:25.580963+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:31:25.580963+0000","last_undegraded":"2023-06-02T15:31:25.580963+0000","last_fullsized":"2023-06-02T15:31:25.580963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580377+0000","last_change":"2023-06-02T15:30:38.641657+0000","last_active":"2023-06-02T15:31:25.580377+0000","last_peered":"2023-06-02T15:31:25.580377+0000","last_clean":"2023-06-02T15:31:25.580377+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:31:25.580377+0000","last_undegraded":"2023-06-02T15:31:25.580377+0000","last_fullsized":"2023-06-02T15:31:25.580377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:22.309633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.580426+0000","last_change":"2023-06-02T15:30:38.640289+0000","last_active":"2023-06-02T15:31:25.580426+0000","last_peered":"2023-06-02T15:31:25.580426+0000","last_clean":"2023-06-02T15:31:25.580426+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:31:25.580426+0000","last_undegraded":"2023-06-02T15:31:25.580426+0000","last_fullsized":"2023-06-02T15:31:25.580426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.626779+0000","last_change":"2023-06-02T15:30:38.656963+0000","last_active":"2023-06-02T15:31:25.626779+0000","last_peered":"2023-06-02T15:31:25.626779+0000","last_clean":"2023-06-02T15:31:25.626779+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:31:25.626779+0000","last_undegraded":"2023-06-02T15:31:25.626779+0000","last_fullsized":"2023-06-02T15:31:25.626779+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.571080+0000","last_change":"2023-06-02T15:30:38.648546+0000","last_active":"2023-06-02T15:31:25.571080+0000","last_peered":"2023-06-02T15:31:25.571080+0000","last_clean":"2023-06-02T15:31:25.571080+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:31:25.571080+0000","last_undegraded":"2023-06-02T15:31:25.571080+0000","last_fullsized":"2023-06-02T15:31:25.571080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.986521+0000","last_change":"2023-06-02T15:30:38.643407+0000","last_active":"2023-06-02T15:31:25.986521+0000","last_peered":"2023-06-02T15:31:25.986521+0000","last_clean":"2023-06-02T15:31:25.986521+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:31:25.986521+0000","last_undegraded":"2023-06-02T15:31:25.986521+0000","last_fullsized":"2023-06-02T15:31:25.986521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T15:49:26.454457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627438+0000","last_change":"2023-06-02T15:30:38.657038+0000","last_active":"2023-06-02T15:31:25.627438+0000","last_peered":"2023-06-02T15:31:25.627438+0000","last_clean":"2023-06-02T15:31:25.627438+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:31:25.627438+0000","last_undegraded":"2023-06-02T15:31:25.627438+0000","last_fullsized":"2023-06-02T15:31:25.627438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619678+0000","last_change":"2023-06-02T15:30:38.638594+0000","last_active":"2023-06-02T15:31:25.619678+0000","last_peered":"2023-06-02T15:31:25.619678+0000","last_clean":"2023-06-02T15:31:25.619678+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:31:25.619678+0000","last_undegraded":"2023-06-02T15:31:25.619678+0000","last_fullsized":"2023-06-02T15:31:25.619678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:09:28.604626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576977+0000","last_change":"2023-06-02T15:30:38.638252+0000","last_active":"2023-06-02T15:31:25.576977+0000","last_peered":"2023-06-02T15:31:25.576977+0000","last_clean":"2023-06-02T15:31:25.576977+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:31:25.576977+0000","last_undegraded":"2023-06-02T15:31:25.576977+0000","last_fullsized":"2023-06-02T15:31:25.576977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:46:24.550049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619807+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:31:25.619807+0000","last_peered":"2023-06-02T15:31:25.619807+0000","last_clean":"2023-06-02T15:31:25.619807+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:31:25.619807+0000","last_undegraded":"2023-06-02T15:31:25.619807+0000","last_fullsized":"2023-06-02T15:31:25.619807+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T18:25:14.924133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987375+0000","last_change":"2023-06-02T15:30:38.639262+0000","last_active":"2023-06-02T15:31:25.987375+0000","last_peered":"2023-06-02T15:31:25.987375+0000","last_clean":"2023-06-02T15:31:25.987375+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:31:25.987375+0000","last_undegraded":"2023-06-02T15:31:25.987375+0000","last_fullsized":"2023-06-02T15:31:25.987375+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:08:29.844170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.618716+0000","last_change":"2023-06-02T15:30:38.636435+0000","last_active":"2023-06-02T15:31:25.618716+0000","last_peered":"2023-06-02T15:31:25.618716+0000","last_clean":"2023-06-02T15:31:25.618716+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:31:25.618716+0000","last_undegraded":"2023-06-02T15:31:25.618716+0000","last_fullsized":"2023-06-02T15:31:25.618716+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:41:54.216725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627147+0000","last_change":"2023-06-02T15:30:38.659341+0000","last_active":"2023-06-02T15:31:25.627147+0000","last_peered":"2023-06-02T15:31:25.627147+0000","last_clean":"2023-06-02T15:31:25.627147+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:31:25.627147+0000","last_undegraded":"2023-06-02T15:31:25.627147+0000","last_fullsized":"2023-06-02T15:31:25.627147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.578465+0000","last_change":"2023-06-02T15:30:38.636138+0000","last_active":"2023-06-02T15:31:25.578465+0000","last_peered":"2023-06-02T15:31:25.578465+0000","last_clean":"2023-06-02T15:31:25.578465+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:31:25.578465+0000","last_undegraded":"2023-06-02T15:31:25.578465+0000","last_fullsized":"2023-06-02T15:31:25.578465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:20:04.172779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.576902+0000","last_change":"2023-06-02T15:30:38.645755+0000","last_active":"2023-06-02T15:31:25.576902+0000","last_peered":"2023-06-02T15:31:25.576902+0000","last_clean":"2023-06-02T15:31:25.576902+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:31:25.576902+0000","last_undegraded":"2023-06-02T15:31:25.576902+0000","last_fullsized":"2023-06-02T15:31:25.576902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:09:40.298901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577266+0000","last_change":"2023-06-02T15:30:38.644641+0000","last_active":"2023-06-02T15:31:25.577266+0000","last_peered":"2023-06-02T15:31:25.577266+0000","last_clean":"2023-06-02T15:31:25.577266+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:31:25.577266+0000","last_undegraded":"2023-06-02T15:31:25.577266+0000","last_fullsized":"2023-06-02T15:31:25.577266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:52:14.588404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.620098+0000","last_change":"2023-06-02T15:30:38.650928+0000","last_active":"2023-06-02T15:31:25.620098+0000","last_peered":"2023-06-02T15:31:25.620098+0000","last_clean":"2023-06-02T15:31:25.620098+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:31:25.620098+0000","last_undegraded":"2023-06-02T15:31:25.620098+0000","last_fullsized":"2023-06-02T15:31:25.620098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:25:02.841725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581483+0000","last_change":"2023-06-02T15:30:38.640368+0000","last_active":"2023-06-02T15:31:25.581483+0000","last_peered":"2023-06-02T15:31:25.581483+0000","last_clean":"2023-06-02T15:31:25.581483+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:31:25.581483+0000","last_undegraded":"2023-06-02T15:31:25.581483+0000","last_fullsized":"2023-06-02T15:31:25.581483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:14:05.700707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987146+0000","last_change":"2023-06-02T15:30:38.639440+0000","last_active":"2023-06-02T15:31:25.987146+0000","last_peered":"2023-06-02T15:31:25.987146+0000","last_clean":"2023-06-02T15:31:25.987146+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:31:25.987146+0000","last_undegraded":"2023-06-02T15:31:25.987146+0000","last_fullsized":"2023-06-02T15:31:25.987146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577488+0000","last_change":"2023-06-02T15:30:38.647961+0000","last_active":"2023-06-02T15:31:25.577488+0000","last_peered":"2023-06-02T15:31:25.577488+0000","last_clean":"2023-06-02T15:31:25.577488+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:31:25.577488+0000","last_undegraded":"2023-06-02T15:31:25.577488+0000","last_fullsized":"2023-06-02T15:31:25.577488+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:41:56.453810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.627017+0000","last_change":"2023-06-02T15:30:38.659299+0000","last_active":"2023-06-02T15:31:25.627017+0000","last_peered":"2023-06-02T15:31:25.627017+0000","last_clean":"2023-06-02T15:31:25.627017+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:31:25.627017+0000","last_undegraded":"2023-06-02T15:31:25.627017+0000","last_fullsized":"2023-06-02T15:31:25.627017+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619150+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:31:25.619150+0000","last_peered":"2023-06-02T15:31:25.619150+0000","last_clean":"2023-06-02T15:31:25.619150+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:31:25.619150+0000","last_undegraded":"2023-06-02T15:31:25.619150+0000","last_fullsized":"2023-06-02T15:31:25.619150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:15:27.850958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.987178+0000","last_change":"2023-06-02T15:30:38.639043+0000","last_active":"2023-06-02T15:31:25.987178+0000","last_peered":"2023-06-02T15:31:25.987178+0000","last_clean":"2023-06-02T15:31:25.987178+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:31:25.987178+0000","last_undegraded":"2023-06-02T15:31:25.987178+0000","last_fullsized":"2023-06-02T15:31:25.987178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:51:15.612078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.579235+0000","last_change":"2023-06-02T15:30:38.637413+0000","last_active":"2023-06-02T15:31:25.579235+0000","last_peered":"2023-06-02T15:31:25.579235+0000","last_clean":"2023-06-02T15:31:25.579235+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:31:25.579235+0000","last_undegraded":"2023-06-02T15:31:25.579235+0000","last_fullsized":"2023-06-02T15:31:25.579235+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:00:22.390984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.619908+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:31:25.619908+0000","last_peered":"2023-06-02T15:31:25.619908+0000","last_clean":"2023-06-02T15:31:25.619908+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:31:25.619908+0000","last_undegraded":"2023-06-02T15:31:25.619908+0000","last_fullsized":"2023-06-02T15:31:25.619908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:17:55.191725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.581242+0000","last_change":"2023-06-02T15:30:38.650591+0000","last_active":"2023-06-02T15:31:25.581242+0000","last_peered":"2023-06-02T15:31:25.581242+0000","last_clean":"2023-06-02T15:31:25.581242+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:31:25.581242+0000","last_undegraded":"2023-06-02T15:31:25.581242+0000","last_fullsized":"2023-06-02T15:31:25.581242+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:04:22.217768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-06-02T15:31:25.577617+0000","last_change":"2023-06-02T15:30:38.639026+0000","last_active":"2023-06-02T15:31:25.577617+0000","last_peered":"2023-06-02T15:31:25.577617+0000","last_clean":"2023-06-02T15:31:25.577617+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:31:25.577617+0000","last_undegraded":"2023-06-02T15:31:25.577617+0000","last_fullsized":"2023-06-02T15:31:25.577617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:42:49.394624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5686,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9156,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362684,"statfs":{"total":96636764160,"available":96627388416,"internally_reserved":0,"allocated":389120,"data_stored":719524,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2529999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0389999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8552,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363288,"statfs":{"total":96636764160,"available":96628006912,"internally_reserved":0,"allocated":294912,"data_stored":123686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.92400000000000004}]},{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.96699999999999997}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":1.03}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.236},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.86199999999999999}]},{"osd":4,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.1719999999999999}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.0880000000000001}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.119},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.141}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":315392,"data_stored":128996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.82999999999999996}]},{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.113}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.91800000000000004}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.089},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":1.1379999999999999}]},{"osd":5,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.63500000000000001}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.71599999999999997}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.2130000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":294912,"data_stored":124126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8484,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94363356,"statfs":{"total":96636764160,"available":96628076544,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9124,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362716,"statfs":{"total":96636764160,"available":96627421184,"internally_reserved":0,"allocated":356352,"data_stored":714404,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8612,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363228,"statfs":{"total":96636764160,"available":96627945472,"internally_reserved":0,"allocated":290816,"data_stored":123616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.60699999999999998}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.82499999999999996}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.73099999999999998}]},{"osd":4,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.85399999999999998}]},{"osd":5,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":1.101}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.048},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.177}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.228},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.0660000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:31:38.630 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.631 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.631 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.632 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.632 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.632 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.632 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.633 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.633 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.633 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.634 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.634 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.634 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.635 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.635 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.635 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.635 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.636 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.636 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.636 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.637 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.637 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.637 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.638 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.638 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.638 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.638 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.639 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.639 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.639 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.640 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.640 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.640 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.641 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.641 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.641 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.641 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.642 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2023-06-02T15:30:32.383863+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.642 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.642 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.643 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.643 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2023-06-02T15:30:32.383863+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.643 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.644 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.645 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.645 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-06-02T15:30:32.383863+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.646 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.646 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.646 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.647 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2023-06-02T15:30:32.383863+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.647 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.647 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.648 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.648 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.648 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-06-02T15:30:33.390390+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.649 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2023-06-02T15:30:32.383863+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.649 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.649 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.649 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.650 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2023-06-02T15:30:32.383863+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.650 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.650 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.651 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.651 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2023-06-02T15:30:32.383863+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.651 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.651 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.652 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.652 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-06-02T15:30:32.383863+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.652 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.653 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.653 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.654 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.654 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.654 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.654 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.655 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.655 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.655 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.656 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.656 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.656 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.657 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.657 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.657 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.657 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.658 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.658 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.658 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.659 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.659 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.659 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.659 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.660 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.660 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.660 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.661 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.661 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.661 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.661 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.662 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.662 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.662 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.663 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.663 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.663 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.663 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.664 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.664 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.664 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.665 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.665 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.665 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.666 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.666 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.666 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.667 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.667 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.667 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.667 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.668 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.668 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.668 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.669 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.669 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.669 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.670 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.670 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.670 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.670 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.671 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.671 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.671 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.672 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.672 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.672 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.673 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.673 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:38.673 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-02T15:31:44.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:31:44.444 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:31:44.447 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:31:44.449 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:31:58.675 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:31:58.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01c641640 1 Processor -- start 2023-06-02T15:31:58.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01c641640 1 -- start start 2023-06-02T15:31:58.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01c641640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb0140ba880 0x7fb0140a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01c641640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb01414fe20 0x7fb0141502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01c641640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0140bb0e0 con 0x7fb014149e00 2023-06-02T15:31:58.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01c641640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01414a1d0 con 0x7fb01414fe20 2023-06-02T15:31:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01c641640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0140a61d0 con 0x7fb0140ba880 2023-06-02T15:31:58.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01abde640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb01414fe20 0x7fb0141502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01a3dd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb014149e00 0x7fb0140a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:57158/0 (socket says 172.21.15.78:57158) 2023-06-02T15:31:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01a3dd640 1 -- 172.21.15.78:0/4156287776 learned_addr learned my addr 172.21.15.78:0/4156287776 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:31:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb019bdc640 1 --2- 172.21.15.78:0/4156287776 >> v2:172.21.15.132:3300/0 conn(0x7fb0140ba880 0x7fb0140a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:58.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb0193db640 1 -- 172.21.15.78:0/4156287776 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209034487 0 0) 0x7fb0140bb0e0 con 0x7fb014149e00 2023-06-02T15:31:58.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb0193db640 1 -- 172.21.15.78:0/4156287776 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb000003530 con 0x7fb014149e00 2023-06-02T15:31:58.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01abde640 1 -- 172.21.15.78:0/4156287776 >> v2:172.21.15.132:3300/0 conn(0x7fb0140ba880 msgr2=0x7fb0140a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:31:58.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01abde640 1 --2- 172.21.15.78:0/4156287776 >> v2:172.21.15.132:3300/0 conn(0x7fb0140ba880 0x7fb0140a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:58.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01abde640 1 -- 172.21.15.78:0/4156287776 >> v1:172.21.15.78:6789/0 conn(0x7fb014149e00 legacy=0x7fb0140a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:58.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.798+0000 7fb01abde640 1 -- 172.21.15.78:0/4156287776 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0140a3810 con 0x7fb01414fe20 2023-06-02T15:31:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01abde640 1 --2- 172.21.15.78:0/4156287776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb01414fe20 0x7fb0141502c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb0140bcf20 tx=0x7fb00c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1525928ed6dbe1ae server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:58.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb0193db640 1 -- 172.21.15.78:0/4156287776 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0a57d0 con 0x7fb01414fe20 2023-06-02T15:31:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb0193db640 1 -- 172.21.15.78:0/4156287776 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb00c0a5930 con 0x7fb01414fe20 2023-06-02T15:31:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb0193db640 1 -- 172.21.15.78:0/4156287776 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c0a5cc0 con 0x7fb01414fe20 2023-06-02T15:31:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 -- 172.21.15.78:0/4156287776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb01414fe20 msgr2=0x7fb0141502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 --2- 172.21.15.78:0/4156287776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb01414fe20 0x7fb0141502c0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fb0140bcf20 tx=0x7fb00c01c910 comp rx=0 tx=0).stop 2023-06-02T15:31:58.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 -- 172.21.15.78:0/4156287776 shutdown_connections 2023-06-02T15:31:58.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 --2- 172.21.15.78:0/4156287776 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb01414fe20 0x7fb0141502c0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:58.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 --2- 172.21.15.78:0/4156287776 >> v2:172.21.15.132:3300/0 conn(0x7fb0140ba880 0x7fb0140a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:58.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 -- 172.21.15.78:0/4156287776 >> 172.21.15.78:0/4156287776 conn(0x7fb0140bcf50 msgr2=0x7fb0140bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:58.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 -- 172.21.15.78:0/4156287776 shutdown_connections 2023-06-02T15:31:58.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 -- 172.21.15.78:0/4156287776 wait complete. 2023-06-02T15:31:58.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 Processor -- start 2023-06-02T15:31:58.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 -- start start 2023-06-02T15:31:58.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140ba880 0x7fb0140bee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:58.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb014149e00 0x7fb01414c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:58.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb01414fe20 0x7fb0140bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:58.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01406f1a0 con 0x7fb0140ba880 2023-06-02T15:31:58.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01406ecb0 con 0x7fb014149e00 2023-06-02T15:31:58.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01c641640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0141e76d0 con 0x7fb01414fe20 2023-06-02T15:31:58.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01a3dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140ba880 0x7fb0140bee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:58.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01a3dd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140ba880 0x7fb0140bee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33768/0 (socket says 172.21.15.78:33768) 2023-06-02T15:31:58.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01a3dd640 1 -- 172.21.15.78:0/160879851 learned_addr learned my addr 172.21.15.78:0/160879851 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:31:58.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01a3dd640 1 -- 172.21.15.78:0/160879851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb01414fe20 msgr2=0x7fb0140bfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:58.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01a3dd640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb01414fe20 0x7fb0140bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:58.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01a3dd640 1 -- 172.21.15.78:0/160879851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb014149e00 msgr2=0x7fb01414c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:58.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01a3dd640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb014149e00 0x7fb01414c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:58.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01a3dd640 1 -- 172.21.15.78:0/160879851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb00c009a70 con 0x7fb0140ba880 2023-06-02T15:31:58.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb01a3dd640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140ba880 0x7fb0140bee50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb00400c4d0 tx=0x7fb00400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:58.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb00affd640 1 -- 172.21.15.78:0/160879851 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004005cf0 con 0x7fb0140ba880 2023-06-02T15:31:58.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb00affd640 1 -- 172.21.15.78:0/160879851 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb004005e50 con 0x7fb0140ba880 2023-06-02T15:31:58.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.802+0000 7fb00affd640 1 -- 172.21.15.78:0/160879851 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb004007270 con 0x7fb0140ba880 2023-06-02T15:31:58.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.806+0000 7fb01c641640 1 -- 172.21.15.78:0/160879851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb014159700 con 0x7fb0140ba880 2023-06-02T15:31:58.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.806+0000 7fb01c641640 1 -- 172.21.15.78:0/160879851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0140a2b00 con 0x7fb0140ba880 2023-06-02T15:31:58.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.806+0000 7fb01c641640 1 -- 172.21.15.78:0/160879851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb014159890 con 0x7fb0140ba880 2023-06-02T15:31:58.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.806+0000 7fb00affd640 1 -- 172.21.15.78:0/160879851 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fb0040073d0 con 0x7fb0140ba880 2023-06-02T15:31:58.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.806+0000 7fb00affd640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faff8065c00 0x7faff80680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:31:58.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.806+0000 7fb019bdc640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faff8065c00 0x7faff80680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:31:58.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.806+0000 7fb00affd640 1 -- 172.21.15.78:0/160879851 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fb004082bf0 con 0x7fb0140ba880 2023-06-02T15:31:58.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.806+0000 7fb019bdc640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faff8065c00 0x7faff80680b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb01414d620 tx=0x7fb010008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:31:58.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.810+0000 7fb00affd640 1 -- 172.21.15.78:0/160879851 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fb00404a6e0 con 0x7fb0140ba880 2023-06-02T15:31:58.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.958+0000 7fb01c641640 1 -- 172.21.15.78:0/160879851 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb014073bc0 con 0x7faff8065c00 2023-06-02T15:31:58.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.986+0000 7fb00affd640 1 -- 172.21.15.78:0/160879851 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+389154 (secure 0 0 0) 0x7fb014073bc0 con 0x7faff8065c00 2023-06-02T15:31:58.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:31:59.001 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:31:59.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 -- 172.21.15.78:0/160879851 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faff8065c00 msgr2=0x7faff80680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:59.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faff8065c00 0x7faff80680b0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb01414d620 tx=0x7fb010008040 comp rx=0 tx=0).stop 2023-06-02T15:31:59.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 -- 172.21.15.78:0/160879851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140ba880 msgr2=0x7fb0140bee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:31:59.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140ba880 0x7fb0140bee50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fb00400c4d0 tx=0x7fb00400c990 comp rx=0 tx=0).stop 2023-06-02T15:31:59.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 -- 172.21.15.78:0/160879851 shutdown_connections 2023-06-02T15:31:59.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fb01414fe20 0x7fb0140bfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:59.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb014149e00 0x7fb01414c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:59.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7faff8065c00 0x7faff80680b0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:59.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 --2- 172.21.15.78:0/160879851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb0140ba880 0x7fb0140bee50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:31:59.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 -- 172.21.15.78:0/160879851 >> 172.21.15.78:0/160879851 conn(0x7fb0140bcf50 msgr2=0x7fb0141566f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:31:59.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.990+0000 7fb01c641640 1 -- 172.21.15.78:0/160879851 shutdown_connections 2023-06-02T15:31:59.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:31:58.994+0000 7fb01c641640 1 -- 172.21.15.78:0/160879851 wait complete. 2023-06-02T15:31:59.018 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2023-06-02T15:31:57.250643+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596054,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":172,"ondisk_log_size":172,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69984,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":67456,"kb_avail":754904736,"statfs":{"total":773094113280,"available":773022449664,"internally_reserved":0,"allocated":2523136,"data_stored":2182424,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69074944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004614"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.920658+0000","last_change":"2023-06-02T15:30:42.711237+0000","last_active":"2023-06-02T15:31:26.920658+0000","last_peered":"2023-06-02T15:31:26.920658+0000","last_clean":"2023-06-02T15:31:26.920658+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:31:26.920658+0000","last_undegraded":"2023-06-02T15:31:26.920658+0000","last_fullsized":"2023-06-02T15:31:26.920658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.684037+0000","last_change":"2023-06-02T15:30:38.275721+0000","last_active":"2023-06-02T15:31:26.684037+0000","last_peered":"2023-06-02T15:31:26.684037+0000","last_clean":"2023-06-02T15:31:26.684037+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:31:26.684037+0000","last_undegraded":"2023-06-02T15:31:26.684037+0000","last_fullsized":"2023-06-02T15:31:26.684037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.768317+0000","last_change":"2023-06-02T15:31:41.768563+0000","last_active":"2023-06-02T15:31:41.768317+0000","last_peered":"2023-06-02T15:31:41.768317+0000","last_clean":"2023-06-02T15:31:41.768317+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:31:41.768317+0000","last_undegraded":"2023-06-02T15:31:41.768317+0000","last_fullsized":"2023-06-02T15:31:41.768317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.768268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.768268+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.768268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:52.927565+0000","scrub_duration":0.003307744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585288+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:31:26.585288+0000","last_peered":"2023-06-02T15:31:26.585288+0000","last_clean":"2023-06-02T15:31:26.585288+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:31:26.585288+0000","last_undegraded":"2023-06-02T15:31:26.585288+0000","last_fullsized":"2023-06-02T15:31:26.585288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:50.673870+0000","last_change":"2023-06-02T15:31:50.674223+0000","last_active":"2023-06-02T15:31:50.673870+0000","last_peered":"2023-06-02T15:31:50.673870+0000","last_clean":"2023-06-02T15:31:50.673870+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:31:50.673870+0000","last_undegraded":"2023-06-02T15:31:50.673870+0000","last_fullsized":"2023-06-02T15:31:50.673870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:31:50.673816+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:31:50.673816+0000","last_clean_scrub_stamp":"2023-06-02T15:31:50.673816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:45.781711+0000","scrub_duration":0.0040557650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.755116+0000","last_change":"2023-06-02T15:30:38.638342+0000","last_active":"2023-06-02T15:31:26.755116+0000","last_peered":"2023-06-02T15:31:26.755116+0000","last_clean":"2023-06-02T15:31:26.755116+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:31:26.755116+0000","last_undegraded":"2023-06-02T15:31:26.755116+0000","last_fullsized":"2023-06-02T15:31:26.755116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.590779+0000","last_change":"2023-06-02T15:30:42.715416+0000","last_active":"2023-06-02T15:31:26.590779+0000","last_peered":"2023-06-02T15:31:26.590779+0000","last_clean":"2023-06-02T15:31:26.590779+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:31:26.590779+0000","last_undegraded":"2023-06-02T15:31:26.590779+0000","last_fullsized":"2023-06-02T15:31:26.590779+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.591495+0000","last_change":"2023-06-02T15:30:38.278973+0000","last_active":"2023-06-02T15:31:26.591495+0000","last_peered":"2023-06-02T15:31:26.591495+0000","last_clean":"2023-06-02T15:31:26.591495+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:31:26.591495+0000","last_undegraded":"2023-06-02T15:31:26.591495+0000","last_fullsized":"2023-06-02T15:31:26.591495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:42.741168+0000","last_change":"2023-06-02T15:31:42.741474+0000","last_active":"2023-06-02T15:31:42.741168+0000","last_peered":"2023-06-02T15:31:42.741168+0000","last_clean":"2023-06-02T15:31:42.741168+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:31:42.741168+0000","last_undegraded":"2023-06-02T15:31:42.741168+0000","last_fullsized":"2023-06-02T15:31:42.741168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:42.741115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:42.741115+0000","last_clean_scrub_stamp":"2023-06-02T15:31:42.741115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:22.341123+0000","scrub_duration":0.0040099519999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921431+0000","last_change":"2023-06-02T15:30:42.707090+0000","last_active":"2023-06-02T15:31:26.921431+0000","last_peered":"2023-06-02T15:31:26.921431+0000","last_clean":"2023-06-02T15:31:26.921431+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:31:26.921431+0000","last_undegraded":"2023-06-02T15:31:26.921431+0000","last_fullsized":"2023-06-02T15:31:26.921431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.591218+0000","last_change":"2023-06-02T15:30:38.269876+0000","last_active":"2023-06-02T15:31:26.591218+0000","last_peered":"2023-06-02T15:31:26.591218+0000","last_clean":"2023-06-02T15:31:26.591218+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:31:26.591218+0000","last_undegraded":"2023-06-02T15:31:26.591218+0000","last_fullsized":"2023-06-02T15:31:26.591218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:40.768267+0000","last_change":"2023-06-02T15:31:40.768497+0000","last_active":"2023-06-02T15:31:40.768267+0000","last_peered":"2023-06-02T15:31:40.768267+0000","last_clean":"2023-06-02T15:31:40.768267+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:31:40.768267+0000","last_undegraded":"2023-06-02T15:31:40.768267+0000","last_fullsized":"2023-06-02T15:31:40.768267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:40.768219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:40.768219+0000","last_clean_scrub_stamp":"2023-06-02T15:31:40.768219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:29:50.472958+0000","scrub_duration":0.0035921740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921566+0000","last_change":"2023-06-02T15:30:42.699623+0000","last_active":"2023-06-02T15:31:26.921566+0000","last_peered":"2023-06-02T15:31:26.921566+0000","last_clean":"2023-06-02T15:31:26.921566+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:31:26.921566+0000","last_undegraded":"2023-06-02T15:31:26.921566+0000","last_fullsized":"2023-06-02T15:31:26.921566+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.683617+0000","last_change":"2023-06-02T15:30:38.263534+0000","last_active":"2023-06-02T15:31:26.683617+0000","last_peered":"2023-06-02T15:31:26.683617+0000","last_clean":"2023-06-02T15:31:26.683617+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:31:26.683617+0000","last_undegraded":"2023-06-02T15:31:26.683617+0000","last_fullsized":"2023-06-02T15:31:26.683617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.770706+0000","last_change":"2023-06-02T15:31:36.770926+0000","last_active":"2023-06-02T15:31:36.770706+0000","last_peered":"2023-06-02T15:31:36.770706+0000","last_clean":"2023-06-02T15:31:36.770706+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:31:36.770706+0000","last_undegraded":"2023-06-02T15:31:36.770706+0000","last_fullsized":"2023-06-02T15:31:36.770706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:36.770650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:36.770650+0000","last_clean_scrub_stamp":"2023-06-02T15:31:36.770650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:01:52.784223+0000","scrub_duration":0.0030208169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.587870+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:31:26.587870+0000","last_peered":"2023-06-02T15:31:26.587870+0000","last_clean":"2023-06-02T15:31:26.587870+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:31:26.587870+0000","last_undegraded":"2023-06-02T15:31:26.587870+0000","last_fullsized":"2023-06-02T15:31:26.587870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.587586+0000","last_change":"2023-06-02T15:30:38.272143+0000","last_active":"2023-06-02T15:31:26.587586+0000","last_peered":"2023-06-02T15:31:26.587586+0000","last_clean":"2023-06-02T15:31:26.587586+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:31:26.587586+0000","last_undegraded":"2023-06-02T15:31:26.587586+0000","last_fullsized":"2023-06-02T15:31:26.587586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.724754+0000","last_change":"2023-06-02T15:31:43.724985+0000","last_active":"2023-06-02T15:31:43.724754+0000","last_peered":"2023-06-02T15:31:43.724754+0000","last_clean":"2023-06-02T15:31:43.724754+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:31:43.724754+0000","last_undegraded":"2023-06-02T15:31:43.724754+0000","last_fullsized":"2023-06-02T15:31:43.724754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.724701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.724701+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.724701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:24.477005+0000","scrub_duration":0.0034074370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.587082+0000","last_change":"2023-06-02T15:30:42.706975+0000","last_active":"2023-06-02T15:31:26.587082+0000","last_peered":"2023-06-02T15:31:26.587082+0000","last_clean":"2023-06-02T15:31:26.587082+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:31:26.587082+0000","last_undegraded":"2023-06-02T15:31:26.587082+0000","last_fullsized":"2023-06-02T15:31:26.587082+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.171811+0000","last_change":"2023-06-02T15:31:37.171911+0000","last_active":"2023-06-02T15:31:37.171811+0000","last_peered":"2023-06-02T15:31:37.171811+0000","last_clean":"2023-06-02T15:31:37.171811+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:31:37.171811+0000","last_undegraded":"2023-06-02T15:31:37.171811+0000","last_fullsized":"2023-06-02T15:31:37.171811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.171792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.171792+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.171792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:05.612504+0000","scrub_duration":0.00141092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.683532+0000","last_change":"2023-06-02T15:30:38.656679+0000","last_active":"2023-06-02T15:31:26.683532+0000","last_peered":"2023-06-02T15:31:26.683532+0000","last_clean":"2023-06-02T15:31:26.683532+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:31:26.683532+0000","last_undegraded":"2023-06-02T15:31:26.683532+0000","last_fullsized":"2023-06-02T15:31:26.683532+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.683971+0000","last_change":"2023-06-02T15:30:42.705633+0000","last_active":"2023-06-02T15:31:26.683971+0000","last_peered":"2023-06-02T15:31:26.683971+0000","last_clean":"2023-06-02T15:31:26.683971+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:31:26.683971+0000","last_undegraded":"2023-06-02T15:31:26.683971+0000","last_fullsized":"2023-06-02T15:31:26.683971+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.755950+0000","last_change":"2023-06-02T15:30:38.273154+0000","last_active":"2023-06-02T15:31:26.755950+0000","last_peered":"2023-06-02T15:31:26.755950+0000","last_clean":"2023-06-02T15:31:26.755950+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:31:26.755950+0000","last_undegraded":"2023-06-02T15:31:26.755950+0000","last_fullsized":"2023-06-02T15:31:26.755950+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.587251+0000","last_change":"2023-06-02T15:30:38.647445+0000","last_active":"2023-06-02T15:31:26.587251+0000","last_peered":"2023-06-02T15:31:26.587251+0000","last_clean":"2023-06-02T15:31:26.587251+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:31:26.587251+0000","last_undegraded":"2023-06-02T15:31:26.587251+0000","last_fullsized":"2023-06-02T15:31:26.587251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:39.691357+0000","last_change":"2023-06-02T15:31:39.691651+0000","last_active":"2023-06-02T15:31:39.691357+0000","last_peered":"2023-06-02T15:31:39.691357+0000","last_clean":"2023-06-02T15:31:39.691357+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:31:39.691357+0000","last_undegraded":"2023-06-02T15:31:39.691357+0000","last_fullsized":"2023-06-02T15:31:39.691357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:39.691303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:39.691303+0000","last_clean_scrub_stamp":"2023-06-02T15:31:39.691303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:08.670458+0000","scrub_duration":0.0032675849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:46.866855+0000","last_change":"2023-06-02T15:31:46.867109+0000","last_active":"2023-06-02T15:31:46.866855+0000","last_peered":"2023-06-02T15:31:46.866855+0000","last_clean":"2023-06-02T15:31:46.866855+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:31:46.866855+0000","last_undegraded":"2023-06-02T15:31:46.866855+0000","last_fullsized":"2023-06-02T15:31:46.866855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:46.866803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:46.866803+0000","last_clean_scrub_stamp":"2023-06-02T15:31:46.866803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:27.619106+0000","scrub_duration":0.0038372440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.584783+0000","last_change":"2023-06-02T15:30:42.710065+0000","last_active":"2023-06-02T15:31:26.584783+0000","last_peered":"2023-06-02T15:31:26.584783+0000","last_clean":"2023-06-02T15:31:26.584783+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:31:26.584783+0000","last_undegraded":"2023-06-02T15:31:26.584783+0000","last_fullsized":"2023-06-02T15:31:26.584783+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.756562+0000","last_change":"2023-06-02T15:30:38.656769+0000","last_active":"2023-06-02T15:31:26.756562+0000","last_peered":"2023-06-02T15:31:26.756562+0000","last_clean":"2023-06-02T15:31:26.756562+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:31:26.756562+0000","last_undegraded":"2023-06-02T15:31:26.756562+0000","last_fullsized":"2023-06-02T15:31:26.756562+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:46.537638+0000","last_change":"2023-06-02T15:31:46.537878+0000","last_active":"2023-06-02T15:31:46.537638+0000","last_peered":"2023-06-02T15:31:46.537638+0000","last_clean":"2023-06-02T15:31:46.537638+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:31:46.537638+0000","last_undegraded":"2023-06-02T15:31:46.537638+0000","last_fullsized":"2023-06-02T15:31:46.537638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:46.537583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:46.537583+0000","last_clean_scrub_stamp":"2023-06-02T15:31:46.537583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:57.696880+0000","scrub_duration":0.0033143180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.920759+0000","last_change":"2023-06-02T15:30:42.706722+0000","last_active":"2023-06-02T15:31:26.920759+0000","last_peered":"2023-06-02T15:31:26.920759+0000","last_clean":"2023-06-02T15:31:26.920759+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:31:26.920759+0000","last_undegraded":"2023-06-02T15:31:26.920759+0000","last_fullsized":"2023-06-02T15:31:26.920759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.000626+0000","last_change":"2023-06-02T15:31:44.000867+0000","last_active":"2023-06-02T15:31:44.000626+0000","last_peered":"2023-06-02T15:31:44.000626+0000","last_clean":"2023-06-02T15:31:44.000626+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:31:44.000626+0000","last_undegraded":"2023-06-02T15:31:44.000626+0000","last_fullsized":"2023-06-02T15:31:44.000626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-06-02T15:31:44.000570+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-06-02T15:31:44.000570+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.000570+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:12.979725+0000","scrub_duration":0.0085722809999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.919355+0000","last_change":"2023-06-02T15:30:38.642841+0000","last_active":"2023-06-02T15:31:26.919355+0000","last_peered":"2023-06-02T15:31:26.919355+0000","last_clean":"2023-06-02T15:31:26.919355+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:31:26.919355+0000","last_undegraded":"2023-06-02T15:31:26.919355+0000","last_fullsized":"2023-06-02T15:31:26.919355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.755954+0000","last_change":"2023-06-02T15:30:42.720577+0000","last_active":"2023-06-02T15:31:26.755954+0000","last_peered":"2023-06-02T15:31:26.755954+0000","last_clean":"2023-06-02T15:31:26.755954+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:31:26.755954+0000","last_undegraded":"2023-06-02T15:31:26.755954+0000","last_fullsized":"2023-06-02T15:31:26.755954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"26'15","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588377+0000","last_change":"2023-06-02T15:30:38.276703+0000","last_active":"2023-06-02T15:31:26.588377+0000","last_peered":"2023-06-02T15:31:26.588377+0000","last_clean":"2023-06-02T15:31:26.588377+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:31:26.588377+0000","last_undegraded":"2023-06-02T15:31:26.588377+0000","last_fullsized":"2023-06-02T15:31:26.588377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4904,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.587938+0000","last_change":"2023-06-02T15:30:38.634436+0000","last_active":"2023-06-02T15:31:26.587938+0000","last_peered":"2023-06-02T15:31:26.587938+0000","last_clean":"2023-06-02T15:31:26.587938+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:31:26.587938+0000","last_undegraded":"2023-06-02T15:31:26.587938+0000","last_fullsized":"2023-06-02T15:31:26.587938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921047+0000","last_change":"2023-06-02T15:30:42.707445+0000","last_active":"2023-06-02T15:31:26.921047+0000","last_peered":"2023-06-02T15:31:26.921047+0000","last_clean":"2023-06-02T15:31:26.921047+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:31:26.921047+0000","last_undegraded":"2023-06-02T15:31:26.921047+0000","last_fullsized":"2023-06-02T15:31:26.921047+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.270176+0000","last_change":"2023-06-02T15:31:51.270419+0000","last_active":"2023-06-02T15:31:51.270176+0000","last_peered":"2023-06-02T15:31:51.270176+0000","last_clean":"2023-06-02T15:31:51.270176+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:31:51.270176+0000","last_undegraded":"2023-06-02T15:31:51.270176+0000","last_fullsized":"2023-06-02T15:31:51.270176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.270125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.270125+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.270125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:30:00.974864+0000","scrub_duration":0.0038244239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.494370+0000","last_change":"2023-06-02T15:31:41.494671+0000","last_active":"2023-06-02T15:31:41.494370+0000","last_peered":"2023-06-02T15:31:41.494370+0000","last_clean":"2023-06-02T15:31:41.494370+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:31:41.494370+0000","last_undegraded":"2023-06-02T15:31:41.494370+0000","last_fullsized":"2023-06-02T15:31:41.494370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.494318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.494318+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.494318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:09.935029+0000","scrub_duration":0.0040292009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:49.596891+0000","last_change":"2023-06-02T15:31:49.597169+0000","last_active":"2023-06-02T15:31:49.596891+0000","last_peered":"2023-06-02T15:31:49.596891+0000","last_clean":"2023-06-02T15:31:49.596891+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:31:49.596891+0000","last_undegraded":"2023-06-02T15:31:49.596891+0000","last_fullsized":"2023-06-02T15:31:49.596891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:49.596840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:49.596840+0000","last_clean_scrub_stamp":"2023-06-02T15:31:49.596840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:44.704735+0000","scrub_duration":0.0034677010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.683126+0000","last_change":"2023-06-02T15:30:42.715780+0000","last_active":"2023-06-02T15:31:26.683126+0000","last_peered":"2023-06-02T15:31:26.683126+0000","last_clean":"2023-06-02T15:31:26.683126+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:31:26.683126+0000","last_undegraded":"2023-06-02T15:31:26.683126+0000","last_fullsized":"2023-06-02T15:31:26.683126+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.681914+0000","last_change":"2023-06-02T15:30:38.632171+0000","last_active":"2023-06-02T15:31:26.681914+0000","last_peered":"2023-06-02T15:31:26.681914+0000","last_clean":"2023-06-02T15:31:26.681914+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:31:26.681914+0000","last_undegraded":"2023-06-02T15:31:26.681914+0000","last_fullsized":"2023-06-02T15:31:26.681914+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:39.527675+0000","last_change":"2023-06-02T15:31:39.527934+0000","last_active":"2023-06-02T15:31:39.527675+0000","last_peered":"2023-06-02T15:31:39.527675+0000","last_clean":"2023-06-02T15:31:39.527675+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:31:39.527675+0000","last_undegraded":"2023-06-02T15:31:39.527675+0000","last_fullsized":"2023-06-02T15:31:39.527675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:39.527621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:39.527621+0000","last_clean_scrub_stamp":"2023-06-02T15:31:39.527621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:31:08.870956+0000","scrub_duration":0.0040577269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.313909+0000","last_change":"2023-06-02T15:31:48.314179+0000","last_active":"2023-06-02T15:31:48.313909+0000","last_peered":"2023-06-02T15:31:48.313909+0000","last_clean":"2023-06-02T15:31:48.313909+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:31:48.313909+0000","last_undegraded":"2023-06-02T15:31:48.313909+0000","last_fullsized":"2023-06-02T15:31:48.313909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.313862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.313862+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.313862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:19:57.371808+0000","scrub_duration":0.003324671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585205+0000","last_change":"2023-06-02T15:30:42.698823+0000","last_active":"2023-06-02T15:31:26.585205+0000","last_peered":"2023-06-02T15:31:26.585205+0000","last_clean":"2023-06-02T15:31:26.585205+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:31:26.585205+0000","last_undegraded":"2023-06-02T15:31:26.585205+0000","last_fullsized":"2023-06-02T15:31:26.585205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:40.702232+0000","last_change":"2023-06-02T15:31:40.702502+0000","last_active":"2023-06-02T15:31:40.702232+0000","last_peered":"2023-06-02T15:31:40.702232+0000","last_clean":"2023-06-02T15:31:40.702232+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:31:40.702232+0000","last_undegraded":"2023-06-02T15:31:40.702232+0000","last_fullsized":"2023-06-02T15:31:40.702232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:40.702183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:40.702183+0000","last_clean_scrub_stamp":"2023-06-02T15:31:40.702183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:17.405756+0000","scrub_duration":0.0083223120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588866+0000","last_change":"2023-06-02T15:30:33.959737+0000","last_active":"2023-06-02T15:31:26.588866+0000","last_peered":"2023-06-02T15:31:26.588866+0000","last_clean":"2023-06-02T15:31:26.588866+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:31:26.588866+0000","last_undegraded":"2023-06-02T15:31:26.588866+0000","last_fullsized":"2023-06-02T15:31:26.588866+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:32.383863+0000","last_clean_scrub_stamp":"2023-06-02T15:30:32.383863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.758082+0000","last_change":"2023-06-02T15:30:38.281667+0000","last_active":"2023-06-02T15:31:26.758082+0000","last_peered":"2023-06-02T15:31:26.758082+0000","last_clean":"2023-06-02T15:31:26.758082+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:31:26.758082+0000","last_undegraded":"2023-06-02T15:31:26.758082+0000","last_fullsized":"2023-06-02T15:31:26.758082+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585197+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:31:26.585197+0000","last_peered":"2023-06-02T15:31:26.585197+0000","last_clean":"2023-06-02T15:31:26.585197+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:31:26.585197+0000","last_undegraded":"2023-06-02T15:31:26.585197+0000","last_fullsized":"2023-06-02T15:31:26.585197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585793+0000","last_change":"2023-06-02T15:30:38.646642+0000","last_active":"2023-06-02T15:31:26.585793+0000","last_peered":"2023-06-02T15:31:26.585793+0000","last_clean":"2023-06-02T15:31:26.585793+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:31:26.585793+0000","last_undegraded":"2023-06-02T15:31:26.585793+0000","last_fullsized":"2023-06-02T15:31:26.585793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:49.711619+0000","last_change":"2023-06-02T15:31:49.712018+0000","last_active":"2023-06-02T15:31:49.711619+0000","last_peered":"2023-06-02T15:31:49.711619+0000","last_clean":"2023-06-02T15:31:49.711619+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:31:49.711619+0000","last_undegraded":"2023-06-02T15:31:49.711619+0000","last_fullsized":"2023-06-02T15:31:49.711619+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:49.711487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:49.711487+0000","last_clean_scrub_stamp":"2023-06-02T15:31:49.711487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:29.311495+0000","scrub_duration":0.0044216419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:42.817603+0000","last_change":"2023-06-02T15:31:42.817844+0000","last_active":"2023-06-02T15:31:42.817603+0000","last_peered":"2023-06-02T15:31:42.817603+0000","last_clean":"2023-06-02T15:31:42.817603+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:31:42.817603+0000","last_undegraded":"2023-06-02T15:31:42.817603+0000","last_fullsized":"2023-06-02T15:31:42.817603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:31:42.817550+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:31:42.817550+0000","last_clean_scrub_stamp":"2023-06-02T15:31:42.817550+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:11.796705+0000","scrub_duration":0.0085183749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.755496+0000","last_change":"2023-06-02T15:30:42.702383+0000","last_active":"2023-06-02T15:31:26.755496+0000","last_peered":"2023-06-02T15:31:26.755496+0000","last_clean":"2023-06-02T15:31:26.755496+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:31:26.755496+0000","last_undegraded":"2023-06-02T15:31:26.755496+0000","last_fullsized":"2023-06-02T15:31:26.755496+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:35.675238+0000","last_change":"2023-06-02T15:31:35.675333+0000","last_active":"2023-06-02T15:31:35.675238+0000","last_peered":"2023-06-02T15:31:35.675238+0000","last_clean":"2023-06-02T15:31:35.675238+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:31:35.675238+0000","last_undegraded":"2023-06-02T15:31:35.675238+0000","last_fullsized":"2023-06-02T15:31:35.675238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:35.675220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:35.675220+0000","last_clean_scrub_stamp":"2023-06-02T15:31:35.675220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:46:41.873628+0000","scrub_duration":0.001699594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.893366+0000","last_change":"2023-06-02T15:31:51.893605+0000","last_active":"2023-06-02T15:31:51.893366+0000","last_peered":"2023-06-02T15:31:51.893366+0000","last_clean":"2023-06-02T15:31:51.893366+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:31:51.893366+0000","last_undegraded":"2023-06-02T15:31:51.893366+0000","last_fullsized":"2023-06-02T15:31:51.893366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.893317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.893317+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.893317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:03.052614+0000","scrub_duration":0.0037955900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"17'117","reported_seq":170,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921346+0000","last_change":"2023-06-02T15:30:34.413807+0000","last_active":"2023-06-02T15:31:26.921346+0000","last_peered":"2023-06-02T15:31:26.921346+0000","last_clean":"2023-06-02T15:31:26.921346+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:31:26.921346+0000","last_undegraded":"2023-06-02T15:31:26.921346+0000","last_fullsized":"2023-06-02T15:31:26.921346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:33.390390+0000","last_clean_scrub_stamp":"2023-06-02T15:30:33.390390+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.176598+0000","last_change":"2023-06-02T15:31:36.176680+0000","last_active":"2023-06-02T15:31:36.176598+0000","last_peered":"2023-06-02T15:31:36.176598+0000","last_clean":"2023-06-02T15:31:36.176598+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:31:36.176598+0000","last_undegraded":"2023-06-02T15:31:36.176598+0000","last_fullsized":"2023-06-02T15:31:36.176598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:36.176579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:36.176579+0000","last_clean_scrub_stamp":"2023-06-02T15:31:36.176579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:31:05.519914+0000","scrub_duration":0.0032385439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.591577+0000","last_change":"2023-06-02T15:30:42.712421+0000","last_active":"2023-06-02T15:31:26.591577+0000","last_peered":"2023-06-02T15:31:26.591577+0000","last_clean":"2023-06-02T15:31:26.591577+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:31:26.591577+0000","last_undegraded":"2023-06-02T15:31:26.591577+0000","last_fullsized":"2023-06-02T15:31:26.591577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.919668+0000","last_change":"2023-06-02T15:30:38.653404+0000","last_active":"2023-06-02T15:31:26.919668+0000","last_peered":"2023-06-02T15:31:26.919668+0000","last_clean":"2023-06-02T15:31:26.919668+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:31:26.919668+0000","last_undegraded":"2023-06-02T15:31:26.919668+0000","last_fullsized":"2023-06-02T15:31:26.919668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.316285+0000","last_change":"2023-06-02T15:31:43.316509+0000","last_active":"2023-06-02T15:31:43.316285+0000","last_peered":"2023-06-02T15:31:43.316285+0000","last_clean":"2023-06-02T15:31:43.316285+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:31:43.316285+0000","last_undegraded":"2023-06-02T15:31:43.316285+0000","last_fullsized":"2023-06-02T15:31:43.316285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.316233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.316233+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.316233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:55:51.972560+0000","scrub_duration":0.0081781270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.031012+0000","last_change":"2023-06-02T15:31:45.031260+0000","last_active":"2023-06-02T15:31:45.031012+0000","last_peered":"2023-06-02T15:31:45.031012+0000","last_clean":"2023-06-02T15:31:45.031012+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:31:45.031012+0000","last_undegraded":"2023-06-02T15:31:45.031012+0000","last_fullsized":"2023-06-02T15:31:45.031012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.030964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.030964+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.030964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:21.734537+0000","scrub_duration":0.0035987649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.582409+0000","last_change":"2023-06-02T15:30:42.705191+0000","last_active":"2023-06-02T15:31:26.582409+0000","last_peered":"2023-06-02T15:31:26.582409+0000","last_clean":"2023-06-02T15:31:26.582409+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:31:26.582409+0000","last_undegraded":"2023-06-02T15:31:26.582409+0000","last_fullsized":"2023-06-02T15:31:26.582409+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.919406+0000","last_change":"2023-06-02T15:30:38.642359+0000","last_active":"2023-06-02T15:31:26.919406+0000","last_peered":"2023-06-02T15:31:26.919406+0000","last_clean":"2023-06-02T15:31:26.919406+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:31:26.919406+0000","last_undegraded":"2023-06-02T15:31:26.919406+0000","last_fullsized":"2023-06-02T15:31:26.919406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588198+0000","last_change":"2023-06-02T15:30:38.257531+0000","last_active":"2023-06-02T15:31:26.588198+0000","last_peered":"2023-06-02T15:31:26.588198+0000","last_clean":"2023-06-02T15:31:26.588198+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:31:26.588198+0000","last_undegraded":"2023-06-02T15:31:26.588198+0000","last_fullsized":"2023-06-02T15:31:26.588198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.531125+0000","last_change":"2023-06-02T15:31:45.531411+0000","last_active":"2023-06-02T15:31:45.531125+0000","last_peered":"2023-06-02T15:31:45.531125+0000","last_clean":"2023-06-02T15:31:45.531125+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:31:45.531125+0000","last_undegraded":"2023-06-02T15:31:45.531125+0000","last_fullsized":"2023-06-02T15:31:45.531125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.531079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.531079+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.531079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:29:55.235818+0000","scrub_duration":0.0038552180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.683397+0000","last_change":"2023-06-02T15:30:42.693557+0000","last_active":"2023-06-02T15:31:26.683397+0000","last_peered":"2023-06-02T15:31:26.683397+0000","last_clean":"2023-06-02T15:31:26.683397+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:31:26.683397+0000","last_undegraded":"2023-06-02T15:31:26.683397+0000","last_fullsized":"2023-06-02T15:31:26.683397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.586626+0000","last_change":"2023-06-02T15:30:38.645488+0000","last_active":"2023-06-02T15:31:26.586626+0000","last_peered":"2023-06-02T15:31:26.586626+0000","last_clean":"2023-06-02T15:31:26.586626+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:31:26.586626+0000","last_undegraded":"2023-06-02T15:31:26.586626+0000","last_fullsized":"2023-06-02T15:31:26.586626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.756157+0000","last_change":"2023-06-02T15:30:38.283390+0000","last_active":"2023-06-02T15:31:26.756157+0000","last_peered":"2023-06-02T15:31:26.756157+0000","last_clean":"2023-06-02T15:31:26.756157+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:31:26.756157+0000","last_undegraded":"2023-06-02T15:31:26.756157+0000","last_fullsized":"2023-06-02T15:31:26.756157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.101882+0000","last_change":"2023-06-02T15:31:48.102141+0000","last_active":"2023-06-02T15:31:48.101882+0000","last_peered":"2023-06-02T15:31:48.101882+0000","last_clean":"2023-06-02T15:31:48.101882+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:31:48.101882+0000","last_undegraded":"2023-06-02T15:31:48.101882+0000","last_fullsized":"2023-06-02T15:31:48.101882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.101830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.101830+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.101830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:28.854133+0000","scrub_duration":0.0082640209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.922116+0000","last_change":"2023-06-02T15:30:42.723169+0000","last_active":"2023-06-02T15:31:26.922116+0000","last_peered":"2023-06-02T15:31:26.922116+0000","last_clean":"2023-06-02T15:31:26.922116+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:31:26.922116+0000","last_undegraded":"2023-06-02T15:31:26.922116+0000","last_fullsized":"2023-06-02T15:31:26.922116+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:27.261530+0000","last_change":"2023-06-02T15:31:26.759068+0000","last_active":"2023-06-02T15:31:27.261530+0000","last_peered":"2023-06-02T15:31:27.261530+0000","last_clean":"2023-06-02T15:31:27.261530+0000","last_became_active":"2023-06-02T15:31:26.758308+0000","last_became_peered":"2023-06-02T15:31:26.758308+0000","last_unstale":"2023-06-02T15:31:27.261530+0000","last_undegraded":"2023-06-02T15:31:27.261530+0000","last_fullsized":"2023-06-02T15:31:27.261530+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.756158+0000","last_change":"2023-06-02T15:30:38.281851+0000","last_active":"2023-06-02T15:31:26.756158+0000","last_peered":"2023-06-02T15:31:26.756158+0000","last_clean":"2023-06-02T15:31:26.756158+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:31:26.756158+0000","last_undegraded":"2023-06-02T15:31:26.756158+0000","last_fullsized":"2023-06-02T15:31:26.756158+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.589177+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:31:26.589177+0000","last_peered":"2023-06-02T15:31:26.589177+0000","last_clean":"2023-06-02T15:31:26.589177+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:31:26.589177+0000","last_undegraded":"2023-06-02T15:31:26.589177+0000","last_fullsized":"2023-06-02T15:31:26.589177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.589162+0000","last_change":"2023-06-02T15:30:38.638725+0000","last_active":"2023-06-02T15:31:26.589162+0000","last_peered":"2023-06-02T15:31:26.589162+0000","last_clean":"2023-06-02T15:31:26.589162+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:31:26.589162+0000","last_undegraded":"2023-06-02T15:31:26.589162+0000","last_fullsized":"2023-06-02T15:31:26.589162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585940+0000","last_change":"2023-06-02T15:30:38.269278+0000","last_active":"2023-06-02T15:31:26.585940+0000","last_peered":"2023-06-02T15:31:26.585940+0000","last_clean":"2023-06-02T15:31:26.585940+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:31:26.585940+0000","last_undegraded":"2023-06-02T15:31:26.585940+0000","last_fullsized":"2023-06-02T15:31:26.585940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.591575+0000","last_change":"2023-06-02T15:30:42.713071+0000","last_active":"2023-06-02T15:31:26.591575+0000","last_peered":"2023-06-02T15:31:26.591575+0000","last_clean":"2023-06-02T15:31:26.591575+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:31:26.591575+0000","last_undegraded":"2023-06-02T15:31:26.591575+0000","last_fullsized":"2023-06-02T15:31:26.591575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588683+0000","last_change":"2023-06-02T15:30:38.636565+0000","last_active":"2023-06-02T15:31:26.588683+0000","last_peered":"2023-06-02T15:31:26.588683+0000","last_clean":"2023-06-02T15:31:26.588683+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:31:26.588683+0000","last_undegraded":"2023-06-02T15:31:26.588683+0000","last_fullsized":"2023-06-02T15:31:26.588683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.525360+0000","last_change":"2023-06-02T15:31:45.525640+0000","last_active":"2023-06-02T15:31:45.525360+0000","last_peered":"2023-06-02T15:31:45.525360+0000","last_clean":"2023-06-02T15:31:45.525360+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:31:45.525360+0000","last_undegraded":"2023-06-02T15:31:45.525360+0000","last_fullsized":"2023-06-02T15:31:45.525360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.525308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.525308+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.525308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:22.228881+0000","scrub_duration":0.0032755190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921436+0000","last_change":"2023-06-02T15:30:42.697724+0000","last_active":"2023-06-02T15:31:26.921436+0000","last_peered":"2023-06-02T15:31:26.921436+0000","last_clean":"2023-06-02T15:31:26.921436+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:31:26.921436+0000","last_undegraded":"2023-06-02T15:31:26.921436+0000","last_fullsized":"2023-06-02T15:31:26.921436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588262+0000","last_change":"2023-06-02T15:30:38.640532+0000","last_active":"2023-06-02T15:31:26.588262+0000","last_peered":"2023-06-02T15:31:26.588262+0000","last_clean":"2023-06-02T15:31:26.588262+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:31:26.588262+0000","last_undegraded":"2023-06-02T15:31:26.588262+0000","last_fullsized":"2023-06-02T15:31:26.588262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.757050+0000","last_change":"2023-06-02T15:30:38.281909+0000","last_active":"2023-06-02T15:31:26.757050+0000","last_peered":"2023-06-02T15:31:26.757050+0000","last_clean":"2023-06-02T15:31:26.757050+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:31:26.757050+0000","last_undegraded":"2023-06-02T15:31:26.757050+0000","last_fullsized":"2023-06-02T15:31:26.757050+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.581964+0000","last_change":"2023-06-02T15:30:42.716337+0000","last_active":"2023-06-02T15:31:26.581964+0000","last_peered":"2023-06-02T15:31:26.581964+0000","last_clean":"2023-06-02T15:31:26.581964+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:31:26.581964+0000","last_undegraded":"2023-06-02T15:31:26.581964+0000","last_fullsized":"2023-06-02T15:31:26.581964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.683118+0000","last_change":"2023-06-02T15:30:38.651270+0000","last_active":"2023-06-02T15:31:26.683118+0000","last_peered":"2023-06-02T15:31:26.683118+0000","last_clean":"2023-06-02T15:31:26.683118+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:31:26.683118+0000","last_undegraded":"2023-06-02T15:31:26.683118+0000","last_fullsized":"2023-06-02T15:31:26.683118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.590797+0000","last_change":"2023-06-02T15:30:38.277304+0000","last_active":"2023-06-02T15:31:26.590797+0000","last_peered":"2023-06-02T15:31:26.590797+0000","last_clean":"2023-06-02T15:31:26.590797+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:31:26.590797+0000","last_undegraded":"2023-06-02T15:31:26.590797+0000","last_fullsized":"2023-06-02T15:31:26.590797+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.581394+0000","last_change":"2023-06-02T15:30:42.692861+0000","last_active":"2023-06-02T15:31:26.581394+0000","last_peered":"2023-06-02T15:31:26.581394+0000","last_clean":"2023-06-02T15:31:26.581394+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:31:26.581394+0000","last_undegraded":"2023-06-02T15:31:26.581394+0000","last_fullsized":"2023-06-02T15:31:26.581394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585414+0000","last_change":"2023-06-02T15:30:38.645534+0000","last_active":"2023-06-02T15:31:26.585414+0000","last_peered":"2023-06-02T15:31:26.585414+0000","last_clean":"2023-06-02T15:31:26.585414+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:31:26.585414+0000","last_undegraded":"2023-06-02T15:31:26.585414+0000","last_fullsized":"2023-06-02T15:31:26.585414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.922364+0000","last_change":"2023-06-02T15:30:38.282239+0000","last_active":"2023-06-02T15:31:26.922364+0000","last_peered":"2023-06-02T15:31:26.922364+0000","last_clean":"2023-06-02T15:31:26.922364+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:31:26.922364+0000","last_undegraded":"2023-06-02T15:31:26.922364+0000","last_fullsized":"2023-06-02T15:31:26.922364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.581730+0000","last_change":"2023-06-02T15:30:42.720849+0000","last_active":"2023-06-02T15:31:26.581730+0000","last_peered":"2023-06-02T15:31:26.581730+0000","last_clean":"2023-06-02T15:31:26.581730+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:31:26.581730+0000","last_undegraded":"2023-06-02T15:31:26.581730+0000","last_fullsized":"2023-06-02T15:31:26.581730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.793654+0000","last_change":"2023-06-02T15:31:51.794000+0000","last_active":"2023-06-02T15:31:51.793654+0000","last_peered":"2023-06-02T15:31:51.793654+0000","last_clean":"2023-06-02T15:31:51.793654+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:31:51.793654+0000","last_undegraded":"2023-06-02T15:31:51.793654+0000","last_fullsized":"2023-06-02T15:31:51.793654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.793607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.793607+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.793607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:03.443296+0000","scrub_duration":0.0037644940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.922660+0000","last_change":"2023-06-02T15:30:38.282724+0000","last_active":"2023-06-02T15:31:26.922660+0000","last_peered":"2023-06-02T15:31:26.922660+0000","last_clean":"2023-06-02T15:31:26.922660+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:31:26.922660+0000","last_undegraded":"2023-06-02T15:31:26.922660+0000","last_fullsized":"2023-06-02T15:31:26.922660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.745277+0000","last_change":"2023-06-02T15:31:48.745565+0000","last_active":"2023-06-02T15:31:48.745277+0000","last_peered":"2023-06-02T15:31:48.745277+0000","last_clean":"2023-06-02T15:31:48.745277+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:31:48.745277+0000","last_undegraded":"2023-06-02T15:31:48.745277+0000","last_fullsized":"2023-06-02T15:31:48.745277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.745224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.745224+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.745224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:29.497528+0000","scrub_duration":0.0041717810000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.590300+0000","last_change":"2023-06-02T15:30:38.656950+0000","last_active":"2023-06-02T15:31:26.590300+0000","last_peered":"2023-06-02T15:31:26.590300+0000","last_clean":"2023-06-02T15:31:26.590300+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:31:26.590300+0000","last_undegraded":"2023-06-02T15:31:26.590300+0000","last_fullsized":"2023-06-02T15:31:26.590300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.922776+0000","last_change":"2023-06-02T15:30:38.283602+0000","last_active":"2023-06-02T15:31:26.922776+0000","last_peered":"2023-06-02T15:31:26.922776+0000","last_clean":"2023-06-02T15:31:26.922776+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:31:26.922776+0000","last_undegraded":"2023-06-02T15:31:26.922776+0000","last_fullsized":"2023-06-02T15:31:26.922776+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921434+0000","last_change":"2023-06-02T15:30:42.722884+0000","last_active":"2023-06-02T15:31:26.921434+0000","last_peered":"2023-06-02T15:31:26.921434+0000","last_clean":"2023-06-02T15:31:26.921434+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:31:26.921434+0000","last_undegraded":"2023-06-02T15:31:26.921434+0000","last_fullsized":"2023-06-02T15:31:26.921434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.591127+0000","last_change":"2023-06-02T15:30:42.714188+0000","last_active":"2023-06-02T15:31:26.591127+0000","last_peered":"2023-06-02T15:31:26.591127+0000","last_clean":"2023-06-02T15:31:26.591127+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:31:26.591127+0000","last_undegraded":"2023-06-02T15:31:26.591127+0000","last_fullsized":"2023-06-02T15:31:26.591127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'12","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.534180+0000","last_change":"2023-06-02T15:31:44.534507+0000","last_active":"2023-06-02T15:31:44.534180+0000","last_peered":"2023-06-02T15:31:44.534180+0000","last_clean":"2023-06-02T15:31:44.534180+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:31:44.534180+0000","last_undegraded":"2023-06-02T15:31:44.534180+0000","last_fullsized":"2023-06-02T15:31:44.534180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2023-06-02T15:31:44.534127+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2023-06-02T15:31:44.534127+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.534127+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:13.513282+0000","scrub_duration":0.010992052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.758033+0000","last_change":"2023-06-02T15:30:38.658984+0000","last_active":"2023-06-02T15:31:26.758033+0000","last_peered":"2023-06-02T15:31:26.758033+0000","last_clean":"2023-06-02T15:31:26.758033+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:31:26.758033+0000","last_undegraded":"2023-06-02T15:31:26.758033+0000","last_fullsized":"2023-06-02T15:31:26.758033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.757737+0000","last_change":"2023-06-02T15:30:42.705561+0000","last_active":"2023-06-02T15:31:26.757737+0000","last_peered":"2023-06-02T15:31:26.757737+0000","last_clean":"2023-06-02T15:31:26.757737+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:31:26.757737+0000","last_undegraded":"2023-06-02T15:31:26.757737+0000","last_fullsized":"2023-06-02T15:31:26.757737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921669+0000","last_change":"2023-06-02T15:30:38.283796+0000","last_active":"2023-06-02T15:31:26.921669+0000","last_peered":"2023-06-02T15:31:26.921669+0000","last_clean":"2023-06-02T15:31:26.921669+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:31:26.921669+0000","last_undegraded":"2023-06-02T15:31:26.921669+0000","last_fullsized":"2023-06-02T15:31:26.921669+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.683749+0000","last_change":"2023-06-02T15:30:38.644966+0000","last_active":"2023-06-02T15:31:26.683749+0000","last_peered":"2023-06-02T15:31:26.683749+0000","last_clean":"2023-06-02T15:31:26.683749+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:31:26.683749+0000","last_undegraded":"2023-06-02T15:31:26.683749+0000","last_fullsized":"2023-06-02T15:31:26.683749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.800790+0000","last_change":"2023-06-02T15:31:43.801035+0000","last_active":"2023-06-02T15:31:43.800790+0000","last_peered":"2023-06-02T15:31:43.800790+0000","last_clean":"2023-06-02T15:31:43.800790+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:31:43.800790+0000","last_undegraded":"2023-06-02T15:31:43.800790+0000","last_fullsized":"2023-06-02T15:31:43.800790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.800740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.800740+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.800740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:20.504313+0000","scrub_duration":0.0039374529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.591298+0000","last_change":"2023-06-02T15:30:38.657999+0000","last_active":"2023-06-02T15:31:26.591298+0000","last_peered":"2023-06-02T15:31:26.591298+0000","last_clean":"2023-06-02T15:31:26.591298+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:31:26.591298+0000","last_undegraded":"2023-06-02T15:31:26.591298+0000","last_fullsized":"2023-06-02T15:31:26.591298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.756671+0000","last_change":"2023-06-02T15:30:42.705725+0000","last_active":"2023-06-02T15:31:26.756671+0000","last_peered":"2023-06-02T15:31:26.756671+0000","last_clean":"2023-06-02T15:31:26.756671+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:31:26.756671+0000","last_undegraded":"2023-06-02T15:31:26.756671+0000","last_fullsized":"2023-06-02T15:31:26.756671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.922010+0000","last_change":"2023-06-02T15:30:38.282095+0000","last_active":"2023-06-02T15:31:26.922010+0000","last_peered":"2023-06-02T15:31:26.922010+0000","last_clean":"2023-06-02T15:31:26.922010+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:31:26.922010+0000","last_undegraded":"2023-06-02T15:31:26.922010+0000","last_fullsized":"2023-06-02T15:31:26.922010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:27.266998+0000","last_change":"2023-06-02T15:31:26.924308+0000","last_active":"2023-06-02T15:31:27.266998+0000","last_peered":"2023-06-02T15:31:27.266998+0000","last_clean":"2023-06-02T15:31:27.266998+0000","last_became_active":"2023-06-02T15:31:26.923733+0000","last_became_peered":"2023-06-02T15:31:26.923733+0000","last_unstale":"2023-06-02T15:31:27.266998+0000","last_undegraded":"2023-06-02T15:31:27.266998+0000","last_fullsized":"2023-06-02T15:31:27.266998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.590990+0000","last_change":"2023-06-02T15:30:42.702456+0000","last_active":"2023-06-02T15:31:26.590990+0000","last_peered":"2023-06-02T15:31:26.590990+0000","last_clean":"2023-06-02T15:31:26.590990+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:31:26.590990+0000","last_undegraded":"2023-06-02T15:31:26.590990+0000","last_fullsized":"2023-06-02T15:31:26.590990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.584731+0000","last_change":"2023-06-02T15:30:38.637380+0000","last_active":"2023-06-02T15:31:26.584731+0000","last_peered":"2023-06-02T15:31:26.584731+0000","last_clean":"2023-06-02T15:31:26.584731+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:31:26.584731+0000","last_undegraded":"2023-06-02T15:31:26.584731+0000","last_fullsized":"2023-06-02T15:31:26.584731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.756192+0000","last_change":"2023-06-02T15:30:38.655074+0000","last_active":"2023-06-02T15:31:26.756192+0000","last_peered":"2023-06-02T15:31:26.756192+0000","last_clean":"2023-06-02T15:31:26.756192+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:31:26.756192+0000","last_undegraded":"2023-06-02T15:31:26.756192+0000","last_fullsized":"2023-06-02T15:31:26.756192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.809260+0000","last_change":"2023-06-02T15:31:48.809508+0000","last_active":"2023-06-02T15:31:48.809260+0000","last_peered":"2023-06-02T15:31:48.809260+0000","last_clean":"2023-06-02T15:31:48.809260+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:31:48.809260+0000","last_undegraded":"2023-06-02T15:31:48.809260+0000","last_fullsized":"2023-06-02T15:31:48.809260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.809212+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:08.812638+0000","scrub_duration":0.003422675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.712883+0000","last_change":"2023-06-02T15:31:48.713166+0000","last_active":"2023-06-02T15:31:48.712883+0000","last_peered":"2023-06-02T15:31:48.712883+0000","last_clean":"2023-06-02T15:31:48.712883+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:31:48.712883+0000","last_undegraded":"2023-06-02T15:31:48.712883+0000","last_fullsized":"2023-06-02T15:31:48.712883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.712833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.712833+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.712833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:59.872130+0000","scrub_duration":0.0041090880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921850+0000","last_change":"2023-06-02T15:30:38.656408+0000","last_active":"2023-06-02T15:31:26.921850+0000","last_peered":"2023-06-02T15:31:26.921850+0000","last_clean":"2023-06-02T15:31:26.921850+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:31:26.921850+0000","last_undegraded":"2023-06-02T15:31:26.921850+0000","last_fullsized":"2023-06-02T15:31:26.921850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.591236+0000","last_change":"2023-06-02T15:30:38.658103+0000","last_active":"2023-06-02T15:31:26.591236+0000","last_peered":"2023-06-02T15:31:26.591236+0000","last_clean":"2023-06-02T15:31:26.591236+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:31:26.591236+0000","last_undegraded":"2023-06-02T15:31:26.591236+0000","last_fullsized":"2023-06-02T15:31:26.591236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.919720+0000","last_change":"2023-06-02T15:30:38.641657+0000","last_active":"2023-06-02T15:31:26.919720+0000","last_peered":"2023-06-02T15:31:26.919720+0000","last_clean":"2023-06-02T15:31:26.919720+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:31:26.919720+0000","last_undegraded":"2023-06-02T15:31:26.919720+0000","last_fullsized":"2023-06-02T15:31:26.919720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.919972+0000","last_change":"2023-06-02T15:30:38.640289+0000","last_active":"2023-06-02T15:31:26.919972+0000","last_peered":"2023-06-02T15:31:26.919972+0000","last_clean":"2023-06-02T15:31:26.919972+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:31:26.919972+0000","last_undegraded":"2023-06-02T15:31:26.919972+0000","last_fullsized":"2023-06-02T15:31:26.919972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921002+0000","last_change":"2023-06-02T15:30:38.656963+0000","last_active":"2023-06-02T15:31:26.921002+0000","last_peered":"2023-06-02T15:31:26.921002+0000","last_clean":"2023-06-02T15:31:26.921002+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:31:26.921002+0000","last_undegraded":"2023-06-02T15:31:26.921002+0000","last_fullsized":"2023-06-02T15:31:26.921002+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.755935+0000","last_change":"2023-06-02T15:30:38.648546+0000","last_active":"2023-06-02T15:31:26.755935+0000","last_peered":"2023-06-02T15:31:26.755935+0000","last_clean":"2023-06-02T15:31:26.755935+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:31:26.755935+0000","last_undegraded":"2023-06-02T15:31:26.755935+0000","last_fullsized":"2023-06-02T15:31:26.755935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.682738+0000","last_change":"2023-06-02T15:30:38.643407+0000","last_active":"2023-06-02T15:31:26.682738+0000","last_peered":"2023-06-02T15:31:26.682738+0000","last_clean":"2023-06-02T15:31:26.682738+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:31:26.682738+0000","last_undegraded":"2023-06-02T15:31:26.682738+0000","last_fullsized":"2023-06-02T15:31:26.682738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921857+0000","last_change":"2023-06-02T15:30:38.657038+0000","last_active":"2023-06-02T15:31:26.921857+0000","last_peered":"2023-06-02T15:31:26.921857+0000","last_clean":"2023-06-02T15:31:26.921857+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:31:26.921857+0000","last_undegraded":"2023-06-02T15:31:26.921857+0000","last_fullsized":"2023-06-02T15:31:26.921857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588198+0000","last_change":"2023-06-02T15:30:38.638594+0000","last_active":"2023-06-02T15:31:26.588198+0000","last_peered":"2023-06-02T15:31:26.588198+0000","last_clean":"2023-06-02T15:31:26.588198+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:31:26.588198+0000","last_undegraded":"2023-06-02T15:31:26.588198+0000","last_fullsized":"2023-06-02T15:31:26.588198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.801078+0000","last_change":"2023-06-02T15:31:37.801217+0000","last_active":"2023-06-02T15:31:37.801078+0000","last_peered":"2023-06-02T15:31:37.801078+0000","last_clean":"2023-06-02T15:31:37.801078+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:31:37.801078+0000","last_undegraded":"2023-06-02T15:31:37.801078+0000","last_fullsized":"2023-06-02T15:31:37.801078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.801043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.801043+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.801043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:46:43.999450+0000","scrub_duration":0.0034263620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588363+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:31:26.588363+0000","last_peered":"2023-06-02T15:31:26.588363+0000","last_clean":"2023-06-02T15:31:26.588363+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:31:26.588363+0000","last_undegraded":"2023-06-02T15:31:26.588363+0000","last_fullsized":"2023-06-02T15:31:26.588363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.683959+0000","last_change":"2023-06-02T15:30:38.639262+0000","last_active":"2023-06-02T15:31:26.683959+0000","last_peered":"2023-06-02T15:31:26.683959+0000","last_clean":"2023-06-02T15:31:26.683959+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:31:26.683959+0000","last_undegraded":"2023-06-02T15:31:26.683959+0000","last_fullsized":"2023-06-02T15:31:26.683959+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585668+0000","last_change":"2023-06-02T15:30:38.636435+0000","last_active":"2023-06-02T15:31:26.585668+0000","last_peered":"2023-06-02T15:31:26.585668+0000","last_clean":"2023-06-02T15:31:26.585668+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:31:26.585668+0000","last_undegraded":"2023-06-02T15:31:26.585668+0000","last_fullsized":"2023-06-02T15:31:26.585668+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921602+0000","last_change":"2023-06-02T15:30:38.659341+0000","last_active":"2023-06-02T15:31:26.921602+0000","last_peered":"2023-06-02T15:31:26.921602+0000","last_clean":"2023-06-02T15:31:26.921602+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:31:26.921602+0000","last_undegraded":"2023-06-02T15:31:26.921602+0000","last_fullsized":"2023-06-02T15:31:26.921602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.498288+0000","last_change":"2023-06-02T15:31:41.498607+0000","last_active":"2023-06-02T15:31:41.498288+0000","last_peered":"2023-06-02T15:31:41.498288+0000","last_clean":"2023-06-02T15:31:41.498288+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:31:41.498288+0000","last_undegraded":"2023-06-02T15:31:41.498288+0000","last_fullsized":"2023-06-02T15:31:41.498288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.498234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.498234+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.498234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:22.250537+0000","scrub_duration":0.0032772719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.761820+0000","last_change":"2023-06-02T15:31:41.762119+0000","last_active":"2023-06-02T15:31:41.761820+0000","last_peered":"2023-06-02T15:31:41.761820+0000","last_clean":"2023-06-02T15:31:41.761820+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:31:41.761820+0000","last_undegraded":"2023-06-02T15:31:41.761820+0000","last_fullsized":"2023-06-02T15:31:41.761820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.761771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.761771+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.761771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:10.202482+0000","scrub_duration":0.0033186510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.714050+0000","last_change":"2023-06-02T15:31:45.714297+0000","last_active":"2023-06-02T15:31:45.714050+0000","last_peered":"2023-06-02T15:31:45.714050+0000","last_clean":"2023-06-02T15:31:45.714050+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:31:45.714050+0000","last_undegraded":"2023-06-02T15:31:45.714050+0000","last_fullsized":"2023-06-02T15:31:45.714050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.713996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.713996+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.713996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:22.417569+0000","scrub_duration":0.003800037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588585+0000","last_change":"2023-06-02T15:30:38.650928+0000","last_active":"2023-06-02T15:31:26.588585+0000","last_peered":"2023-06-02T15:31:26.588585+0000","last_clean":"2023-06-02T15:31:26.588585+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:31:26.588585+0000","last_undegraded":"2023-06-02T15:31:26.588585+0000","last_fullsized":"2023-06-02T15:31:26.588585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.497864+0000","last_change":"2023-06-02T15:31:37.498112+0000","last_active":"2023-06-02T15:31:37.497864+0000","last_peered":"2023-06-02T15:31:37.497864+0000","last_clean":"2023-06-02T15:31:37.497864+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:31:37.497864+0000","last_undegraded":"2023-06-02T15:31:37.497864+0000","last_fullsized":"2023-06-02T15:31:37.497864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.497813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.497813+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.497813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:06.476968+0000","scrub_duration":0.0034432849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:38.779703+0000","last_change":"2023-06-02T15:31:38.779930+0000","last_active":"2023-06-02T15:31:38.779703+0000","last_peered":"2023-06-02T15:31:38.779703+0000","last_clean":"2023-06-02T15:31:38.779703+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:31:38.779703+0000","last_undegraded":"2023-06-02T15:31:38.779703+0000","last_fullsized":"2023-06-02T15:31:38.779703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:38.779654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:38.779654+0000","last_clean_scrub_stamp":"2023-06-02T15:31:38.779654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:07.220365+0000","scrub_duration":0.0031197170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.590199+0000","last_change":"2023-06-02T15:30:38.647961+0000","last_active":"2023-06-02T15:31:26.590199+0000","last_peered":"2023-06-02T15:31:26.590199+0000","last_clean":"2023-06-02T15:31:26.590199+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:31:26.590199+0000","last_undegraded":"2023-06-02T15:31:26.590199+0000","last_fullsized":"2023-06-02T15:31:26.590199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921334+0000","last_change":"2023-06-02T15:30:38.659299+0000","last_active":"2023-06-02T15:31:26.921334+0000","last_peered":"2023-06-02T15:31:26.921334+0000","last_clean":"2023-06-02T15:31:26.921334+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:31:26.921334+0000","last_undegraded":"2023-06-02T15:31:26.921334+0000","last_fullsized":"2023-06-02T15:31:26.921334+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585297+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:31:26.585297+0000","last_peered":"2023-06-02T15:31:26.585297+0000","last_clean":"2023-06-02T15:31:26.585297+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:31:26.585297+0000","last_undegraded":"2023-06-02T15:31:26.585297+0000","last_fullsized":"2023-06-02T15:31:26.585297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.683585+0000","last_change":"2023-06-02T15:30:38.639043+0000","last_active":"2023-06-02T15:31:26.683585+0000","last_peered":"2023-06-02T15:31:26.683585+0000","last_clean":"2023-06-02T15:31:26.683585+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:31:26.683585+0000","last_undegraded":"2023-06-02T15:31:26.683585+0000","last_fullsized":"2023-06-02T15:31:26.683585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.546272+0000","last_change":"2023-06-02T15:31:48.546529+0000","last_active":"2023-06-02T15:31:48.546272+0000","last_peered":"2023-06-02T15:31:48.546272+0000","last_clean":"2023-06-02T15:31:48.546272+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:31:48.546272+0000","last_undegraded":"2023-06-02T15:31:48.546272+0000","last_fullsized":"2023-06-02T15:31:48.546272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.546224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.546224+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.546224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:29.298528+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588483+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:31:26.588483+0000","last_peered":"2023-06-02T15:31:26.588483+0000","last_clean":"2023-06-02T15:31:26.588483+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:31:26.588483+0000","last_undegraded":"2023-06-02T15:31:26.588483+0000","last_fullsized":"2023-06-02T15:31:26.588483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:38.480377+0000","last_change":"2023-06-02T15:31:38.480659+0000","last_active":"2023-06-02T15:31:38.480377+0000","last_peered":"2023-06-02T15:31:38.480377+0000","last_clean":"2023-06-02T15:31:38.480377+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:31:38.480377+0000","last_undegraded":"2023-06-02T15:31:38.480377+0000","last_fullsized":"2023-06-02T15:31:38.480377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:38.480329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:38.480329+0000","last_clean_scrub_stamp":"2023-06-02T15:31:38.480329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:15.183901+0000","scrub_duration":0.0035440649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.744380+0000","last_change":"2023-06-02T15:31:44.744656+0000","last_active":"2023-06-02T15:31:44.744380+0000","last_peered":"2023-06-02T15:31:44.744380+0000","last_clean":"2023-06-02T15:31:44.744380+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:31:44.744380+0000","last_undegraded":"2023-06-02T15:31:44.744380+0000","last_fullsized":"2023-06-02T15:31:44.744380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:44.744325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:44.744325+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.744325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:13.723480+0000","scrub_duration":0.0037133079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5686,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9220,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362620,"statfs":{"total":96636764160,"available":96627322880,"internally_reserved":0,"allocated":389120,"data_stored":719524,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.0920000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":1.0309999999999999}]},{"osd":2,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.88600000000000001}]},{"osd":4,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.92800000000000005}]},{"osd":5,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.004},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.141}]},{"osd":6,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.119}]}]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":1.046},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.74399999999999999}]},{"osd":2,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.877},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":1.077}]},{"osd":3,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.98699999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.216}]},{"osd":5,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.024},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.1140000000000001}]},{"osd":7,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.1459999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8552,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363288,"statfs":{"total":96636764160,"available":96628006912,"internally_reserved":0,"allocated":294912,"data_stored":123686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.745}]},{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":0.92100000000000004}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.79700000000000004}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.046},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.119}]},{"osd":4,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.83999999999999997}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.1519999999999999}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.96699999999999997},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.1990000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8700,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363140,"statfs":{"total":96636764160,"available":96627855360,"internally_reserved":0,"allocated":315392,"data_stored":128996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.64200000000000002}]},{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.1180000000000001}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":1.04},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.86599999999999999}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.82999999999999996}]},{"osd":5,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.75},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.78500000000000003}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":1.069}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":1.018},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":1.097}]}]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":294912,"data_stored":124126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.59199999999999997}]},{"osd":2,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":1.21},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.76700000000000002}]},{"osd":5,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0609999999999999}]},{"osd":6,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.018},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":1.04}]},{"osd":7,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.145},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.099}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.79700000000000004}]},{"osd":1,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.65000000000000002}]},{"osd":3,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.61299999999999999}]},{"osd":4,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.92800000000000005}]},{"osd":5,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.044},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.022}]},{"osd":6,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.1779999999999999}]},{"osd":7,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.153},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.1140000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9124,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":8768,"kb_avail":94362716,"statfs":{"total":96636764160,"available":96627421184,"internally_reserved":0,"allocated":356352,"data_stored":714404,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":8978432},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.628},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.503},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.77400000000000002}]},{"osd":3,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.79200000000000004}]},{"osd":4,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.871},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.98799999999999999}]},{"osd":5,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.93400000000000005}]},{"osd":6,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":1.01}]},{"osd":7,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.034}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8676,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363164,"statfs":{"total":96636764160,"available":96627879936,"internally_reserved":0,"allocated":290816,"data_stored":123616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.77400000000000002}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.61099999999999999}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.93500000000000005}]},{"osd":5,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.95099999999999996}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.006},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.90500000000000003}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.81200000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:31:59.027 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.028 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.028 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.028 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.029 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.029 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.029 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.029 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.030 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.030 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.030 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.031 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.031 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.031 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.032 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.032 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.032 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.032 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.033 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.033 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.033 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.034 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.034 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.034 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.035 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.035 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.035 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.035 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.036 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2023-06-02T15:30:32.383863+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=32, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.036 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.036 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.037 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.037 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.037 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-06-02T15:30:33.390390+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.038 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.038 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.038 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.038 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.039 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.039 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.039 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.040 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.040 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.040 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.041 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.041 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.041 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.041 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.042 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.042 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.042 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.043 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.043 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.043 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.043 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.044 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.044 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.044 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.045 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.045 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.045 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.045 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.046 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.046 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.046 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.047 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.047 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.047 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.048 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.048 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.048 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.048 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.049 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.049 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.049 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.050 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.050 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.050 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.050 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.051 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.051 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.051 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.052 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.052 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.052 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.052 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.053 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.053 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.053 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.054 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.054 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.054 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.055 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.055 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.055 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:31:59.055 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-02T15:32:14.640 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:32:14.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:32:14.646 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:32:14.648 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:32:19.056 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:32:19.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.174+0000 7f075c08b640 1 Processor -- start 2023-06-02T15:32:19.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.174+0000 7f075c08b640 1 -- start start 2023-06-02T15:32:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075c08b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0754149e00 0x7f07540a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:19.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075c08b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f075414fe20 0x7f07541502a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075c08b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07540bb0e0 con 0x7f07540ba880 2023-06-02T15:32:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075c08b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075414a1d0 con 0x7f075414fe20 2023-06-02T15:32:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075c08b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07540a61d0 con 0x7f0754149e00 2023-06-02T15:32:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f0759626640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f07540ba880 0x7f07540a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44734/0 (socket says 172.21.15.78:44734) 2023-06-02T15:32:19.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075a628640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f075414fe20 0x7f07541502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:19.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f0759626640 1 -- 172.21.15.78:0/3137597060 learned_addr learned my addr 172.21.15.78:0/3137597060 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:32:19.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f0759e27640 1 --2- 172.21.15.78:0/3137597060 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0754149e00 0x7f07540a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:19.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075a628640 1 -- 172.21.15.78:0/3137597060 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0754149e00 msgr2=0x7f07540a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:32:19.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075a628640 1 --2- 172.21.15.78:0/3137597060 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0754149e00 0x7f07540a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:19.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075a628640 1 -- 172.21.15.78:0/3137597060 >> v1:172.21.15.78:6789/0 conn(0x7f07540ba880 legacy=0x7f07540a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:19.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075a628640 1 -- 172.21.15.78:0/3137597060 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540a3810 con 0x7f075414fe20 2023-06-02T15:32:19.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f0758e25640 1 -- 172.21.15.78:0/3137597060 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3741667953 0 0) 0x7f07540bb0e0 con 0x7f07540ba880 2023-06-02T15:32:19.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075a628640 1 --2- 172.21.15.78:0/3137597060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 0x7f07541502a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f074c009d90 tx=0x7f074c01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0b9daf8d0fd56e server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:32:19.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f0758e25640 1 -- 172.21.15.78:0/3137597060 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c0a5810 con 0x7f075414fe20 2023-06-02T15:32:19.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f0758e25640 1 -- 172.21.15.78:0/3137597060 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c0a5970 con 0x7f075414fe20 2023-06-02T15:32:19.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f0758e25640 1 -- 172.21.15.78:0/3137597060 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c0a5d00 con 0x7f075414fe20 2023-06-02T15:32:19.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075c08b640 1 -- 172.21.15.78:0/3137597060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 msgr2=0x7f07541502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:19.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075c08b640 1 --2- 172.21.15.78:0/3137597060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 0x7f07541502a0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f074c009d90 tx=0x7f074c01c950 comp rx=0 tx=0).stop 2023-06-02T15:32:19.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075c08b640 1 -- 172.21.15.78:0/3137597060 shutdown_connections 2023-06-02T15:32:19.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075c08b640 1 --2- 172.21.15.78:0/3137597060 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 0x7f07541502a0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:19.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.178+0000 7f075c08b640 1 --2- 172.21.15.78:0/3137597060 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0754149e00 0x7f07540a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:19.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 -- 172.21.15.78:0/3137597060 >> 172.21.15.78:0/3137597060 conn(0x7f07540bcf50 msgr2=0x7f07540bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:32:19.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 -- 172.21.15.78:0/3137597060 shutdown_connections 2023-06-02T15:32:19.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 -- 172.21.15.78:0/3137597060 wait complete. 2023-06-02T15:32:19.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 Processor -- start 2023-06-02T15:32:19.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 -- start start 2023-06-02T15:32:19.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07540ba880 0x7f075414b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:19.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0754149e00 0x7f07540a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:19.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 0x7f07540b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:19.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07540ba020 con 0x7f075414fe20 2023-06-02T15:32:19.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07540c09b0 con 0x7f07540ba880 2023-06-02T15:32:19.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0754146d10 con 0x7f0754149e00 2023-06-02T15:32:19.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075a628640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 0x7f07540b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:19.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075a628640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 0x7f07540b9ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54014/0 (socket says 172.21.15.78:54014) 2023-06-02T15:32:19.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075a628640 1 -- 172.21.15.78:0/2513506020 learned_addr learned my addr 172.21.15.78:0/2513506020 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:32:19.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f0759626640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0754149e00 0x7f07540a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:19.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075a628640 1 -- 172.21.15.78:0/2513506020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0754149e00 msgr2=0x7f07540a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:19.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f0759e27640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07540ba880 0x7f075414b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:19.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075a628640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0754149e00 0x7f07540a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:19.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075a628640 1 -- 172.21.15.78:0/2513506020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07540ba880 msgr2=0x7f075414b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:19.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075a628640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07540ba880 0x7f075414b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:19.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075a628640 1 -- 172.21.15.78:0/2513506020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074c009a70 con 0x7f075414fe20 2023-06-02T15:32:19.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075a628640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 0x7f07540b9ae0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f074c01a580 tx=0x7f074c0196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:32:19.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f074a7fc640 1 -- 172.21.15.78:0/2513506020 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c0b9650 con 0x7f075414fe20 2023-06-02T15:32:19.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f074a7fc640 1 -- 172.21.15.78:0/2513506020 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c0b97b0 con 0x7f075414fe20 2023-06-02T15:32:19.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 -- 172.21.15.78:0/2513506020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0754159700 con 0x7f075414fe20 2023-06-02T15:32:19.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f074a7fc640 1 -- 172.21.15.78:0/2513506020 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c0b9b20 con 0x7f075414fe20 2023-06-02T15:32:19.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 -- 172.21.15.78:0/2513506020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07540a2b00 con 0x7f075414fe20 2023-06-02T15:32:19.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.182+0000 7f075c08b640 1 -- 172.21.15.78:0/2513506020 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0754159890 con 0x7f075414fe20 2023-06-02T15:32:19.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.186+0000 7f074a7fc640 1 -- 172.21.15.78:0/2513506020 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f074c0b9c80 con 0x7f075414fe20 2023-06-02T15:32:19.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.186+0000 7f074a7fc640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0738065c00 0x7f07380680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:19.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.186+0000 7f074a7fc640 1 -- 172.21.15.78:0/2513506020 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f074c11e940 con 0x7f075414fe20 2023-06-02T15:32:19.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.186+0000 7f0759e27640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0738065c00 0x7f07380680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:19.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.186+0000 7f0759e27640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0738065c00 0x7f07380680b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0750009790 tx=0x7f0750008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:32:19.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.190+0000 7f074a7fc640 1 -- 172.21.15.78:0/2513506020 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f074c0ebde0 con 0x7f075414fe20 2023-06-02T15:32:19.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.338+0000 7f075c08b640 1 -- 172.21.15.78:0/2513506020 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07540a1b30 con 0x7f0738065c00 2023-06-02T15:32:19.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.366+0000 7f074a7fc640 1 -- 172.21.15.78:0/2513506020 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+393245 (secure 0 0 0) 0x7f07540a1b30 con 0x7f0738065c00 2023-06-02T15:32:19.380 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:32:19.382 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:32:19.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 -- 172.21.15.78:0/2513506020 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0738065c00 msgr2=0x7f07380680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:19.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0738065c00 0x7f07380680b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0750009790 tx=0x7f0750008040 comp rx=0 tx=0).stop 2023-06-02T15:32:19.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 -- 172.21.15.78:0/2513506020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 msgr2=0x7f07540b9ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 0x7f07540b9ae0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f074c01a580 tx=0x7f074c0196f0 comp rx=0 tx=0).stop 2023-06-02T15:32:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 -- 172.21.15.78:0/2513506020 shutdown_connections 2023-06-02T15:32:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0738065c00 0x7f07380680b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f075414fe20 0x7f07540b9ae0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:19.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0754149e00 0x7f07540a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:19.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 --2- 172.21.15.78:0/2513506020 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07540ba880 0x7f075414b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:19.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 -- 172.21.15.78:0/2513506020 >> 172.21.15.78:0/2513506020 conn(0x7f07540bcf50 msgr2=0x7f075414f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:32:19.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 -- 172.21.15.78:0/2513506020 shutdown_connections 2023-06-02T15:32:19.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:19.370+0000 7f075c08b640 1 -- 172.21.15.78:0/2513506020 wait complete. 2023-06-02T15:32:19.395 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":74,"stamp":"2023-06-02T15:32:19.259299+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596054,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70240,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":67712,"kb_avail":754904480,"statfs":{"total":773094113280,"available":773022187520,"internally_reserved":0,"allocated":2523136,"data_stored":2182424,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69337088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004630"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.920658+0000","last_change":"2023-06-02T15:30:42.711237+0000","last_active":"2023-06-02T15:31:26.920658+0000","last_peered":"2023-06-02T15:31:26.920658+0000","last_clean":"2023-06-02T15:31:26.920658+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:31:26.920658+0000","last_undegraded":"2023-06-02T15:31:26.920658+0000","last_fullsized":"2023-06-02T15:31:26.920658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.897499+0000","last_change":"2023-06-02T15:31:52.897745+0000","last_active":"2023-06-02T15:31:52.897499+0000","last_peered":"2023-06-02T15:31:52.897499+0000","last_clean":"2023-06-02T15:31:52.897499+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:31:52.897499+0000","last_undegraded":"2023-06-02T15:31:52.897499+0000","last_fullsized":"2023-06-02T15:31:52.897499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-06-02T15:31:52.897446+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-06-02T15:31:52.897446+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.897446+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:32.497455+0000","scrub_duration":0.010025713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.768317+0000","last_change":"2023-06-02T15:31:41.768563+0000","last_active":"2023-06-02T15:31:41.768317+0000","last_peered":"2023-06-02T15:31:41.768317+0000","last_clean":"2023-06-02T15:31:41.768317+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:31:41.768317+0000","last_undegraded":"2023-06-02T15:31:41.768317+0000","last_fullsized":"2023-06-02T15:31:41.768317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.768268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.768268+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.768268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:52.927565+0000","scrub_duration":0.003307744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585288+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:31:26.585288+0000","last_peered":"2023-06-02T15:31:26.585288+0000","last_clean":"2023-06-02T15:31:26.585288+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:31:26.585288+0000","last_undegraded":"2023-06-02T15:31:26.585288+0000","last_fullsized":"2023-06-02T15:31:26.585288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:50.673870+0000","last_change":"2023-06-02T15:31:50.674223+0000","last_active":"2023-06-02T15:31:50.673870+0000","last_peered":"2023-06-02T15:31:50.673870+0000","last_clean":"2023-06-02T15:31:50.673870+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:31:50.673870+0000","last_undegraded":"2023-06-02T15:31:50.673870+0000","last_fullsized":"2023-06-02T15:31:50.673870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:31:50.673816+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:31:50.673816+0000","last_clean_scrub_stamp":"2023-06-02T15:31:50.673816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:45.781711+0000","scrub_duration":0.0040557650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.766596+0000","last_change":"2023-06-02T15:32:08.766821+0000","last_active":"2023-06-02T15:32:08.766596+0000","last_peered":"2023-06-02T15:32:08.766596+0000","last_clean":"2023-06-02T15:32:08.766596+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:32:08.766596+0000","last_undegraded":"2023-06-02T15:32:08.766596+0000","last_fullsized":"2023-06-02T15:32:08.766596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:08.766547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:08.766547+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.766547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:16.433658+0000","scrub_duration":0.0038415820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.351238+0000","last_change":"2023-06-02T15:32:14.351572+0000","last_active":"2023-06-02T15:32:14.351238+0000","last_peered":"2023-06-02T15:32:14.351238+0000","last_clean":"2023-06-02T15:32:14.351238+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:32:14.351238+0000","last_undegraded":"2023-06-02T15:32:14.351238+0000","last_fullsized":"2023-06-02T15:32:14.351238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.351188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.351188+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.351188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:54.109455+0000","scrub_duration":0.0037757120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.644002+0000","last_change":"2023-06-02T15:31:53.644353+0000","last_active":"2023-06-02T15:31:53.644002+0000","last_peered":"2023-06-02T15:31:53.644002+0000","last_clean":"2023-06-02T15:31:53.644002+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:31:53.644002+0000","last_undegraded":"2023-06-02T15:31:53.644002+0000","last_fullsized":"2023-06-02T15:31:53.644002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:53.643891+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:53.643891+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.643891+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:13.647317+0000","scrub_duration":0.0067897779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:42.741168+0000","last_change":"2023-06-02T15:31:42.741474+0000","last_active":"2023-06-02T15:31:42.741168+0000","last_peered":"2023-06-02T15:31:42.741168+0000","last_clean":"2023-06-02T15:31:42.741168+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:31:42.741168+0000","last_undegraded":"2023-06-02T15:31:42.741168+0000","last_fullsized":"2023-06-02T15:31:42.741168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:42.741115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:42.741115+0000","last_clean_scrub_stamp":"2023-06-02T15:31:42.741115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:22.341123+0000","scrub_duration":0.0040099519999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921431+0000","last_change":"2023-06-02T15:30:42.707090+0000","last_active":"2023-06-02T15:31:26.921431+0000","last_peered":"2023-06-02T15:31:26.921431+0000","last_clean":"2023-06-02T15:31:26.921431+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:31:26.921431+0000","last_undegraded":"2023-06-02T15:31:26.921431+0000","last_fullsized":"2023-06-02T15:31:26.921431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.593085+0000","last_change":"2023-06-02T15:31:56.593314+0000","last_active":"2023-06-02T15:31:56.593085+0000","last_peered":"2023-06-02T15:31:56.593085+0000","last_clean":"2023-06-02T15:31:56.593085+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:31:56.593085+0000","last_undegraded":"2023-06-02T15:31:56.593085+0000","last_fullsized":"2023-06-02T15:31:56.593085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:56.593030+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:56.593030+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.593030+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:08.242720+0000","scrub_duration":0.0068701040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:40.768267+0000","last_change":"2023-06-02T15:31:40.768497+0000","last_active":"2023-06-02T15:31:40.768267+0000","last_peered":"2023-06-02T15:31:40.768267+0000","last_clean":"2023-06-02T15:31:40.768267+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:31:40.768267+0000","last_undegraded":"2023-06-02T15:31:40.768267+0000","last_fullsized":"2023-06-02T15:31:40.768267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:40.768219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:40.768219+0000","last_clean_scrub_stamp":"2023-06-02T15:31:40.768219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:29:50.472958+0000","scrub_duration":0.0035921740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.349663+0000","last_change":"2023-06-02T15:32:13.349940+0000","last_active":"2023-06-02T15:32:13.349663+0000","last_peered":"2023-06-02T15:32:13.349663+0000","last_clean":"2023-06-02T15:32:13.349663+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:32:13.349663+0000","last_undegraded":"2023-06-02T15:32:13.349663+0000","last_fullsized":"2023-06-02T15:32:13.349663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.349610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.349610+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.349610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:27:11.184062+0000","scrub_duration":0.0039129899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.968715+0000","last_change":"2023-06-02T15:31:57.968954+0000","last_active":"2023-06-02T15:31:57.968715+0000","last_peered":"2023-06-02T15:31:57.968715+0000","last_clean":"2023-06-02T15:31:57.968715+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:31:57.968715+0000","last_undegraded":"2023-06-02T15:31:57.968715+0000","last_fullsized":"2023-06-02T15:31:57.968715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:31:57.968663+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:31:57.968663+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.968663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:43.801926+0000","scrub_duration":0.003851307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.770706+0000","last_change":"2023-06-02T15:31:36.770926+0000","last_active":"2023-06-02T15:31:36.770706+0000","last_peered":"2023-06-02T15:31:36.770706+0000","last_clean":"2023-06-02T15:31:36.770706+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:31:36.770706+0000","last_undegraded":"2023-06-02T15:31:36.770706+0000","last_fullsized":"2023-06-02T15:31:36.770706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:36.770650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:36.770650+0000","last_clean_scrub_stamp":"2023-06-02T15:31:36.770650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:01:52.784223+0000","scrub_duration":0.0030208169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.587870+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:31:26.587870+0000","last_peered":"2023-06-02T15:31:26.587870+0000","last_clean":"2023-06-02T15:31:26.587870+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:31:26.587870+0000","last_undegraded":"2023-06-02T15:31:26.587870+0000","last_fullsized":"2023-06-02T15:31:26.587870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.718833+0000","last_change":"2023-06-02T15:32:13.719090+0000","last_active":"2023-06-02T15:32:13.718833+0000","last_peered":"2023-06-02T15:32:13.718833+0000","last_clean":"2023-06-02T15:32:13.718833+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:32:13.718833+0000","last_undegraded":"2023-06-02T15:32:13.718833+0000","last_fullsized":"2023-06-02T15:32:13.718833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:32:13.718779+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:32:13.718779+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.718779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:17.067801+0000","scrub_duration":0.0036400669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.724754+0000","last_change":"2023-06-02T15:31:43.724985+0000","last_active":"2023-06-02T15:31:43.724754+0000","last_peered":"2023-06-02T15:31:43.724754+0000","last_clean":"2023-06-02T15:31:43.724754+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:31:43.724754+0000","last_undegraded":"2023-06-02T15:31:43.724754+0000","last_fullsized":"2023-06-02T15:31:43.724754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.724701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.724701+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.724701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:24.477005+0000","scrub_duration":0.0034074370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.609164+0000","last_change":"2023-06-02T15:32:03.609423+0000","last_active":"2023-06-02T15:32:03.609164+0000","last_peered":"2023-06-02T15:32:03.609164+0000","last_clean":"2023-06-02T15:32:03.609164+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:32:03.609164+0000","last_undegraded":"2023-06-02T15:32:03.609164+0000","last_fullsized":"2023-06-02T15:32:03.609164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.609111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.609111+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.609111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:15.258800+0000","scrub_duration":0.0036874350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.171811+0000","last_change":"2023-06-02T15:31:37.171911+0000","last_active":"2023-06-02T15:31:37.171811+0000","last_peered":"2023-06-02T15:31:37.171811+0000","last_clean":"2023-06-02T15:31:37.171811+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:31:37.171811+0000","last_undegraded":"2023-06-02T15:31:37.171811+0000","last_fullsized":"2023-06-02T15:31:37.171811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.171792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.171792+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.171792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:05.612504+0000","scrub_duration":0.00141092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.879500+0000","last_change":"2023-06-02T15:32:13.879735+0000","last_active":"2023-06-02T15:32:13.879500+0000","last_peered":"2023-06-02T15:32:13.879500+0000","last_clean":"2023-06-02T15:32:13.879500+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:32:13.879500+0000","last_undegraded":"2023-06-02T15:32:13.879500+0000","last_fullsized":"2023-06-02T15:32:13.879500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.879426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.879426+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.879426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:21.546537+0000","scrub_duration":0.003456967,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.952958+0000","last_change":"2023-06-02T15:32:16.953226+0000","last_active":"2023-06-02T15:32:16.952958+0000","last_peered":"2023-06-02T15:32:16.952958+0000","last_clean":"2023-06-02T15:32:16.952958+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:32:16.952958+0000","last_undegraded":"2023-06-02T15:32:16.952958+0000","last_fullsized":"2023-06-02T15:32:16.952958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.952905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.952905+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.952905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:56.711172+0000","scrub_duration":0.0040503359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:04.775444+0000","last_change":"2023-06-02T15:32:04.775742+0000","last_active":"2023-06-02T15:32:04.775444+0000","last_peered":"2023-06-02T15:32:04.775444+0000","last_clean":"2023-06-02T15:32:04.775444+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:32:04.775444+0000","last_undegraded":"2023-06-02T15:32:04.775444+0000","last_fullsized":"2023-06-02T15:32:04.775444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:04.775390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:04.775390+0000","last_clean_scrub_stamp":"2023-06-02T15:32:04.775390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:09.162959+0000","scrub_duration":0.0032928110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.517902+0000","last_change":"2023-06-02T15:31:53.518146+0000","last_active":"2023-06-02T15:31:53.517902+0000","last_peered":"2023-06-02T15:31:53.517902+0000","last_clean":"2023-06-02T15:31:53.517902+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:31:53.517902+0000","last_undegraded":"2023-06-02T15:31:53.517902+0000","last_fullsized":"2023-06-02T15:31:53.517902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:53.517854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:53.517854+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.517854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.677151+0000","scrub_duration":0.0031286759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:39.691357+0000","last_change":"2023-06-02T15:31:39.691651+0000","last_active":"2023-06-02T15:31:39.691357+0000","last_peered":"2023-06-02T15:31:39.691357+0000","last_clean":"2023-06-02T15:31:39.691357+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:31:39.691357+0000","last_undegraded":"2023-06-02T15:31:39.691357+0000","last_fullsized":"2023-06-02T15:31:39.691357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:39.691303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:39.691303+0000","last_clean_scrub_stamp":"2023-06-02T15:31:39.691303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:08.670458+0000","scrub_duration":0.0032675849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:46.866855+0000","last_change":"2023-06-02T15:31:46.867109+0000","last_active":"2023-06-02T15:31:46.866855+0000","last_peered":"2023-06-02T15:31:46.866855+0000","last_clean":"2023-06-02T15:31:46.866855+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:31:46.866855+0000","last_undegraded":"2023-06-02T15:31:46.866855+0000","last_fullsized":"2023-06-02T15:31:46.866855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:46.866803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:46.866803+0000","last_clean_scrub_stamp":"2023-06-02T15:31:46.866803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:27.619106+0000","scrub_duration":0.0038372440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:12.762729+0000","last_change":"2023-06-02T15:32:12.762960+0000","last_active":"2023-06-02T15:32:12.762729+0000","last_peered":"2023-06-02T15:32:12.762729+0000","last_clean":"2023-06-02T15:32:12.762729+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:32:12.762729+0000","last_undegraded":"2023-06-02T15:32:12.762729+0000","last_fullsized":"2023-06-02T15:32:12.762729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:12.762690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:12.762690+0000","last_clean_scrub_stamp":"2023-06-02T15:32:12.762690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:37.440741+0000","scrub_duration":0.0035931549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:06.764347+0000","last_change":"2023-06-02T15:32:06.764696+0000","last_active":"2023-06-02T15:32:06.764347+0000","last_peered":"2023-06-02T15:32:06.764347+0000","last_clean":"2023-06-02T15:32:06.764347+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:32:06.764347+0000","last_undegraded":"2023-06-02T15:32:06.764347+0000","last_fullsized":"2023-06-02T15:32:06.764347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:06.764295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:06.764295+0000","last_clean_scrub_stamp":"2023-06-02T15:32:06.764295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:01.519486+0000","scrub_duration":0.0036305719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:46.537638+0000","last_change":"2023-06-02T15:31:46.537878+0000","last_active":"2023-06-02T15:31:46.537638+0000","last_peered":"2023-06-02T15:31:46.537638+0000","last_clean":"2023-06-02T15:31:46.537638+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:31:46.537638+0000","last_undegraded":"2023-06-02T15:31:46.537638+0000","last_fullsized":"2023-06-02T15:31:46.537638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:46.537583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:46.537583+0000","last_clean_scrub_stamp":"2023-06-02T15:31:46.537583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:57.696880+0000","scrub_duration":0.0033143180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.135482+0000","last_change":"2023-06-02T15:32:13.135793+0000","last_active":"2023-06-02T15:32:13.135482+0000","last_peered":"2023-06-02T15:32:13.135482+0000","last_clean":"2023-06-02T15:32:13.135482+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:32:13.135482+0000","last_undegraded":"2023-06-02T15:32:13.135482+0000","last_fullsized":"2023-06-02T15:32:13.135482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.135430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.135430+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.135430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:20.802541+0000","scrub_duration":0.0040929599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.000626+0000","last_change":"2023-06-02T15:31:44.000867+0000","last_active":"2023-06-02T15:31:44.000626+0000","last_peered":"2023-06-02T15:31:44.000626+0000","last_clean":"2023-06-02T15:31:44.000626+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:31:44.000626+0000","last_undegraded":"2023-06-02T15:31:44.000626+0000","last_fullsized":"2023-06-02T15:31:44.000626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-06-02T15:31:44.000570+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-06-02T15:31:44.000570+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.000570+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:12.979725+0000","scrub_duration":0.0085722809999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:07.319600+0000","last_change":"2023-06-02T15:32:07.319836+0000","last_active":"2023-06-02T15:32:07.319600+0000","last_peered":"2023-06-02T15:32:07.319600+0000","last_clean":"2023-06-02T15:32:07.319600+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:32:07.319600+0000","last_undegraded":"2023-06-02T15:32:07.319600+0000","last_fullsized":"2023-06-02T15:32:07.319600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:07.319552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:07.319552+0000","last_clean_scrub_stamp":"2023-06-02T15:32:07.319552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:37.767754+0000","scrub_duration":0.0036772110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.755954+0000","last_change":"2023-06-02T15:30:42.720577+0000","last_active":"2023-06-02T15:31:26.755954+0000","last_peered":"2023-06-02T15:31:26.755954+0000","last_clean":"2023-06-02T15:31:26.755954+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:31:26.755954+0000","last_undegraded":"2023-06-02T15:31:26.755954+0000","last_fullsized":"2023-06-02T15:31:26.755954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'19","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.805093+0000","last_change":"2023-06-02T15:32:08.805341+0000","last_active":"2023-06-02T15:32:08.805093+0000","last_peered":"2023-06-02T15:32:08.805093+0000","last_clean":"2023-06-02T15:32:08.805093+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:32:08.805093+0000","last_undegraded":"2023-06-02T15:32:08.805093+0000","last_fullsized":"2023-06-02T15:32:08.805093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2023-06-02T15:32:08.805041+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2023-06-02T15:32:08.805041+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.805041+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:48.563308+0000","scrub_duration":0.01113798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4904,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.873703+0000","last_change":"2023-06-02T15:32:03.873928+0000","last_active":"2023-06-02T15:32:03.873703+0000","last_peered":"2023-06-02T15:32:03.873703+0000","last_clean":"2023-06-02T15:32:03.873703+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:32:03.873703+0000","last_undegraded":"2023-06-02T15:32:03.873703+0000","last_fullsized":"2023-06-02T15:32:03.873703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.873651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.873651+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.873651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:07:58.628843+0000","scrub_duration":0.0075517730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:15.379094+0000","last_change":"2023-06-02T15:32:15.379438+0000","last_active":"2023-06-02T15:32:15.379094+0000","last_peered":"2023-06-02T15:32:15.379094+0000","last_clean":"2023-06-02T15:32:15.379094+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:32:15.379094+0000","last_undegraded":"2023-06-02T15:32:15.379094+0000","last_fullsized":"2023-06-02T15:32:15.379094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:15.379039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:15.379039+0000","last_clean_scrub_stamp":"2023-06-02T15:32:15.379039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:10.134230+0000","scrub_duration":0.0041123649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.270176+0000","last_change":"2023-06-02T15:31:51.270419+0000","last_active":"2023-06-02T15:31:51.270176+0000","last_peered":"2023-06-02T15:31:51.270176+0000","last_clean":"2023-06-02T15:31:51.270176+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:31:51.270176+0000","last_undegraded":"2023-06-02T15:31:51.270176+0000","last_fullsized":"2023-06-02T15:31:51.270176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.270125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.270125+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.270125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:30:00.974864+0000","scrub_duration":0.0038244239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.494370+0000","last_change":"2023-06-02T15:31:41.494671+0000","last_active":"2023-06-02T15:31:41.494370+0000","last_peered":"2023-06-02T15:31:41.494370+0000","last_clean":"2023-06-02T15:31:41.494370+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:31:41.494370+0000","last_undegraded":"2023-06-02T15:31:41.494370+0000","last_fullsized":"2023-06-02T15:31:41.494370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.494318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.494318+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.494318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:09.935029+0000","scrub_duration":0.0040292009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:49.596891+0000","last_change":"2023-06-02T15:31:49.597169+0000","last_active":"2023-06-02T15:31:49.596891+0000","last_peered":"2023-06-02T15:31:49.596891+0000","last_clean":"2023-06-02T15:31:49.596891+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:31:49.596891+0000","last_undegraded":"2023-06-02T15:31:49.596891+0000","last_fullsized":"2023-06-02T15:31:49.596891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:49.596840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:49.596840+0000","last_clean_scrub_stamp":"2023-06-02T15:31:49.596840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:44.704735+0000","scrub_duration":0.0034677010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.886292+0000","last_change":"2023-06-02T15:32:14.886646+0000","last_active":"2023-06-02T15:32:14.886292+0000","last_peered":"2023-06-02T15:32:14.886292+0000","last_clean":"2023-06-02T15:32:14.886292+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:32:14.886292+0000","last_undegraded":"2023-06-02T15:32:14.886292+0000","last_fullsized":"2023-06-02T15:32:14.886292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.886241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.886241+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.886241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:34.203061+0000","scrub_duration":0.0039836819999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.998849+0000","last_change":"2023-06-02T15:32:05.999085+0000","last_active":"2023-06-02T15:32:05.998849+0000","last_peered":"2023-06-02T15:32:05.998849+0000","last_clean":"2023-06-02T15:32:05.998849+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:32:05.998849+0000","last_undegraded":"2023-06-02T15:32:05.998849+0000","last_fullsized":"2023-06-02T15:32:05.998849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.998798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.998798+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.998798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:36.447000+0000","scrub_duration":0.0035371059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:39.527675+0000","last_change":"2023-06-02T15:31:39.527934+0000","last_active":"2023-06-02T15:31:39.527675+0000","last_peered":"2023-06-02T15:31:39.527675+0000","last_clean":"2023-06-02T15:31:39.527675+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:31:39.527675+0000","last_undegraded":"2023-06-02T15:31:39.527675+0000","last_fullsized":"2023-06-02T15:31:39.527675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:39.527621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:39.527621+0000","last_clean_scrub_stamp":"2023-06-02T15:31:39.527621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:31:08.870956+0000","scrub_duration":0.0040577269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.313909+0000","last_change":"2023-06-02T15:31:48.314179+0000","last_active":"2023-06-02T15:31:48.313909+0000","last_peered":"2023-06-02T15:31:48.313909+0000","last_clean":"2023-06-02T15:31:48.313909+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:31:48.313909+0000","last_undegraded":"2023-06-02T15:31:48.313909+0000","last_fullsized":"2023-06-02T15:31:48.313909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.313862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.313862+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.313862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:19:57.371808+0000","scrub_duration":0.003324671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.724480+0000","last_change":"2023-06-02T15:32:08.724804+0000","last_active":"2023-06-02T15:32:08.724480+0000","last_peered":"2023-06-02T15:32:08.724480+0000","last_clean":"2023-06-02T15:32:08.724480+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:32:08.724480+0000","last_undegraded":"2023-06-02T15:32:08.724480+0000","last_fullsized":"2023-06-02T15:32:08.724480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:08.724428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:08.724428+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.724428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:39.172630+0000","scrub_duration":0.0040007369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:40.702232+0000","last_change":"2023-06-02T15:31:40.702502+0000","last_active":"2023-06-02T15:31:40.702232+0000","last_peered":"2023-06-02T15:31:40.702232+0000","last_clean":"2023-06-02T15:31:40.702232+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:31:40.702232+0000","last_undegraded":"2023-06-02T15:31:40.702232+0000","last_fullsized":"2023-06-02T15:31:40.702232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:40.702183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:40.702183+0000","last_clean_scrub_stamp":"2023-06-02T15:31:40.702183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:17.405756+0000","scrub_duration":0.0083223120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.826192+0000","last_change":"2023-06-02T15:32:05.826457+0000","last_active":"2023-06-02T15:32:05.826192+0000","last_peered":"2023-06-02T15:32:05.826192+0000","last_clean":"2023-06-02T15:32:05.826192+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:32:05.826192+0000","last_undegraded":"2023-06-02T15:32:05.826192+0000","last_fullsized":"2023-06-02T15:32:05.826192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.826140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.826140+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.826140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:13.493251+0000","scrub_duration":0.0034698720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.692402+0000","last_change":"2023-06-02T15:32:00.692667+0000","last_active":"2023-06-02T15:32:00.692402+0000","last_peered":"2023-06-02T15:32:00.692402+0000","last_clean":"2023-06-02T15:32:00.692402+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:32:00.692402+0000","last_undegraded":"2023-06-02T15:32:00.692402+0000","last_fullsized":"2023-06-02T15:32:00.692402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:32:00.692346+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:32:00.692346+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.692346+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:31.140548+0000","scrub_duration":0.0085621840000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585197+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:31:26.585197+0000","last_peered":"2023-06-02T15:31:26.585197+0000","last_clean":"2023-06-02T15:31:26.585197+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:31:26.585197+0000","last_undegraded":"2023-06-02T15:31:26.585197+0000","last_fullsized":"2023-06-02T15:31:26.585197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.850649+0000","last_change":"2023-06-02T15:32:00.850871+0000","last_active":"2023-06-02T15:32:00.850649+0000","last_peered":"2023-06-02T15:32:00.850649+0000","last_clean":"2023-06-02T15:32:00.850649+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:32:00.850649+0000","last_undegraded":"2023-06-02T15:32:00.850649+0000","last_fullsized":"2023-06-02T15:32:00.850649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:00.850599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:00.850599+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.850599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:25.528650+0000","scrub_duration":0.0036098129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:49.711619+0000","last_change":"2023-06-02T15:31:49.712018+0000","last_active":"2023-06-02T15:31:49.711619+0000","last_peered":"2023-06-02T15:31:49.711619+0000","last_clean":"2023-06-02T15:31:49.711619+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:31:49.711619+0000","last_undegraded":"2023-06-02T15:31:49.711619+0000","last_fullsized":"2023-06-02T15:31:49.711619+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:49.711487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:49.711487+0000","last_clean_scrub_stamp":"2023-06-02T15:31:49.711487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:29.311495+0000","scrub_duration":0.0044216419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:42.817603+0000","last_change":"2023-06-02T15:31:42.817844+0000","last_active":"2023-06-02T15:31:42.817603+0000","last_peered":"2023-06-02T15:31:42.817603+0000","last_clean":"2023-06-02T15:31:42.817603+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:31:42.817603+0000","last_undegraded":"2023-06-02T15:31:42.817603+0000","last_fullsized":"2023-06-02T15:31:42.817603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:31:42.817550+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:31:42.817550+0000","last_clean_scrub_stamp":"2023-06-02T15:31:42.817550+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:11.796705+0000","scrub_duration":0.0085183749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.741731+0000","last_change":"2023-06-02T15:32:16.742059+0000","last_active":"2023-06-02T15:32:16.741731+0000","last_peered":"2023-06-02T15:32:16.741731+0000","last_clean":"2023-06-02T15:32:16.741731+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:32:16.741731+0000","last_undegraded":"2023-06-02T15:32:16.741731+0000","last_fullsized":"2023-06-02T15:32:16.741731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.741672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.741672+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.741672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:20.090695+0000","scrub_duration":0.004709123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:35.675238+0000","last_change":"2023-06-02T15:31:35.675333+0000","last_active":"2023-06-02T15:31:35.675238+0000","last_peered":"2023-06-02T15:31:35.675238+0000","last_clean":"2023-06-02T15:31:35.675238+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:31:35.675238+0000","last_undegraded":"2023-06-02T15:31:35.675238+0000","last_fullsized":"2023-06-02T15:31:35.675238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:35.675220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:35.675220+0000","last_clean_scrub_stamp":"2023-06-02T15:31:35.675220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:46:41.873628+0000","scrub_duration":0.001699594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.893366+0000","last_change":"2023-06-02T15:31:51.893605+0000","last_active":"2023-06-02T15:31:51.893366+0000","last_peered":"2023-06-02T15:31:51.893366+0000","last_clean":"2023-06-02T15:31:51.893366+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:31:51.893366+0000","last_undegraded":"2023-06-02T15:31:51.893366+0000","last_fullsized":"2023-06-02T15:31:51.893366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.893317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.893317+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.893317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:03.052614+0000","scrub_duration":0.0037955900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'119","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.046042+0000","last_change":"2023-06-02T15:31:53.046295+0000","last_active":"2023-06-02T15:31:53.046042+0000","last_peered":"2023-06-02T15:31:53.046042+0000","last_clean":"2023-06-02T15:31:53.046042+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:31:53.046042+0000","last_undegraded":"2023-06-02T15:31:53.046042+0000","last_fullsized":"2023-06-02T15:31:53.046042+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-06-02T15:31:53.045988+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-06-02T15:31:53.045988+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.045988+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.205286+0000","scrub_duration":0.014250489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.176598+0000","last_change":"2023-06-02T15:31:36.176680+0000","last_active":"2023-06-02T15:31:36.176598+0000","last_peered":"2023-06-02T15:31:36.176598+0000","last_clean":"2023-06-02T15:31:36.176598+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:31:36.176598+0000","last_undegraded":"2023-06-02T15:31:36.176598+0000","last_fullsized":"2023-06-02T15:31:36.176598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:36.176579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:36.176579+0000","last_clean_scrub_stamp":"2023-06-02T15:31:36.176579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:31:05.519914+0000","scrub_duration":0.0032385439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.591577+0000","last_change":"2023-06-02T15:30:42.712421+0000","last_active":"2023-06-02T15:31:26.591577+0000","last_peered":"2023-06-02T15:31:26.591577+0000","last_clean":"2023-06-02T15:31:26.591577+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:31:26.591577+0000","last_undegraded":"2023-06-02T15:31:26.591577+0000","last_fullsized":"2023-06-02T15:31:26.591577+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.306197+0000","last_change":"2023-06-02T15:31:55.306444+0000","last_active":"2023-06-02T15:31:55.306197+0000","last_peered":"2023-06-02T15:31:55.306197+0000","last_clean":"2023-06-02T15:31:55.306197+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:31:55.306197+0000","last_undegraded":"2023-06-02T15:31:55.306197+0000","last_fullsized":"2023-06-02T15:31:55.306197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:55.306148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:55.306148+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.306148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.414043+0000","scrub_duration":0.0036463979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.316285+0000","last_change":"2023-06-02T15:31:43.316509+0000","last_active":"2023-06-02T15:31:43.316285+0000","last_peered":"2023-06-02T15:31:43.316285+0000","last_clean":"2023-06-02T15:31:43.316285+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:31:43.316285+0000","last_undegraded":"2023-06-02T15:31:43.316285+0000","last_fullsized":"2023-06-02T15:31:43.316285+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.316233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.316233+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.316233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:55:51.972560+0000","scrub_duration":0.0081781270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.031012+0000","last_change":"2023-06-02T15:31:45.031260+0000","last_active":"2023-06-02T15:31:45.031012+0000","last_peered":"2023-06-02T15:31:45.031012+0000","last_clean":"2023-06-02T15:31:45.031012+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:31:45.031012+0000","last_undegraded":"2023-06-02T15:31:45.031012+0000","last_fullsized":"2023-06-02T15:31:45.031012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.030964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.030964+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.030964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:21.734537+0000","scrub_duration":0.0035987649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.736558+0000","last_change":"2023-06-02T15:31:55.736848+0000","last_active":"2023-06-02T15:31:55.736558+0000","last_peered":"2023-06-02T15:31:55.736558+0000","last_clean":"2023-06-02T15:31:55.736558+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:31:55.736558+0000","last_undegraded":"2023-06-02T15:31:55.736558+0000","last_fullsized":"2023-06-02T15:31:55.736558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:55.736507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:55.736507+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.736507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.844402+0000","scrub_duration":0.004192884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.289588+0000","last_change":"2023-06-02T15:31:52.289872+0000","last_active":"2023-06-02T15:31:52.289588+0000","last_peered":"2023-06-02T15:31:52.289588+0000","last_clean":"2023-06-02T15:31:52.289588+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:31:52.289588+0000","last_undegraded":"2023-06-02T15:31:52.289588+0000","last_fullsized":"2023-06-02T15:31:52.289588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.289531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.289531+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.289531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:03.448828+0000","scrub_duration":0.0032206029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588198+0000","last_change":"2023-06-02T15:30:38.257531+0000","last_active":"2023-06-02T15:31:26.588198+0000","last_peered":"2023-06-02T15:31:26.588198+0000","last_clean":"2023-06-02T15:31:26.588198+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:31:26.588198+0000","last_undegraded":"2023-06-02T15:31:26.588198+0000","last_fullsized":"2023-06-02T15:31:26.588198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:37.226788+0000","last_clean_scrub_stamp":"2023-06-02T15:30:37.226788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.531125+0000","last_change":"2023-06-02T15:31:45.531411+0000","last_active":"2023-06-02T15:31:45.531125+0000","last_peered":"2023-06-02T15:31:45.531125+0000","last_clean":"2023-06-02T15:31:45.531125+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:31:45.531125+0000","last_undegraded":"2023-06-02T15:31:45.531125+0000","last_fullsized":"2023-06-02T15:31:45.531125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.531079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.531079+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.531079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:29:55.235818+0000","scrub_duration":0.0038552180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.683397+0000","last_change":"2023-06-02T15:30:42.693557+0000","last_active":"2023-06-02T15:31:26.683397+0000","last_peered":"2023-06-02T15:31:26.683397+0000","last_clean":"2023-06-02T15:31:26.683397+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:31:26.683397+0000","last_undegraded":"2023-06-02T15:31:26.683397+0000","last_fullsized":"2023-06-02T15:31:26.683397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.555538+0000","last_change":"2023-06-02T15:31:52.555827+0000","last_active":"2023-06-02T15:31:52.555538+0000","last_peered":"2023-06-02T15:31:52.555538+0000","last_clean":"2023-06-02T15:31:52.555538+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:31:52.555538+0000","last_undegraded":"2023-06-02T15:31:52.555538+0000","last_fullsized":"2023-06-02T15:31:52.555538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.555485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.555485+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.555485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:30:02.260224+0000","scrub_duration":0.0031645419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:58.638273+0000","last_change":"2023-06-02T15:31:58.638743+0000","last_active":"2023-06-02T15:31:58.638273+0000","last_peered":"2023-06-02T15:31:58.638273+0000","last_clean":"2023-06-02T15:31:58.638273+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:31:58.638273+0000","last_undegraded":"2023-06-02T15:31:58.638273+0000","last_fullsized":"2023-06-02T15:31:58.638273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:58.638110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:58.638110+0000","last_clean_scrub_stamp":"2023-06-02T15:31:58.638110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:51.247160+0000","scrub_duration":0.0035255070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.101882+0000","last_change":"2023-06-02T15:31:48.102141+0000","last_active":"2023-06-02T15:31:48.101882+0000","last_peered":"2023-06-02T15:31:48.101882+0000","last_clean":"2023-06-02T15:31:48.101882+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:31:48.101882+0000","last_undegraded":"2023-06-02T15:31:48.101882+0000","last_fullsized":"2023-06-02T15:31:48.101882+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.101830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.101830+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.101830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:28.854133+0000","scrub_duration":0.0082640209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.094980+0000","last_change":"2023-06-02T15:32:14.095296+0000","last_active":"2023-06-02T15:32:14.094980+0000","last_peered":"2023-06-02T15:32:14.094980+0000","last_clean":"2023-06-02T15:32:14.094980+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:32:14.094980+0000","last_undegraded":"2023-06-02T15:32:14.094980+0000","last_fullsized":"2023-06-02T15:32:14.094980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.094929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.094929+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.094929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:33.411749+0000","scrub_duration":0.0041825120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.841653+0000","last_change":"2023-06-02T15:32:02.841867+0000","last_active":"2023-06-02T15:32:02.841653+0000","last_peered":"2023-06-02T15:32:02.841653+0000","last_clean":"2023-06-02T15:32:02.841653+0000","last_became_active":"2023-06-02T15:31:26.758308+0000","last_became_peered":"2023-06-02T15:31:26.758308+0000","last_unstale":"2023-06-02T15:32:02.841653+0000","last_undegraded":"2023-06-02T15:32:02.841653+0000","last_fullsized":"2023-06-02T15:32:02.841653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.841598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.841598+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.841598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.491288+0000","scrub_duration":0.0031874889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.727125+0000","last_change":"2023-06-02T15:31:52.727371+0000","last_active":"2023-06-02T15:31:52.727125+0000","last_peered":"2023-06-02T15:31:52.727125+0000","last_clean":"2023-06-02T15:31:52.727125+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:31:52.727125+0000","last_undegraded":"2023-06-02T15:31:52.727125+0000","last_fullsized":"2023-06-02T15:31:52.727125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.727078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.727078+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.727078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:38.560342+0000","scrub_duration":0.003683974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.589177+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:31:26.589177+0000","last_peered":"2023-06-02T15:31:26.589177+0000","last_clean":"2023-06-02T15:31:26.589177+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:31:26.589177+0000","last_undegraded":"2023-06-02T15:31:26.589177+0000","last_fullsized":"2023-06-02T15:31:26.589177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.589162+0000","last_change":"2023-06-02T15:30:38.638725+0000","last_active":"2023-06-02T15:31:26.589162+0000","last_peered":"2023-06-02T15:31:26.589162+0000","last_clean":"2023-06-02T15:31:26.589162+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:31:26.589162+0000","last_undegraded":"2023-06-02T15:31:26.589162+0000","last_fullsized":"2023-06-02T15:31:26.589162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:06.778227+0000","last_change":"2023-06-02T15:32:06.778522+0000","last_active":"2023-06-02T15:32:06.778227+0000","last_peered":"2023-06-02T15:32:06.778227+0000","last_clean":"2023-06-02T15:32:06.778227+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:32:06.778227+0000","last_undegraded":"2023-06-02T15:32:06.778227+0000","last_fullsized":"2023-06-02T15:32:06.778227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:06.778176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:06.778176+0000","last_clean_scrub_stamp":"2023-06-02T15:32:06.778176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:26.094996+0000","scrub_duration":0.0036399050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.591575+0000","last_change":"2023-06-02T15:30:42.713071+0000","last_active":"2023-06-02T15:31:26.591575+0000","last_peered":"2023-06-02T15:31:26.591575+0000","last_clean":"2023-06-02T15:31:26.591575+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:31:26.591575+0000","last_undegraded":"2023-06-02T15:31:26.591575+0000","last_fullsized":"2023-06-02T15:31:26.591575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588683+0000","last_change":"2023-06-02T15:30:38.636565+0000","last_active":"2023-06-02T15:31:26.588683+0000","last_peered":"2023-06-02T15:31:26.588683+0000","last_clean":"2023-06-02T15:31:26.588683+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:31:26.588683+0000","last_undegraded":"2023-06-02T15:31:26.588683+0000","last_fullsized":"2023-06-02T15:31:26.588683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.525360+0000","last_change":"2023-06-02T15:31:45.525640+0000","last_active":"2023-06-02T15:31:45.525360+0000","last_peered":"2023-06-02T15:31:45.525360+0000","last_clean":"2023-06-02T15:31:45.525360+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:31:45.525360+0000","last_undegraded":"2023-06-02T15:31:45.525360+0000","last_fullsized":"2023-06-02T15:31:45.525360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.525308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.525308+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.525308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:22.228881+0000","scrub_duration":0.0032755190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.921436+0000","last_change":"2023-06-02T15:30:42.697724+0000","last_active":"2023-06-02T15:31:26.921436+0000","last_peered":"2023-06-02T15:31:26.921436+0000","last_clean":"2023-06-02T15:31:26.921436+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:31:26.921436+0000","last_undegraded":"2023-06-02T15:31:26.921436+0000","last_fullsized":"2023-06-02T15:31:26.921436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588262+0000","last_change":"2023-06-02T15:30:38.640532+0000","last_active":"2023-06-02T15:31:26.588262+0000","last_peered":"2023-06-02T15:31:26.588262+0000","last_clean":"2023-06-02T15:31:26.588262+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:31:26.588262+0000","last_undegraded":"2023-06-02T15:31:26.588262+0000","last_fullsized":"2023-06-02T15:31:26.588262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.681927+0000","last_change":"2023-06-02T15:31:57.682215+0000","last_active":"2023-06-02T15:31:57.681927+0000","last_peered":"2023-06-02T15:31:57.681927+0000","last_clean":"2023-06-02T15:31:57.681927+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:31:57.681927+0000","last_undegraded":"2023-06-02T15:31:57.681927+0000","last_fullsized":"2023-06-02T15:31:57.681927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:57.681867+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:57.681867+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.681867+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:09.331557+0000","scrub_duration":0.0066385239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:54.709129+0000","last_change":"2023-06-02T15:31:54.709526+0000","last_active":"2023-06-02T15:31:54.709129+0000","last_peered":"2023-06-02T15:31:54.709129+0000","last_clean":"2023-06-02T15:31:54.709129+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:31:54.709129+0000","last_undegraded":"2023-06-02T15:31:54.709129+0000","last_fullsized":"2023-06-02T15:31:54.709129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:54.709024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:54.709024+0000","last_clean_scrub_stamp":"2023-06-02T15:31:54.709024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:34.309032+0000","scrub_duration":0.0044425330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:10.905530+0000","last_change":"2023-06-02T15:32:10.905766+0000","last_active":"2023-06-02T15:32:10.905530+0000","last_peered":"2023-06-02T15:32:10.905530+0000","last_clean":"2023-06-02T15:32:10.905530+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:32:10.905530+0000","last_undegraded":"2023-06-02T15:32:10.905530+0000","last_fullsized":"2023-06-02T15:32:10.905530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:10.905480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:10.905480+0000","last_clean_scrub_stamp":"2023-06-02T15:32:10.905480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:19.827428+0000","scrub_duration":0.0033200590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:01.605460+0000","last_change":"2023-06-02T15:32:01.605705+0000","last_active":"2023-06-02T15:32:01.605460+0000","last_peered":"2023-06-02T15:32:01.605460+0000","last_clean":"2023-06-02T15:32:01.605460+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:32:01.605460+0000","last_undegraded":"2023-06-02T15:32:01.605460+0000","last_fullsized":"2023-06-02T15:32:01.605460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:01.605406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:01.605406+0000","last_clean_scrub_stamp":"2023-06-02T15:32:01.605406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:32.053608+0000","scrub_duration":0.0036437890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.682068+0000","last_change":"2023-06-02T15:31:53.682346+0000","last_active":"2023-06-02T15:31:53.682068+0000","last_peered":"2023-06-02T15:31:53.682068+0000","last_clean":"2023-06-02T15:31:53.682068+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:31:53.682068+0000","last_undegraded":"2023-06-02T15:31:53.682068+0000","last_fullsized":"2023-06-02T15:31:53.682068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:53.682012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:53.682012+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.682012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.841309+0000","scrub_duration":0.003995602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.514711+0000","last_change":"2023-06-02T15:31:56.514954+0000","last_active":"2023-06-02T15:31:56.514711+0000","last_peered":"2023-06-02T15:31:56.514711+0000","last_clean":"2023-06-02T15:31:56.514711+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:31:56.514711+0000","last_undegraded":"2023-06-02T15:31:56.514711+0000","last_fullsized":"2023-06-02T15:31:56.514711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:56.514662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:56.514662+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.514662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:51.622557+0000","scrub_duration":0.0037504259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.132683+0000","last_change":"2023-06-02T15:31:57.132917+0000","last_active":"2023-06-02T15:31:57.132683+0000","last_peered":"2023-06-02T15:31:57.132683+0000","last_clean":"2023-06-02T15:31:57.132683+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:31:57.132683+0000","last_undegraded":"2023-06-02T15:31:57.132683+0000","last_fullsized":"2023-06-02T15:31:57.132683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:31:57.132631+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:31:57.132631+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.132631+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:42.965894+0000","scrub_duration":0.0071564879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.807786+0000","last_change":"2023-06-02T15:31:57.808081+0000","last_active":"2023-06-02T15:31:57.807786+0000","last_peered":"2023-06-02T15:31:57.807786+0000","last_clean":"2023-06-02T15:31:57.807786+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:31:57.807786+0000","last_undegraded":"2023-06-02T15:31:57.807786+0000","last_fullsized":"2023-06-02T15:31:57.807786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:57.807733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:57.807733+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.807733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:43.640997+0000","scrub_duration":0.0037340979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.793654+0000","last_change":"2023-06-02T15:31:51.794000+0000","last_active":"2023-06-02T15:31:51.793654+0000","last_peered":"2023-06-02T15:31:51.793654+0000","last_clean":"2023-06-02T15:31:51.793654+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:31:51.793654+0000","last_undegraded":"2023-06-02T15:31:51.793654+0000","last_fullsized":"2023-06-02T15:31:51.793654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.793607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.793607+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.793607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:03.443296+0000","scrub_duration":0.0037644940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.022267+0000","last_change":"2023-06-02T15:32:02.022508+0000","last_active":"2023-06-02T15:32:02.022267+0000","last_peered":"2023-06-02T15:32:02.022267+0000","last_clean":"2023-06-02T15:32:02.022267+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:32:02.022267+0000","last_undegraded":"2023-06-02T15:32:02.022267+0000","last_fullsized":"2023-06-02T15:32:02.022267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:32:02.022211+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:32:02.022211+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.022211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:13.671901+0000","scrub_duration":0.0065549570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.745277+0000","last_change":"2023-06-02T15:31:48.745565+0000","last_active":"2023-06-02T15:31:48.745277+0000","last_peered":"2023-06-02T15:31:48.745277+0000","last_clean":"2023-06-02T15:31:48.745277+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:31:48.745277+0000","last_undegraded":"2023-06-02T15:31:48.745277+0000","last_fullsized":"2023-06-02T15:31:48.745277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.745224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.745224+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.745224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:29.497528+0000","scrub_duration":0.0041717810000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.580577+0000","last_change":"2023-06-02T15:32:05.580802+0000","last_active":"2023-06-02T15:32:05.580577+0000","last_peered":"2023-06-02T15:32:05.580577+0000","last_clean":"2023-06-02T15:32:05.580577+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:32:05.580577+0000","last_undegraded":"2023-06-02T15:32:05.580577+0000","last_fullsized":"2023-06-02T15:32:05.580577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.580528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.580528+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.580528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:30.258580+0000","scrub_duration":0.0033003379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.048276+0000","last_change":"2023-06-02T15:32:03.048495+0000","last_active":"2023-06-02T15:32:03.048276+0000","last_peered":"2023-06-02T15:32:03.048276+0000","last_clean":"2023-06-02T15:32:03.048276+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:32:03.048276+0000","last_undegraded":"2023-06-02T15:32:03.048276+0000","last_fullsized":"2023-06-02T15:32:03.048276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:32:03.048224+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:32:03.048224+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.048224+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:55.657274+0000","scrub_duration":0.0067757360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.095863+0000","last_change":"2023-06-02T15:32:16.096164+0000","last_active":"2023-06-02T15:32:16.095863+0000","last_peered":"2023-06-02T15:32:16.095863+0000","last_clean":"2023-06-02T15:32:16.095863+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:32:16.095863+0000","last_undegraded":"2023-06-02T15:32:16.095863+0000","last_fullsized":"2023-06-02T15:32:16.095863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.095808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.095808+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.095808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:55.854075+0000","scrub_duration":0.0041363069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.591127+0000","last_change":"2023-06-02T15:30:42.714188+0000","last_active":"2023-06-02T15:31:26.591127+0000","last_peered":"2023-06-02T15:31:26.591127+0000","last_clean":"2023-06-02T15:31:26.591127+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:31:26.591127+0000","last_undegraded":"2023-06-02T15:31:26.591127+0000","last_fullsized":"2023-06-02T15:31:26.591127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'12","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.534180+0000","last_change":"2023-06-02T15:31:44.534507+0000","last_active":"2023-06-02T15:31:44.534180+0000","last_peered":"2023-06-02T15:31:44.534180+0000","last_clean":"2023-06-02T15:31:44.534180+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:31:44.534180+0000","last_undegraded":"2023-06-02T15:31:44.534180+0000","last_fullsized":"2023-06-02T15:31:44.534180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2023-06-02T15:31:44.534127+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2023-06-02T15:31:44.534127+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.534127+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:13.513282+0000","scrub_duration":0.010992052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.800436+0000","last_change":"2023-06-02T15:32:05.800709+0000","last_active":"2023-06-02T15:32:05.800436+0000","last_peered":"2023-06-02T15:32:05.800436+0000","last_clean":"2023-06-02T15:32:05.800436+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:32:05.800436+0000","last_undegraded":"2023-06-02T15:32:05.800436+0000","last_fullsized":"2023-06-02T15:32:05.800436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.800386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.800386+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.800386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:14.722334+0000","scrub_duration":0.0038761970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.757737+0000","last_change":"2023-06-02T15:30:42.705561+0000","last_active":"2023-06-02T15:31:26.757737+0000","last_peered":"2023-06-02T15:31:26.757737+0000","last_clean":"2023-06-02T15:31:26.757737+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:31:26.757737+0000","last_undegraded":"2023-06-02T15:31:26.757737+0000","last_fullsized":"2023-06-02T15:31:26.757737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:54.070573+0000","last_change":"2023-06-02T15:31:54.070812+0000","last_active":"2023-06-02T15:31:54.070573+0000","last_peered":"2023-06-02T15:31:54.070573+0000","last_clean":"2023-06-02T15:31:54.070573+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:31:54.070573+0000","last_undegraded":"2023-06-02T15:31:54.070573+0000","last_fullsized":"2023-06-02T15:31:54.070573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:54.070524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:54.070524+0000","last_clean_scrub_stamp":"2023-06-02T15:31:54.070524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:33.670532+0000","scrub_duration":0.003366693,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.886215+0000","last_change":"2023-06-02T15:32:09.886495+0000","last_active":"2023-06-02T15:32:09.886215+0000","last_peered":"2023-06-02T15:32:09.886215+0000","last_clean":"2023-06-02T15:32:09.886215+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:32:09.886215+0000","last_undegraded":"2023-06-02T15:32:09.886215+0000","last_fullsized":"2023-06-02T15:32:09.886215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.886166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.886166+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.886166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:14.273734+0000","scrub_duration":0.003413995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.800790+0000","last_change":"2023-06-02T15:31:43.801035+0000","last_active":"2023-06-02T15:31:43.800790+0000","last_peered":"2023-06-02T15:31:43.800790+0000","last_clean":"2023-06-02T15:31:43.800790+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:31:43.800790+0000","last_undegraded":"2023-06-02T15:31:43.800790+0000","last_fullsized":"2023-06-02T15:31:43.800790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.800740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.800740+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.800740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:20.504313+0000","scrub_duration":0.0039374529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.427238+0000","last_change":"2023-06-02T15:32:09.427459+0000","last_active":"2023-06-02T15:32:09.427238+0000","last_peered":"2023-06-02T15:32:09.427238+0000","last_clean":"2023-06-02T15:32:09.427238+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:32:09.427238+0000","last_undegraded":"2023-06-02T15:32:09.427238+0000","last_fullsized":"2023-06-02T15:32:09.427238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.427191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.427191+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.427191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:04.182383+0000","scrub_duration":0.0032371549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.756671+0000","last_change":"2023-06-02T15:30:42.705725+0000","last_active":"2023-06-02T15:31:26.756671+0000","last_peered":"2023-06-02T15:31:26.756671+0000","last_clean":"2023-06-02T15:31:26.756671+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:31:26.756671+0000","last_undegraded":"2023-06-02T15:31:26.756671+0000","last_fullsized":"2023-06-02T15:31:26.756671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.110801+0000","last_change":"2023-06-02T15:31:55.111052+0000","last_active":"2023-06-02T15:31:55.110801+0000","last_peered":"2023-06-02T15:31:55.110801+0000","last_clean":"2023-06-02T15:31:55.110801+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:31:55.110801+0000","last_undegraded":"2023-06-02T15:31:55.110801+0000","last_fullsized":"2023-06-02T15:31:55.110801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2023-06-02T15:31:55.110743+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2023-06-02T15:31:55.110743+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.110743+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.218637+0000","scrub_duration":0.0089042889999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:27.266998+0000","last_change":"2023-06-02T15:31:26.924308+0000","last_active":"2023-06-02T15:31:27.266998+0000","last_peered":"2023-06-02T15:31:27.266998+0000","last_clean":"2023-06-02T15:31:27.266998+0000","last_became_active":"2023-06-02T15:31:26.923733+0000","last_became_peered":"2023-06-02T15:31:26.923733+0000","last_unstale":"2023-06-02T15:31:27.266998+0000","last_undegraded":"2023-06-02T15:31:27.266998+0000","last_fullsized":"2023-06-02T15:31:27.266998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:12.439543+0000","last_change":"2023-06-02T15:32:12.439830+0000","last_active":"2023-06-02T15:32:12.439543+0000","last_peered":"2023-06-02T15:32:12.439543+0000","last_clean":"2023-06-02T15:32:12.439543+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:32:12.439543+0000","last_undegraded":"2023-06-02T15:32:12.439543+0000","last_fullsized":"2023-06-02T15:32:12.439543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:12.439487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:12.439487+0000","last_clean_scrub_stamp":"2023-06-02T15:32:12.439487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:31.756307+0000","scrub_duration":0.0043436109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.568549+0000","last_change":"2023-06-02T15:32:00.568821+0000","last_active":"2023-06-02T15:32:00.568549+0000","last_peered":"2023-06-02T15:32:00.568549+0000","last_clean":"2023-06-02T15:32:00.568549+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:32:00.568549+0000","last_undegraded":"2023-06-02T15:32:00.568549+0000","last_fullsized":"2023-06-02T15:32:00.568549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:00.568499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:00.568499+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.568499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:20.571924+0000","scrub_duration":0.003625372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.739861+0000","last_change":"2023-06-02T15:32:09.740104+0000","last_active":"2023-06-02T15:32:09.739861+0000","last_peered":"2023-06-02T15:32:09.739861+0000","last_clean":"2023-06-02T15:32:09.739861+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:32:09.739861+0000","last_undegraded":"2023-06-02T15:32:09.739861+0000","last_fullsized":"2023-06-02T15:32:09.739861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.739809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.739809+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.739809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:29.056629+0000","scrub_duration":0.0034772800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.809260+0000","last_change":"2023-06-02T15:31:48.809508+0000","last_active":"2023-06-02T15:31:48.809260+0000","last_peered":"2023-06-02T15:31:48.809260+0000","last_clean":"2023-06-02T15:31:48.809260+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:31:48.809260+0000","last_undegraded":"2023-06-02T15:31:48.809260+0000","last_fullsized":"2023-06-02T15:31:48.809260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.809212+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:08.812638+0000","scrub_duration":0.003422675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.712883+0000","last_change":"2023-06-02T15:31:48.713166+0000","last_active":"2023-06-02T15:31:48.712883+0000","last_peered":"2023-06-02T15:31:48.712883+0000","last_clean":"2023-06-02T15:31:48.712883+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:31:48.712883+0000","last_undegraded":"2023-06-02T15:31:48.712883+0000","last_fullsized":"2023-06-02T15:31:48.712883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.712833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.712833+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.712833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:59.872130+0000","scrub_duration":0.0041090880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.357705+0000","last_change":"2023-06-02T15:32:11.357932+0000","last_active":"2023-06-02T15:32:11.357705+0000","last_peered":"2023-06-02T15:32:11.357705+0000","last_clean":"2023-06-02T15:32:11.357705+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:32:11.357705+0000","last_undegraded":"2023-06-02T15:32:11.357705+0000","last_fullsized":"2023-06-02T15:32:11.357705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.357659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.357659+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.357659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:36.035711+0000","scrub_duration":0.003466874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.463187+0000","last_change":"2023-06-02T15:32:11.463479+0000","last_active":"2023-06-02T15:32:11.463187+0000","last_peered":"2023-06-02T15:32:11.463187+0000","last_clean":"2023-06-02T15:32:11.463187+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:32:11.463187+0000","last_undegraded":"2023-06-02T15:32:11.463187+0000","last_fullsized":"2023-06-02T15:32:11.463187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.463140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.463140+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.463140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:19.130250+0000","scrub_duration":0.0031256579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.404861+0000","last_change":"2023-06-02T15:32:02.405088+0000","last_active":"2023-06-02T15:32:02.404861+0000","last_peered":"2023-06-02T15:32:02.404861+0000","last_clean":"2023-06-02T15:32:02.404861+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:32:02.404861+0000","last_undegraded":"2023-06-02T15:32:02.404861+0000","last_fullsized":"2023-06-02T15:32:02.404861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.404814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.404814+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.404814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.054503+0000","scrub_duration":0.003729914,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:59.370456+0000","last_change":"2023-06-02T15:31:59.370686+0000","last_active":"2023-06-02T15:31:59.370456+0000","last_peered":"2023-06-02T15:31:59.370456+0000","last_clean":"2023-06-02T15:31:59.370456+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:31:59.370456+0000","last_undegraded":"2023-06-02T15:31:59.370456+0000","last_fullsized":"2023-06-02T15:31:59.370456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:59.370409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:59.370409+0000","last_clean_scrub_stamp":"2023-06-02T15:31:59.370409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:19.373834+0000","scrub_duration":0.0039692160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.051406+0000","last_change":"2023-06-02T15:32:05.051651+0000","last_active":"2023-06-02T15:32:05.051406+0000","last_peered":"2023-06-02T15:32:05.051406+0000","last_clean":"2023-06-02T15:32:05.051406+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:32:05.051406+0000","last_undegraded":"2023-06-02T15:32:05.051406+0000","last_fullsized":"2023-06-02T15:32:05.051406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.051353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.051353+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.051353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:35.499555+0000","scrub_duration":0.0040453920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.672474+0000","last_change":"2023-06-02T15:32:11.672704+0000","last_active":"2023-06-02T15:32:11.672474+0000","last_peered":"2023-06-02T15:32:11.672474+0000","last_clean":"2023-06-02T15:32:11.672474+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:32:11.672474+0000","last_undegraded":"2023-06-02T15:32:11.672474+0000","last_fullsized":"2023-06-02T15:32:11.672474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.672427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.672427+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.672427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:51.430694+0000","scrub_duration":0.0035935189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:04.015620+0000","last_change":"2023-06-02T15:32:04.015903+0000","last_active":"2023-06-02T15:32:04.015620+0000","last_peered":"2023-06-02T15:32:04.015620+0000","last_clean":"2023-06-02T15:32:04.015620+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:32:04.015620+0000","last_undegraded":"2023-06-02T15:32:04.015620+0000","last_fullsized":"2023-06-02T15:32:04.015620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:04.015570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:04.015570+0000","last_clean_scrub_stamp":"2023-06-02T15:32:04.015570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:56.624619+0000","scrub_duration":0.0033126750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.055931+0000","last_change":"2023-06-02T15:32:09.056254+0000","last_active":"2023-06-02T15:32:09.055931+0000","last_peered":"2023-06-02T15:32:09.055931+0000","last_clean":"2023-06-02T15:32:09.055931+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:32:09.055931+0000","last_undegraded":"2023-06-02T15:32:09.055931+0000","last_fullsized":"2023-06-02T15:32:09.055931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.055882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.055882+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.055882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:13.443451+0000","scrub_duration":0.0037959309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.888219+0000","last_change":"2023-06-02T15:31:56.888442+0000","last_active":"2023-06-02T15:31:56.888219+0000","last_peered":"2023-06-02T15:31:56.888219+0000","last_clean":"2023-06-02T15:31:56.888219+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:31:56.888219+0000","last_undegraded":"2023-06-02T15:31:56.888219+0000","last_fullsized":"2023-06-02T15:31:56.888219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:56.888166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:56.888166+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.888166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:27.336368+0000","scrub_duration":0.0032250339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.801078+0000","last_change":"2023-06-02T15:31:37.801217+0000","last_active":"2023-06-02T15:31:37.801078+0000","last_peered":"2023-06-02T15:31:37.801078+0000","last_clean":"2023-06-02T15:31:37.801078+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:31:37.801078+0000","last_undegraded":"2023-06-02T15:31:37.801078+0000","last_fullsized":"2023-06-02T15:31:37.801078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.801043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.801043+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.801043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:46:43.999450+0000","scrub_duration":0.0034263620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588363+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:31:26.588363+0000","last_peered":"2023-06-02T15:31:26.588363+0000","last_clean":"2023-06-02T15:31:26.588363+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:31:26.588363+0000","last_undegraded":"2023-06-02T15:31:26.588363+0000","last_fullsized":"2023-06-02T15:31:26.588363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.005598+0000","last_change":"2023-06-02T15:32:03.005845+0000","last_active":"2023-06-02T15:32:03.005598+0000","last_peered":"2023-06-02T15:32:03.005598+0000","last_clean":"2023-06-02T15:32:03.005598+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:32:03.005598+0000","last_undegraded":"2023-06-02T15:32:03.005598+0000","last_fullsized":"2023-06-02T15:32:03.005598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.005544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.005544+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.005544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.655234+0000","scrub_duration":0.0031069069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.859940+0000","last_change":"2023-06-02T15:32:02.860193+0000","last_active":"2023-06-02T15:32:02.859940+0000","last_peered":"2023-06-02T15:32:02.859940+0000","last_clean":"2023-06-02T15:32:02.859940+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:32:02.859940+0000","last_undegraded":"2023-06-02T15:32:02.859940+0000","last_fullsized":"2023-06-02T15:32:02.859940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.859891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.859891+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.859891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:11.781839+0000","scrub_duration":0.0039529639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:10.100774+0000","last_change":"2023-06-02T15:32:10.101069+0000","last_active":"2023-06-02T15:32:10.100774+0000","last_peered":"2023-06-02T15:32:10.100774+0000","last_clean":"2023-06-02T15:32:10.100774+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:32:10.100774+0000","last_undegraded":"2023-06-02T15:32:10.100774+0000","last_fullsized":"2023-06-02T15:32:10.100774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:10.100721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:10.100721+0000","last_clean_scrub_stamp":"2023-06-02T15:32:10.100721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:19.022669+0000","scrub_duration":0.003560887,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.498288+0000","last_change":"2023-06-02T15:31:41.498607+0000","last_active":"2023-06-02T15:31:41.498288+0000","last_peered":"2023-06-02T15:31:41.498288+0000","last_clean":"2023-06-02T15:31:41.498288+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:31:41.498288+0000","last_undegraded":"2023-06-02T15:31:41.498288+0000","last_fullsized":"2023-06-02T15:31:41.498288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.498234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.498234+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.498234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:22.250537+0000","scrub_duration":0.0032772719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.761820+0000","last_change":"2023-06-02T15:31:41.762119+0000","last_active":"2023-06-02T15:31:41.761820+0000","last_peered":"2023-06-02T15:31:41.761820+0000","last_clean":"2023-06-02T15:31:41.761820+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:31:41.761820+0000","last_undegraded":"2023-06-02T15:31:41.761820+0000","last_fullsized":"2023-06-02T15:31:41.761820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.761771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.761771+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.761771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:10.202482+0000","scrub_duration":0.0033186510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.714050+0000","last_change":"2023-06-02T15:31:45.714297+0000","last_active":"2023-06-02T15:31:45.714050+0000","last_peered":"2023-06-02T15:31:45.714050+0000","last_clean":"2023-06-02T15:31:45.714050+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:31:45.714050+0000","last_undegraded":"2023-06-02T15:31:45.714050+0000","last_fullsized":"2023-06-02T15:31:45.714050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.713996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.713996+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.713996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:22.417569+0000","scrub_duration":0.003800037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588585+0000","last_change":"2023-06-02T15:30:38.650928+0000","last_active":"2023-06-02T15:31:26.588585+0000","last_peered":"2023-06-02T15:31:26.588585+0000","last_clean":"2023-06-02T15:31:26.588585+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:31:26.588585+0000","last_undegraded":"2023-06-02T15:31:26.588585+0000","last_fullsized":"2023-06-02T15:31:26.588585+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.497864+0000","last_change":"2023-06-02T15:31:37.498112+0000","last_active":"2023-06-02T15:31:37.497864+0000","last_peered":"2023-06-02T15:31:37.497864+0000","last_clean":"2023-06-02T15:31:37.497864+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:31:37.497864+0000","last_undegraded":"2023-06-02T15:31:37.497864+0000","last_fullsized":"2023-06-02T15:31:37.497864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.497813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.497813+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.497813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:06.476968+0000","scrub_duration":0.0034432849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:38.779703+0000","last_change":"2023-06-02T15:31:38.779930+0000","last_active":"2023-06-02T15:31:38.779703+0000","last_peered":"2023-06-02T15:31:38.779703+0000","last_clean":"2023-06-02T15:31:38.779703+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:31:38.779703+0000","last_undegraded":"2023-06-02T15:31:38.779703+0000","last_fullsized":"2023-06-02T15:31:38.779703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:38.779654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:38.779654+0000","last_clean_scrub_stamp":"2023-06-02T15:31:38.779654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:07.220365+0000","scrub_duration":0.0031197170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:07.505180+0000","last_change":"2023-06-02T15:32:07.505469+0000","last_active":"2023-06-02T15:32:07.505180+0000","last_peered":"2023-06-02T15:32:07.505180+0000","last_clean":"2023-06-02T15:32:07.505180+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:32:07.505180+0000","last_undegraded":"2023-06-02T15:32:07.505180+0000","last_fullsized":"2023-06-02T15:32:07.505180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:07.505132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:07.505132+0000","last_clean_scrub_stamp":"2023-06-02T15:32:07.505132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:27:05.339584+0000","scrub_duration":0.0034090029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.084596+0000","last_change":"2023-06-02T15:32:11.084825+0000","last_active":"2023-06-02T15:32:11.084596+0000","last_peered":"2023-06-02T15:32:11.084596+0000","last_clean":"2023-06-02T15:32:11.084596+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:32:11.084596+0000","last_undegraded":"2023-06-02T15:32:11.084596+0000","last_fullsized":"2023-06-02T15:32:11.084596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.084549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.084549+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.084549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:05.839740+0000","scrub_duration":0.0037808770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585297+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:31:26.585297+0000","last_peered":"2023-06-02T15:31:26.585297+0000","last_clean":"2023-06-02T15:31:26.585297+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:31:26.585297+0000","last_undegraded":"2023-06-02T15:31:26.585297+0000","last_fullsized":"2023-06-02T15:31:26.585297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.887243+0000","last_change":"2023-06-02T15:32:11.887491+0000","last_active":"2023-06-02T15:32:11.887243+0000","last_peered":"2023-06-02T15:32:11.887243+0000","last_clean":"2023-06-02T15:32:11.887243+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:32:11.887243+0000","last_undegraded":"2023-06-02T15:32:11.887243+0000","last_fullsized":"2023-06-02T15:32:11.887243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.887196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.887196+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.887196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:06.642387+0000","scrub_duration":0.003596793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.546272+0000","last_change":"2023-06-02T15:31:48.546529+0000","last_active":"2023-06-02T15:31:48.546272+0000","last_peered":"2023-06-02T15:31:48.546272+0000","last_clean":"2023-06-02T15:31:48.546272+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:31:48.546272+0000","last_undegraded":"2023-06-02T15:31:48.546272+0000","last_fullsized":"2023-06-02T15:31:48.546272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.546224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.546224+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.546224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:29.298528+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588483+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:31:26.588483+0000","last_peered":"2023-06-02T15:31:26.588483+0000","last_clean":"2023-06-02T15:31:26.588483+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:31:26.588483+0000","last_undegraded":"2023-06-02T15:31:26.588483+0000","last_fullsized":"2023-06-02T15:31:26.588483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:38.480377+0000","last_change":"2023-06-02T15:31:38.480659+0000","last_active":"2023-06-02T15:31:38.480377+0000","last_peered":"2023-06-02T15:31:38.480377+0000","last_clean":"2023-06-02T15:31:38.480377+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:31:38.480377+0000","last_undegraded":"2023-06-02T15:31:38.480377+0000","last_fullsized":"2023-06-02T15:31:38.480377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:38.480329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:38.480329+0000","last_clean_scrub_stamp":"2023-06-02T15:31:38.480329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:15.183901+0000","scrub_duration":0.0035440649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.744380+0000","last_change":"2023-06-02T15:31:44.744656+0000","last_active":"2023-06-02T15:31:44.744380+0000","last_peered":"2023-06-02T15:31:44.744380+0000","last_clean":"2023-06-02T15:31:44.744380+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:31:44.744380+0000","last_undegraded":"2023-06-02T15:31:44.744380+0000","last_fullsized":"2023-06-02T15:31:44.744380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:44.744325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:44.744325+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.744325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:13.723480+0000","scrub_duration":0.0037133079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5686,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9220,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362620,"statfs":{"total":96636764160,"available":96627322880,"internally_reserved":0,"allocated":389120,"data_stored":719524,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.538,"5min":1.538,"15min":1.538},"last":0.95099999999999996}]},{"osd":1,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.76600000000000001}]},{"osd":2,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.88},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.72399999999999998}]},{"osd":3,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":1.0169999999999999}]},{"osd":4,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.96799999999999997}]},{"osd":5,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.997}]},{"osd":6,"last update":"Fri Jun 2 15:31:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.1120000000000001}]},{"osd":1,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.875},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.0029999999999999}]},{"osd":2,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.96999999999999997}]},{"osd":3,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.78100000000000003}]},{"osd":4,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.66400000000000003}]},{"osd":5,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":0.90900000000000003}]},{"osd":7,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.93799999999999994}]}]},{"osd":5,"up_from":13,"seq":55834574872,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":294912,"data_stored":123686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.94499999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.79000000000000004}]},{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.159,"5min":1.159,"15min":1.159},"last":1.0620000000000001}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.234,"5min":1.234,"15min":1.234},"last":0.746}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.095}]},{"osd":4,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.2770000000000001,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.2370000000000001}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.881,"5min":1.881,"15min":1.881},"last":0.89000000000000001},{"interface":"front","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.165}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.137}]}]},{"osd":4,"up_from":13,"seq":55834574872,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8764,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363076,"statfs":{"total":96636764160,"available":96627789824,"internally_reserved":0,"allocated":315392,"data_stored":128996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.93400000000000005}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":1.018},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":0.89400000000000002}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.94699999999999995}]},{"osd":5,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.66400000000000003}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.76700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574873,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":294912,"data_stored":124126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.90300000000000002}]},{"osd":1,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.63700000000000001}]},{"osd":2,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78700000000000003}]},{"osd":4,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.05}]},{"osd":5,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.84999999999999998}]},{"osd":6,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.121},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.88}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.038}]},{"osd":1,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.751}]},{"osd":3,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.878},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.141}]},{"osd":4,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.79900000000000004}]},{"osd":5,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.337,"5min":1.337,"15min":1.337},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.6040000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.97599999999999998}]},{"osd":6,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.4970000000000001,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.2}]},{"osd":7,"last update":"Fri Jun 2 15:31:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.6619999999999999,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.165},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0069999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":356352,"data_stored":714404,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.59799999999999998}]},{"osd":2,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":1.0580000000000001}]},{"osd":3,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":1.1619999999999999}]},{"osd":5,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":1.115}]},{"osd":6,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":1.258},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":1.04}]},{"osd":7,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.143},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.01}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8676,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363164,"statfs":{"total":96636764160,"available":96627879936,"internally_reserved":0,"allocated":290816,"data_stored":123616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.65900000000000003}]},{"osd":2,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.74299999999999999}]},{"osd":3,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.77800000000000002}]},{"osd":4,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.84899999999999998}]},{"osd":5,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":1.04,"5min":1.04,"15min":1.04},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.573,"5min":1.573,"15min":1.573},"last":0.83499999999999996}]},{"osd":6,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":1.05,"5min":1.05,"15min":1.05},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0230000000000001,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":0.97199999999999998}]},{"osd":7,"last update":"Fri Jun 2 15:31:31 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.8080000000000001,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.022},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":1.0449999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:32:19.457 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.457 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.458 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.458 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.459 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.459 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.460 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.460 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-06-02T15:30:37.226788+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=37, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.461 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.461 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.461 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.462 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.462 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.462 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.463 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.463 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.463 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.464 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.464 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.465 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.465 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.466 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.466 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:19.466 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-02T15:32:39.468 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:32:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.593+0000 7fda72cc1640 1 Processor -- start 2023-06-02T15:32:39.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.593+0000 7fda72cc1640 1 -- start start 2023-06-02T15:32:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda72cc1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda6c14f330 0x7fda6c14bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:39.601 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda72cc1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fda6c0a0020 0x7fda6c1487d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda72cc1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda6c14ba90 con 0x7fda6c0bc1c0 2023-06-02T15:32:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda72cc1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6c0a47b0 con 0x7fda6c14f330 2023-06-02T15:32:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda72cc1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6c14f7c0 con 0x7fda6c0a0020 2023-06-02T15:32:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda6c14f330 0x7fda6c14bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:39.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda6c14f330 0x7fda6c14bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56516/0 (socket says 172.21.15.78:56516) 2023-06-02T15:32:39.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6bfff640 1 -- 172.21.15.78:0/2092825671 learned_addr learned my addr 172.21.15.78:0/2092825671 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:32:39.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda7125e640 1 --2- 172.21.15.78:0/2092825671 >> v2:172.21.15.132:3300/0 conn(0x7fda6c0a0020 0x7fda6c1487d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:39.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6bfff640 1 -- 172.21.15.78:0/2092825671 >> v2:172.21.15.132:3300/0 conn(0x7fda6c0a0020 msgr2=0x7fda6c1487d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:32:39.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6bfff640 1 --2- 172.21.15.78:0/2092825671 >> v2:172.21.15.132:3300/0 conn(0x7fda6c0a0020 0x7fda6c1487d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6bfff640 1 -- 172.21.15.78:0/2092825671 >> v1:172.21.15.132:6789/0 conn(0x7fda6c0bc1c0 legacy=0x7fda6c0a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:32:39.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6bfff640 1 -- 172.21.15.78:0/2092825671 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c14b440 con 0x7fda6c14f330 2023-06-02T15:32:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6bfff640 1 --2- 172.21.15.78:0/2092825671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 0x7fda6c14bf20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda6c06e8f0 tx=0x7fda6001eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b66e481f2e79a7 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:32:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6b7fe640 1 -- 172.21.15.78:0/2092825671 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda600a79e0 con 0x7fda6c14f330 2023-06-02T15:32:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6b7fe640 1 -- 172.21.15.78:0/2092825671 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda600a7b40 con 0x7fda6c14f330 2023-06-02T15:32:39.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.597+0000 7fda6b7fe640 1 -- 172.21.15.78:0/2092825671 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda600af440 con 0x7fda6c14f330 2023-06-02T15:32:39.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- 172.21.15.78:0/2092825671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 msgr2=0x7fda6c14bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:39.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 --2- 172.21.15.78:0/2092825671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 0x7fda6c14bf20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fda6c06e8f0 tx=0x7fda6001eb00 comp rx=0 tx=0).stop 2023-06-02T15:32:39.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- 172.21.15.78:0/2092825671 shutdown_connections 2023-06-02T15:32:39.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 --2- 172.21.15.78:0/2092825671 >> v2:172.21.15.132:3300/0 conn(0x7fda6c0a0020 0x7fda6c1487d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 --2- 172.21.15.78:0/2092825671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 0x7fda6c14bf20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- 172.21.15.78:0/2092825671 >> 172.21.15.78:0/2092825671 conn(0x7fda6c0bcf50 msgr2=0x7fda6c0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:32:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- 172.21.15.78:0/2092825671 shutdown_connections 2023-06-02T15:32:39.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- 172.21.15.78:0/2092825671 wait complete. 2023-06-02T15:32:39.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 Processor -- start 2023-06-02T15:32:39.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- start start 2023-06-02T15:32:39.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda6c0a0020 0x7fda6c0bf000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:39.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda6c0bc1c0 0x7fda6c13d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:39.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 0x7fda6c13dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:39.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c0be110 con 0x7fda6c14f330 2023-06-02T15:32:39.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c0c0940 con 0x7fda6c0bc1c0 2023-06-02T15:32:39.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c0bf540 con 0x7fda6c0a0020 2023-06-02T15:32:39.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda7125e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 0x7fda6c13dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:39.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda7125e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 0x7fda6c13dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:56518/0 (socket says 172.21.15.78:56518) 2023-06-02T15:32:39.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda7125e640 1 -- 172.21.15.78:0/1981657037 learned_addr learned my addr 172.21.15.78:0/1981657037 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:32:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda7125e640 1 -- 172.21.15.78:0/1981657037 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda6c0a0020 msgr2=0x7fda6c0bf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda7125e640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda6c0a0020 0x7fda6c0bf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda7125e640 1 -- 172.21.15.78:0/1981657037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda6c0bc1c0 msgr2=0x7fda6c13d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:39.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda6bfff640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda6c0bc1c0 0x7fda6c13d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda7125e640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda6c0bc1c0 0x7fda6c13d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda7125e640 1 -- 172.21.15.78:0/1981657037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6000b770 con 0x7fda6c14f330 2023-06-02T15:32:39.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda7125e640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 0x7fda6c13dad0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fda64007e70 tx=0x7fda6400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:32:39.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda697fa640 1 -- 172.21.15.78:0/1981657037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64014620 con 0x7fda6c14f330 2023-06-02T15:32:39.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda697fa640 1 -- 172.21.15.78:0/1981657037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda640147a0 con 0x7fda6c14f330 2023-06-02T15:32:39.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- 172.21.15.78:0/1981657037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda6c0bcb90 con 0x7fda6c14f330 2023-06-02T15:32:39.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda697fa640 1 -- 172.21.15.78:0/1981657037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda64014b50 con 0x7fda6c14f330 2023-06-02T15:32:39.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- 172.21.15.78:0/1981657037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda6c0bca00 con 0x7fda6c14f330 2023-06-02T15:32:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.601+0000 7fda72cc1640 1 -- 172.21.15.78:0/1981657037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda6c0bb660 con 0x7fda6c14f330 2023-06-02T15:32:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.605+0000 7fda697fa640 1 -- 172.21.15.78:0/1981657037 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fda64014cb0 con 0x7fda6c14f330 2023-06-02T15:32:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.605+0000 7fda697fa640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fda58065c00 0x7fda580680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.605+0000 7fda697fa640 1 -- 172.21.15.78:0/1981657037 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fda64083fa0 con 0x7fda6c14f330 2023-06-02T15:32:39.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.605+0000 7fda70a5d640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fda58065c00 0x7fda580680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.605+0000 7fda70a5d640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fda58065c00 0x7fda580680b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda5c003cf0 tx=0x7fda5c0079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:32:39.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.609+0000 7fda697fa640 1 -- 172.21.15.78:0/1981657037 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fda64054f60 con 0x7fda6c14f330 2023-06-02T15:32:39.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.757+0000 7fda72cc1640 1 -- 172.21.15.78:0/1981657037 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fda6c073bc0 con 0x7fda58065c00 2023-06-02T15:32:39.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.769+0000 7fda697fa640 1 -- 172.21.15.78:0/1981657037 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+393230 (secure 0 0 0) 0x7fda6c073bc0 con 0x7fda58065c00 2023-06-02T15:32:39.775 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:32:39.780 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:32:39.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.773+0000 7fda72cc1640 1 -- 172.21.15.78:0/1981657037 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fda58065c00 msgr2=0x7fda580680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:39.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.773+0000 7fda72cc1640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fda58065c00 0x7fda580680b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda5c003cf0 tx=0x7fda5c0079c0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.773+0000 7fda72cc1640 1 -- 172.21.15.78:0/1981657037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 msgr2=0x7fda6c13dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:39.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.773+0000 7fda72cc1640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 0x7fda6c13dad0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fda64007e70 tx=0x7fda6400e4b0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.777+0000 7fda72cc1640 1 -- 172.21.15.78:0/1981657037 shutdown_connections 2023-06-02T15:32:39.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.777+0000 7fda72cc1640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fda58065c00 0x7fda580680b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.777+0000 7fda72cc1640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda6c14f330 0x7fda6c13dad0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.777+0000 7fda72cc1640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda6c0bc1c0 0x7fda6c13d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.777+0000 7fda72cc1640 1 --2- 172.21.15.78:0/1981657037 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fda6c0a0020 0x7fda6c0bf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:39.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.777+0000 7fda72cc1640 1 -- 172.21.15.78:0/1981657037 >> 172.21.15.78:0/1981657037 conn(0x7fda6c0bcf50 msgr2=0x7fda6c1491a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:32:39.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.777+0000 7fda72cc1640 1 -- 172.21.15.78:0/1981657037 shutdown_connections 2023-06-02T15:32:39.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:39.777+0000 7fda72cc1640 1 -- 172.21.15.78:0/1981657037 wait complete. 2023-06-02T15:32:39.797 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-06-02T15:32:39.267781+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596054,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70304,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":67776,"kb_avail":754904416,"statfs":{"total":773094113280,"available":773022121984,"internally_reserved":0,"allocated":2523136,"data_stored":2182424,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69402624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004791"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:17.308033+0000","last_change":"2023-06-02T15:32:17.308306+0000","last_active":"2023-06-02T15:32:17.308033+0000","last_peered":"2023-06-02T15:32:17.308033+0000","last_clean":"2023-06-02T15:32:17.308033+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:32:17.308033+0000","last_undegraded":"2023-06-02T15:32:17.308033+0000","last_fullsized":"2023-06-02T15:32:17.308033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:17.307977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:17.307977+0000","last_clean_scrub_stamp":"2023-06-02T15:32:17.307977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:24.975088+0000","scrub_duration":0.0040900049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.897499+0000","last_change":"2023-06-02T15:31:52.897745+0000","last_active":"2023-06-02T15:31:52.897499+0000","last_peered":"2023-06-02T15:31:52.897499+0000","last_clean":"2023-06-02T15:31:52.897499+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:31:52.897499+0000","last_undegraded":"2023-06-02T15:31:52.897499+0000","last_fullsized":"2023-06-02T15:31:52.897499+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-06-02T15:31:52.897446+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-06-02T15:31:52.897446+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.897446+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:32.497455+0000","scrub_duration":0.010025713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.768317+0000","last_change":"2023-06-02T15:31:41.768563+0000","last_active":"2023-06-02T15:31:41.768317+0000","last_peered":"2023-06-02T15:31:41.768317+0000","last_clean":"2023-06-02T15:31:41.768317+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:31:41.768317+0000","last_undegraded":"2023-06-02T15:31:41.768317+0000","last_fullsized":"2023-06-02T15:31:41.768317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.768268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.768268+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.768268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:52.927565+0000","scrub_duration":0.003307744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585288+0000","last_change":"2023-06-02T15:30:42.696233+0000","last_active":"2023-06-02T15:31:26.585288+0000","last_peered":"2023-06-02T15:31:26.585288+0000","last_clean":"2023-06-02T15:31:26.585288+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:31:26.585288+0000","last_undegraded":"2023-06-02T15:31:26.585288+0000","last_fullsized":"2023-06-02T15:31:26.585288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:50.674223+0000","last_change":"2023-06-02T15:31:50.674223+0000","last_active":"2023-06-02T15:31:50.674223+0000","last_peered":"2023-06-02T15:31:50.674223+0000","last_clean":"2023-06-02T15:31:50.674223+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:31:50.674223+0000","last_undegraded":"2023-06-02T15:31:50.674223+0000","last_fullsized":"2023-06-02T15:31:50.674223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:31:50.673816+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:31:50.673816+0000","last_clean_scrub_stamp":"2023-06-02T15:31:50.673816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:45.781711+0000","scrub_duration":0.0040557650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.766596+0000","last_change":"2023-06-02T15:32:08.766821+0000","last_active":"2023-06-02T15:32:08.766596+0000","last_peered":"2023-06-02T15:32:08.766596+0000","last_clean":"2023-06-02T15:32:08.766596+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:32:08.766596+0000","last_undegraded":"2023-06-02T15:32:08.766596+0000","last_fullsized":"2023-06-02T15:32:08.766596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:08.766547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:08.766547+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.766547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:16.433658+0000","scrub_duration":0.0038415820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.351238+0000","last_change":"2023-06-02T15:32:14.351572+0000","last_active":"2023-06-02T15:32:14.351238+0000","last_peered":"2023-06-02T15:32:14.351238+0000","last_clean":"2023-06-02T15:32:14.351238+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:32:14.351238+0000","last_undegraded":"2023-06-02T15:32:14.351238+0000","last_fullsized":"2023-06-02T15:32:14.351238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.351188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.351188+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.351188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:54.109455+0000","scrub_duration":0.0037757120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.644002+0000","last_change":"2023-06-02T15:31:53.644353+0000","last_active":"2023-06-02T15:31:53.644002+0000","last_peered":"2023-06-02T15:31:53.644002+0000","last_clean":"2023-06-02T15:31:53.644002+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:31:53.644002+0000","last_undegraded":"2023-06-02T15:31:53.644002+0000","last_fullsized":"2023-06-02T15:31:53.644002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:53.643891+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:53.643891+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.643891+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:13.647317+0000","scrub_duration":0.0067897779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:42.741168+0000","last_change":"2023-06-02T15:31:42.741474+0000","last_active":"2023-06-02T15:31:42.741168+0000","last_peered":"2023-06-02T15:31:42.741168+0000","last_clean":"2023-06-02T15:31:42.741168+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:31:42.741168+0000","last_undegraded":"2023-06-02T15:31:42.741168+0000","last_fullsized":"2023-06-02T15:31:42.741168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:42.741115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:42.741115+0000","last_clean_scrub_stamp":"2023-06-02T15:31:42.741115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:22.341123+0000","scrub_duration":0.0040099519999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:21.225274+0000","last_change":"2023-06-02T15:32:21.225588+0000","last_active":"2023-06-02T15:32:21.225274+0000","last_peered":"2023-06-02T15:32:21.225274+0000","last_clean":"2023-06-02T15:32:21.225274+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:32:21.225274+0000","last_undegraded":"2023-06-02T15:32:21.225274+0000","last_fullsized":"2023-06-02T15:32:21.225274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:21.225222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:21.225222+0000","last_clean_scrub_stamp":"2023-06-02T15:32:21.225222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:24.574245+0000","scrub_duration":0.0040298850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.593085+0000","last_change":"2023-06-02T15:31:56.593314+0000","last_active":"2023-06-02T15:31:56.593085+0000","last_peered":"2023-06-02T15:31:56.593085+0000","last_clean":"2023-06-02T15:31:56.593085+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:31:56.593085+0000","last_undegraded":"2023-06-02T15:31:56.593085+0000","last_fullsized":"2023-06-02T15:31:56.593085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:56.593030+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:56.593030+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.593030+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:08.242720+0000","scrub_duration":0.0068701040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:40.768267+0000","last_change":"2023-06-02T15:31:40.768497+0000","last_active":"2023-06-02T15:31:40.768267+0000","last_peered":"2023-06-02T15:31:40.768267+0000","last_clean":"2023-06-02T15:31:40.768267+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:31:40.768267+0000","last_undegraded":"2023-06-02T15:31:40.768267+0000","last_fullsized":"2023-06-02T15:31:40.768267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:40.768219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:40.768219+0000","last_clean_scrub_stamp":"2023-06-02T15:31:40.768219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:29:50.472958+0000","scrub_duration":0.0035921740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.349663+0000","last_change":"2023-06-02T15:32:13.349940+0000","last_active":"2023-06-02T15:32:13.349663+0000","last_peered":"2023-06-02T15:32:13.349663+0000","last_clean":"2023-06-02T15:32:13.349663+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:32:13.349663+0000","last_undegraded":"2023-06-02T15:32:13.349663+0000","last_fullsized":"2023-06-02T15:32:13.349663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.349610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.349610+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.349610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:27:11.184062+0000","scrub_duration":0.0039129899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.968715+0000","last_change":"2023-06-02T15:31:57.968954+0000","last_active":"2023-06-02T15:31:57.968715+0000","last_peered":"2023-06-02T15:31:57.968715+0000","last_clean":"2023-06-02T15:31:57.968715+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:31:57.968715+0000","last_undegraded":"2023-06-02T15:31:57.968715+0000","last_fullsized":"2023-06-02T15:31:57.968715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:31:57.968663+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:31:57.968663+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.968663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:43.801926+0000","scrub_duration":0.003851307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.770706+0000","last_change":"2023-06-02T15:31:36.770926+0000","last_active":"2023-06-02T15:31:36.770706+0000","last_peered":"2023-06-02T15:31:36.770706+0000","last_clean":"2023-06-02T15:31:36.770706+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:31:36.770706+0000","last_undegraded":"2023-06-02T15:31:36.770706+0000","last_fullsized":"2023-06-02T15:31:36.770706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:36.770650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:36.770650+0000","last_clean_scrub_stamp":"2023-06-02T15:31:36.770650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:01:52.784223+0000","scrub_duration":0.0030208169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.587870+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:31:26.587870+0000","last_peered":"2023-06-02T15:31:26.587870+0000","last_clean":"2023-06-02T15:31:26.587870+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:31:26.587870+0000","last_undegraded":"2023-06-02T15:31:26.587870+0000","last_fullsized":"2023-06-02T15:31:26.587870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.718833+0000","last_change":"2023-06-02T15:32:13.719090+0000","last_active":"2023-06-02T15:32:13.718833+0000","last_peered":"2023-06-02T15:32:13.718833+0000","last_clean":"2023-06-02T15:32:13.718833+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:32:13.718833+0000","last_undegraded":"2023-06-02T15:32:13.718833+0000","last_fullsized":"2023-06-02T15:32:13.718833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:32:13.718779+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:32:13.718779+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.718779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:17.067801+0000","scrub_duration":0.0036400669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.724754+0000","last_change":"2023-06-02T15:31:43.724985+0000","last_active":"2023-06-02T15:31:43.724754+0000","last_peered":"2023-06-02T15:31:43.724754+0000","last_clean":"2023-06-02T15:31:43.724754+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:31:43.724754+0000","last_undegraded":"2023-06-02T15:31:43.724754+0000","last_fullsized":"2023-06-02T15:31:43.724754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.724701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.724701+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.724701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:24.477005+0000","scrub_duration":0.0034074370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.609164+0000","last_change":"2023-06-02T15:32:03.609423+0000","last_active":"2023-06-02T15:32:03.609164+0000","last_peered":"2023-06-02T15:32:03.609164+0000","last_clean":"2023-06-02T15:32:03.609164+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:32:03.609164+0000","last_undegraded":"2023-06-02T15:32:03.609164+0000","last_fullsized":"2023-06-02T15:32:03.609164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.609111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.609111+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.609111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:15.258800+0000","scrub_duration":0.0036874350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.171811+0000","last_change":"2023-06-02T15:31:37.171911+0000","last_active":"2023-06-02T15:31:37.171811+0000","last_peered":"2023-06-02T15:31:37.171811+0000","last_clean":"2023-06-02T15:31:37.171811+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:31:37.171811+0000","last_undegraded":"2023-06-02T15:31:37.171811+0000","last_fullsized":"2023-06-02T15:31:37.171811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.171792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.171792+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.171792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:05.612504+0000","scrub_duration":0.00141092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.879500+0000","last_change":"2023-06-02T15:32:13.879735+0000","last_active":"2023-06-02T15:32:13.879500+0000","last_peered":"2023-06-02T15:32:13.879500+0000","last_clean":"2023-06-02T15:32:13.879500+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:32:13.879500+0000","last_undegraded":"2023-06-02T15:32:13.879500+0000","last_fullsized":"2023-06-02T15:32:13.879500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.879426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.879426+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.879426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:21.546537+0000","scrub_duration":0.003456967,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.952958+0000","last_change":"2023-06-02T15:32:16.953226+0000","last_active":"2023-06-02T15:32:16.952958+0000","last_peered":"2023-06-02T15:32:16.952958+0000","last_clean":"2023-06-02T15:32:16.952958+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:32:16.952958+0000","last_undegraded":"2023-06-02T15:32:16.952958+0000","last_fullsized":"2023-06-02T15:32:16.952958+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.952905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.952905+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.952905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:56.711172+0000","scrub_duration":0.0040503359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:04.775444+0000","last_change":"2023-06-02T15:32:04.775742+0000","last_active":"2023-06-02T15:32:04.775444+0000","last_peered":"2023-06-02T15:32:04.775444+0000","last_clean":"2023-06-02T15:32:04.775444+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:32:04.775444+0000","last_undegraded":"2023-06-02T15:32:04.775444+0000","last_fullsized":"2023-06-02T15:32:04.775444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:04.775390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:04.775390+0000","last_clean_scrub_stamp":"2023-06-02T15:32:04.775390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:09.162959+0000","scrub_duration":0.0032928110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.517902+0000","last_change":"2023-06-02T15:31:53.518146+0000","last_active":"2023-06-02T15:31:53.517902+0000","last_peered":"2023-06-02T15:31:53.517902+0000","last_clean":"2023-06-02T15:31:53.517902+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:31:53.517902+0000","last_undegraded":"2023-06-02T15:31:53.517902+0000","last_fullsized":"2023-06-02T15:31:53.517902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:53.517854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:53.517854+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.517854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.677151+0000","scrub_duration":0.0031286759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:39.691357+0000","last_change":"2023-06-02T15:31:39.691651+0000","last_active":"2023-06-02T15:31:39.691357+0000","last_peered":"2023-06-02T15:31:39.691357+0000","last_clean":"2023-06-02T15:31:39.691357+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:31:39.691357+0000","last_undegraded":"2023-06-02T15:31:39.691357+0000","last_fullsized":"2023-06-02T15:31:39.691357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:39.691303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:39.691303+0000","last_clean_scrub_stamp":"2023-06-02T15:31:39.691303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:08.670458+0000","scrub_duration":0.0032675849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:46.866855+0000","last_change":"2023-06-02T15:31:46.867109+0000","last_active":"2023-06-02T15:31:46.866855+0000","last_peered":"2023-06-02T15:31:46.866855+0000","last_clean":"2023-06-02T15:31:46.866855+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:31:46.866855+0000","last_undegraded":"2023-06-02T15:31:46.866855+0000","last_fullsized":"2023-06-02T15:31:46.866855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:46.866803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:46.866803+0000","last_clean_scrub_stamp":"2023-06-02T15:31:46.866803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:27.619106+0000","scrub_duration":0.0038372440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:12.762729+0000","last_change":"2023-06-02T15:32:12.762960+0000","last_active":"2023-06-02T15:32:12.762729+0000","last_peered":"2023-06-02T15:32:12.762729+0000","last_clean":"2023-06-02T15:32:12.762729+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:32:12.762729+0000","last_undegraded":"2023-06-02T15:32:12.762729+0000","last_fullsized":"2023-06-02T15:32:12.762729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:12.762690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:12.762690+0000","last_clean_scrub_stamp":"2023-06-02T15:32:12.762690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:37.440741+0000","scrub_duration":0.0035931549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:06.764347+0000","last_change":"2023-06-02T15:32:06.764696+0000","last_active":"2023-06-02T15:32:06.764347+0000","last_peered":"2023-06-02T15:32:06.764347+0000","last_clean":"2023-06-02T15:32:06.764347+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:32:06.764347+0000","last_undegraded":"2023-06-02T15:32:06.764347+0000","last_fullsized":"2023-06-02T15:32:06.764347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:06.764295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:06.764295+0000","last_clean_scrub_stamp":"2023-06-02T15:32:06.764295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:01.519486+0000","scrub_duration":0.0036305719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:46.537638+0000","last_change":"2023-06-02T15:31:46.537878+0000","last_active":"2023-06-02T15:31:46.537638+0000","last_peered":"2023-06-02T15:31:46.537638+0000","last_clean":"2023-06-02T15:31:46.537638+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:31:46.537638+0000","last_undegraded":"2023-06-02T15:31:46.537638+0000","last_fullsized":"2023-06-02T15:31:46.537638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:46.537583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:46.537583+0000","last_clean_scrub_stamp":"2023-06-02T15:31:46.537583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:57.696880+0000","scrub_duration":0.0033143180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.135482+0000","last_change":"2023-06-02T15:32:13.135793+0000","last_active":"2023-06-02T15:32:13.135482+0000","last_peered":"2023-06-02T15:32:13.135482+0000","last_clean":"2023-06-02T15:32:13.135482+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:32:13.135482+0000","last_undegraded":"2023-06-02T15:32:13.135482+0000","last_fullsized":"2023-06-02T15:32:13.135482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.135430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.135430+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.135430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:20.802541+0000","scrub_duration":0.0040929599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.000626+0000","last_change":"2023-06-02T15:31:44.000867+0000","last_active":"2023-06-02T15:31:44.000626+0000","last_peered":"2023-06-02T15:31:44.000626+0000","last_clean":"2023-06-02T15:31:44.000626+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:31:44.000626+0000","last_undegraded":"2023-06-02T15:31:44.000626+0000","last_fullsized":"2023-06-02T15:31:44.000626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-06-02T15:31:44.000570+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-06-02T15:31:44.000570+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.000570+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:12.979725+0000","scrub_duration":0.0085722809999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:07.319600+0000","last_change":"2023-06-02T15:32:07.319836+0000","last_active":"2023-06-02T15:32:07.319600+0000","last_peered":"2023-06-02T15:32:07.319600+0000","last_clean":"2023-06-02T15:32:07.319600+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:32:07.319600+0000","last_undegraded":"2023-06-02T15:32:07.319600+0000","last_fullsized":"2023-06-02T15:32:07.319600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:07.319552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:07.319552+0000","last_clean_scrub_stamp":"2023-06-02T15:32:07.319552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:37.767754+0000","scrub_duration":0.0036772110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:27.684976+0000","last_change":"2023-06-02T15:32:27.685321+0000","last_active":"2023-06-02T15:32:27.684976+0000","last_peered":"2023-06-02T15:32:27.684976+0000","last_clean":"2023-06-02T15:32:27.684976+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:32:27.684976+0000","last_undegraded":"2023-06-02T15:32:27.684976+0000","last_fullsized":"2023-06-02T15:32:27.684976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:27.684926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:27.684926+0000","last_clean_scrub_stamp":"2023-06-02T15:32:27.684926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:02:57.805759+0000","scrub_duration":0.0043116439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'19","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.805093+0000","last_change":"2023-06-02T15:32:08.805341+0000","last_active":"2023-06-02T15:32:08.805093+0000","last_peered":"2023-06-02T15:32:08.805093+0000","last_clean":"2023-06-02T15:32:08.805093+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:32:08.805093+0000","last_undegraded":"2023-06-02T15:32:08.805093+0000","last_fullsized":"2023-06-02T15:32:08.805093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2023-06-02T15:32:08.805041+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2023-06-02T15:32:08.805041+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.805041+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:48.563308+0000","scrub_duration":0.01113798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4904,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.873703+0000","last_change":"2023-06-02T15:32:03.873928+0000","last_active":"2023-06-02T15:32:03.873703+0000","last_peered":"2023-06-02T15:32:03.873703+0000","last_clean":"2023-06-02T15:32:03.873703+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:32:03.873703+0000","last_undegraded":"2023-06-02T15:32:03.873703+0000","last_fullsized":"2023-06-02T15:32:03.873703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.873651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.873651+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.873651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:07:58.628843+0000","scrub_duration":0.0075517730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:15.379094+0000","last_change":"2023-06-02T15:32:15.379438+0000","last_active":"2023-06-02T15:32:15.379094+0000","last_peered":"2023-06-02T15:32:15.379094+0000","last_clean":"2023-06-02T15:32:15.379094+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:32:15.379094+0000","last_undegraded":"2023-06-02T15:32:15.379094+0000","last_fullsized":"2023-06-02T15:32:15.379094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:15.379039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:15.379039+0000","last_clean_scrub_stamp":"2023-06-02T15:32:15.379039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:10.134230+0000","scrub_duration":0.0041123649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.270176+0000","last_change":"2023-06-02T15:31:51.270419+0000","last_active":"2023-06-02T15:31:51.270176+0000","last_peered":"2023-06-02T15:31:51.270176+0000","last_clean":"2023-06-02T15:31:51.270176+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:31:51.270176+0000","last_undegraded":"2023-06-02T15:31:51.270176+0000","last_fullsized":"2023-06-02T15:31:51.270176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.270125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.270125+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.270125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:30:00.974864+0000","scrub_duration":0.0038244239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.494370+0000","last_change":"2023-06-02T15:31:41.494671+0000","last_active":"2023-06-02T15:31:41.494370+0000","last_peered":"2023-06-02T15:31:41.494370+0000","last_clean":"2023-06-02T15:31:41.494370+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:31:41.494370+0000","last_undegraded":"2023-06-02T15:31:41.494370+0000","last_fullsized":"2023-06-02T15:31:41.494370+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.494318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.494318+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.494318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:09.935029+0000","scrub_duration":0.0040292009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:49.596891+0000","last_change":"2023-06-02T15:31:49.597169+0000","last_active":"2023-06-02T15:31:49.596891+0000","last_peered":"2023-06-02T15:31:49.596891+0000","last_clean":"2023-06-02T15:31:49.596891+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:31:49.596891+0000","last_undegraded":"2023-06-02T15:31:49.596891+0000","last_fullsized":"2023-06-02T15:31:49.596891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:49.596840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:49.596840+0000","last_clean_scrub_stamp":"2023-06-02T15:31:49.596840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:44.704735+0000","scrub_duration":0.0034677010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.886292+0000","last_change":"2023-06-02T15:32:14.886646+0000","last_active":"2023-06-02T15:32:14.886292+0000","last_peered":"2023-06-02T15:32:14.886292+0000","last_clean":"2023-06-02T15:32:14.886292+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:32:14.886292+0000","last_undegraded":"2023-06-02T15:32:14.886292+0000","last_fullsized":"2023-06-02T15:32:14.886292+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.886241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.886241+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.886241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:34.203061+0000","scrub_duration":0.0039836819999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.998849+0000","last_change":"2023-06-02T15:32:05.999085+0000","last_active":"2023-06-02T15:32:05.998849+0000","last_peered":"2023-06-02T15:32:05.998849+0000","last_clean":"2023-06-02T15:32:05.998849+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:32:05.998849+0000","last_undegraded":"2023-06-02T15:32:05.998849+0000","last_fullsized":"2023-06-02T15:32:05.998849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.998798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.998798+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.998798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:36.447000+0000","scrub_duration":0.0035371059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:39.527675+0000","last_change":"2023-06-02T15:31:39.527934+0000","last_active":"2023-06-02T15:31:39.527675+0000","last_peered":"2023-06-02T15:31:39.527675+0000","last_clean":"2023-06-02T15:31:39.527675+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:31:39.527675+0000","last_undegraded":"2023-06-02T15:31:39.527675+0000","last_fullsized":"2023-06-02T15:31:39.527675+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:39.527621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:39.527621+0000","last_clean_scrub_stamp":"2023-06-02T15:31:39.527621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:31:08.870956+0000","scrub_duration":0.0040577269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.313909+0000","last_change":"2023-06-02T15:31:48.314179+0000","last_active":"2023-06-02T15:31:48.313909+0000","last_peered":"2023-06-02T15:31:48.313909+0000","last_clean":"2023-06-02T15:31:48.313909+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:31:48.313909+0000","last_undegraded":"2023-06-02T15:31:48.313909+0000","last_fullsized":"2023-06-02T15:31:48.313909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.313862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.313862+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.313862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:19:57.371808+0000","scrub_duration":0.003324671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.724480+0000","last_change":"2023-06-02T15:32:08.724804+0000","last_active":"2023-06-02T15:32:08.724480+0000","last_peered":"2023-06-02T15:32:08.724480+0000","last_clean":"2023-06-02T15:32:08.724480+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:32:08.724480+0000","last_undegraded":"2023-06-02T15:32:08.724480+0000","last_fullsized":"2023-06-02T15:32:08.724480+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:08.724428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:08.724428+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.724428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:39.172630+0000","scrub_duration":0.0040007369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:40.702232+0000","last_change":"2023-06-02T15:31:40.702502+0000","last_active":"2023-06-02T15:31:40.702232+0000","last_peered":"2023-06-02T15:31:40.702232+0000","last_clean":"2023-06-02T15:31:40.702232+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:31:40.702232+0000","last_undegraded":"2023-06-02T15:31:40.702232+0000","last_fullsized":"2023-06-02T15:31:40.702232+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:40.702183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:40.702183+0000","last_clean_scrub_stamp":"2023-06-02T15:31:40.702183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:17.405756+0000","scrub_duration":0.0083223120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.826192+0000","last_change":"2023-06-02T15:32:05.826457+0000","last_active":"2023-06-02T15:32:05.826192+0000","last_peered":"2023-06-02T15:32:05.826192+0000","last_clean":"2023-06-02T15:32:05.826192+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:32:05.826192+0000","last_undegraded":"2023-06-02T15:32:05.826192+0000","last_fullsized":"2023-06-02T15:32:05.826192+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.826140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.826140+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.826140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:13.493251+0000","scrub_duration":0.0034698720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.692402+0000","last_change":"2023-06-02T15:32:00.692667+0000","last_active":"2023-06-02T15:32:00.692402+0000","last_peered":"2023-06-02T15:32:00.692402+0000","last_clean":"2023-06-02T15:32:00.692402+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:32:00.692402+0000","last_undegraded":"2023-06-02T15:32:00.692402+0000","last_fullsized":"2023-06-02T15:32:00.692402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:32:00.692346+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:32:00.692346+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.692346+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:31.140548+0000","scrub_duration":0.0085621840000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585197+0000","last_change":"2023-06-02T15:30:42.709540+0000","last_active":"2023-06-02T15:31:26.585197+0000","last_peered":"2023-06-02T15:31:26.585197+0000","last_clean":"2023-06-02T15:31:26.585197+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:31:26.585197+0000","last_undegraded":"2023-06-02T15:31:26.585197+0000","last_fullsized":"2023-06-02T15:31:26.585197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.850649+0000","last_change":"2023-06-02T15:32:00.850871+0000","last_active":"2023-06-02T15:32:00.850649+0000","last_peered":"2023-06-02T15:32:00.850649+0000","last_clean":"2023-06-02T15:32:00.850649+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:32:00.850649+0000","last_undegraded":"2023-06-02T15:32:00.850649+0000","last_fullsized":"2023-06-02T15:32:00.850649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:00.850599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:00.850599+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.850599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:25.528650+0000","scrub_duration":0.0036098129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:49.711619+0000","last_change":"2023-06-02T15:31:49.712018+0000","last_active":"2023-06-02T15:31:49.711619+0000","last_peered":"2023-06-02T15:31:49.711619+0000","last_clean":"2023-06-02T15:31:49.711619+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:31:49.711619+0000","last_undegraded":"2023-06-02T15:31:49.711619+0000","last_fullsized":"2023-06-02T15:31:49.711619+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:49.711487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:49.711487+0000","last_clean_scrub_stamp":"2023-06-02T15:31:49.711487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:29.311495+0000","scrub_duration":0.0044216419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:42.817603+0000","last_change":"2023-06-02T15:31:42.817844+0000","last_active":"2023-06-02T15:31:42.817603+0000","last_peered":"2023-06-02T15:31:42.817603+0000","last_clean":"2023-06-02T15:31:42.817603+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:31:42.817603+0000","last_undegraded":"2023-06-02T15:31:42.817603+0000","last_fullsized":"2023-06-02T15:31:42.817603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:31:42.817550+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:31:42.817550+0000","last_clean_scrub_stamp":"2023-06-02T15:31:42.817550+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:11.796705+0000","scrub_duration":0.0085183749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.741731+0000","last_change":"2023-06-02T15:32:16.742059+0000","last_active":"2023-06-02T15:32:16.741731+0000","last_peered":"2023-06-02T15:32:16.741731+0000","last_clean":"2023-06-02T15:32:16.741731+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:32:16.741731+0000","last_undegraded":"2023-06-02T15:32:16.741731+0000","last_fullsized":"2023-06-02T15:32:16.741731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.741672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.741672+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.741672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:20.090695+0000","scrub_duration":0.004709123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:35.675238+0000","last_change":"2023-06-02T15:31:35.675333+0000","last_active":"2023-06-02T15:31:35.675238+0000","last_peered":"2023-06-02T15:31:35.675238+0000","last_clean":"2023-06-02T15:31:35.675238+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:31:35.675238+0000","last_undegraded":"2023-06-02T15:31:35.675238+0000","last_fullsized":"2023-06-02T15:31:35.675238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:35.675220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:35.675220+0000","last_clean_scrub_stamp":"2023-06-02T15:31:35.675220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:46:41.873628+0000","scrub_duration":0.001699594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.893366+0000","last_change":"2023-06-02T15:31:51.893605+0000","last_active":"2023-06-02T15:31:51.893366+0000","last_peered":"2023-06-02T15:31:51.893366+0000","last_clean":"2023-06-02T15:31:51.893366+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:31:51.893366+0000","last_undegraded":"2023-06-02T15:31:51.893366+0000","last_fullsized":"2023-06-02T15:31:51.893366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.893317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.893317+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.893317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:03.052614+0000","scrub_duration":0.0037955900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'119","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.046295+0000","last_change":"2023-06-02T15:31:53.046295+0000","last_active":"2023-06-02T15:31:53.046295+0000","last_peered":"2023-06-02T15:31:53.046295+0000","last_clean":"2023-06-02T15:31:53.046295+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:31:53.046295+0000","last_undegraded":"2023-06-02T15:31:53.046295+0000","last_fullsized":"2023-06-02T15:31:53.046295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-06-02T15:31:53.045988+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-06-02T15:31:53.045988+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.045988+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.205286+0000","scrub_duration":0.014250489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.176598+0000","last_change":"2023-06-02T15:31:36.176680+0000","last_active":"2023-06-02T15:31:36.176598+0000","last_peered":"2023-06-02T15:31:36.176598+0000","last_clean":"2023-06-02T15:31:36.176598+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:31:36.176598+0000","last_undegraded":"2023-06-02T15:31:36.176598+0000","last_fullsized":"2023-06-02T15:31:36.176598+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:36.176579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:36.176579+0000","last_clean_scrub_stamp":"2023-06-02T15:31:36.176579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:31:05.519914+0000","scrub_duration":0.0032385439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:30.351003+0000","last_change":"2023-06-02T15:32:30.351352+0000","last_active":"2023-06-02T15:32:30.351003+0000","last_peered":"2023-06-02T15:32:30.351003+0000","last_clean":"2023-06-02T15:32:30.351003+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:32:30.351003+0000","last_undegraded":"2023-06-02T15:32:30.351003+0000","last_fullsized":"2023-06-02T15:32:30.351003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:30.350951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:30.350951+0000","last_clean_scrub_stamp":"2023-06-02T15:32:30.350951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:03:00.471783+0000","scrub_duration":0.0043598769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.306197+0000","last_change":"2023-06-02T15:31:55.306444+0000","last_active":"2023-06-02T15:31:55.306197+0000","last_peered":"2023-06-02T15:31:55.306197+0000","last_clean":"2023-06-02T15:31:55.306197+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:31:55.306197+0000","last_undegraded":"2023-06-02T15:31:55.306197+0000","last_fullsized":"2023-06-02T15:31:55.306197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:55.306148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:55.306148+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.306148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.414043+0000","scrub_duration":0.0036463979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.316509+0000","last_change":"2023-06-02T15:31:43.316509+0000","last_active":"2023-06-02T15:31:43.316509+0000","last_peered":"2023-06-02T15:31:43.316509+0000","last_clean":"2023-06-02T15:31:43.316509+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:31:43.316509+0000","last_undegraded":"2023-06-02T15:31:43.316509+0000","last_fullsized":"2023-06-02T15:31:43.316509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.316233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.316233+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.316233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:55:51.972560+0000","scrub_duration":0.0081781270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.031012+0000","last_change":"2023-06-02T15:31:45.031260+0000","last_active":"2023-06-02T15:31:45.031012+0000","last_peered":"2023-06-02T15:31:45.031012+0000","last_clean":"2023-06-02T15:31:45.031012+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:31:45.031012+0000","last_undegraded":"2023-06-02T15:31:45.031012+0000","last_fullsized":"2023-06-02T15:31:45.031012+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.030964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.030964+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.030964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:21.734537+0000","scrub_duration":0.0035987649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.736558+0000","last_change":"2023-06-02T15:31:55.736848+0000","last_active":"2023-06-02T15:31:55.736558+0000","last_peered":"2023-06-02T15:31:55.736558+0000","last_clean":"2023-06-02T15:31:55.736558+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:31:55.736558+0000","last_undegraded":"2023-06-02T15:31:55.736558+0000","last_fullsized":"2023-06-02T15:31:55.736558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:55.736507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:55.736507+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.736507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.844402+0000","scrub_duration":0.004192884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.289588+0000","last_change":"2023-06-02T15:31:52.289872+0000","last_active":"2023-06-02T15:31:52.289588+0000","last_peered":"2023-06-02T15:31:52.289588+0000","last_clean":"2023-06-02T15:31:52.289588+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:31:52.289588+0000","last_undegraded":"2023-06-02T15:31:52.289588+0000","last_fullsized":"2023-06-02T15:31:52.289588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.289531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.289531+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.289531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:03.448828+0000","scrub_duration":0.0032206029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:24.859634+0000","last_change":"2023-06-02T15:32:24.859872+0000","last_active":"2023-06-02T15:32:24.859634+0000","last_peered":"2023-06-02T15:32:24.859634+0000","last_clean":"2023-06-02T15:32:24.859634+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:32:24.859634+0000","last_undegraded":"2023-06-02T15:32:24.859634+0000","last_fullsized":"2023-06-02T15:32:24.859634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:24.859585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:24.859585+0000","last_clean_scrub_stamp":"2023-06-02T15:32:24.859585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:02:54.980417+0000","scrub_duration":0.003862814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.531125+0000","last_change":"2023-06-02T15:31:45.531411+0000","last_active":"2023-06-02T15:31:45.531125+0000","last_peered":"2023-06-02T15:31:45.531125+0000","last_clean":"2023-06-02T15:31:45.531125+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:31:45.531125+0000","last_undegraded":"2023-06-02T15:31:45.531125+0000","last_fullsized":"2023-06-02T15:31:45.531125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.531079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.531079+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.531079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:29:55.235818+0000","scrub_duration":0.0038552180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:21.924160+0000","last_change":"2023-06-02T15:32:21.924439+0000","last_active":"2023-06-02T15:32:21.924160+0000","last_peered":"2023-06-02T15:32:21.924160+0000","last_clean":"2023-06-02T15:32:21.924160+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:32:21.924160+0000","last_undegraded":"2023-06-02T15:32:21.924160+0000","last_fullsized":"2023-06-02T15:32:21.924160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:21.924109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:21.924109+0000","last_clean_scrub_stamp":"2023-06-02T15:32:21.924109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:25.273132+0000","scrub_duration":0.0041237380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.555538+0000","last_change":"2023-06-02T15:31:52.555827+0000","last_active":"2023-06-02T15:31:52.555538+0000","last_peered":"2023-06-02T15:31:52.555538+0000","last_clean":"2023-06-02T15:31:52.555538+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:31:52.555538+0000","last_undegraded":"2023-06-02T15:31:52.555538+0000","last_fullsized":"2023-06-02T15:31:52.555538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.555485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.555485+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.555485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:30:02.260224+0000","scrub_duration":0.0031645419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:58.638273+0000","last_change":"2023-06-02T15:31:58.638743+0000","last_active":"2023-06-02T15:31:58.638273+0000","last_peered":"2023-06-02T15:31:58.638273+0000","last_clean":"2023-06-02T15:31:58.638273+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:31:58.638273+0000","last_undegraded":"2023-06-02T15:31:58.638273+0000","last_fullsized":"2023-06-02T15:31:58.638273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:58.638110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:58.638110+0000","last_clean_scrub_stamp":"2023-06-02T15:31:58.638110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:51.247160+0000","scrub_duration":0.0035255070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.102141+0000","last_change":"2023-06-02T15:31:48.102141+0000","last_active":"2023-06-02T15:31:48.102141+0000","last_peered":"2023-06-02T15:31:48.102141+0000","last_clean":"2023-06-02T15:31:48.102141+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:31:48.102141+0000","last_undegraded":"2023-06-02T15:31:48.102141+0000","last_fullsized":"2023-06-02T15:31:48.102141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.101830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.101830+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.101830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:28.854133+0000","scrub_duration":0.0082640209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.094980+0000","last_change":"2023-06-02T15:32:14.095296+0000","last_active":"2023-06-02T15:32:14.094980+0000","last_peered":"2023-06-02T15:32:14.094980+0000","last_clean":"2023-06-02T15:32:14.094980+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:32:14.094980+0000","last_undegraded":"2023-06-02T15:32:14.094980+0000","last_fullsized":"2023-06-02T15:32:14.094980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.094929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.094929+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.094929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:33.411749+0000","scrub_duration":0.0041825120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.841653+0000","last_change":"2023-06-02T15:32:02.841867+0000","last_active":"2023-06-02T15:32:02.841653+0000","last_peered":"2023-06-02T15:32:02.841653+0000","last_clean":"2023-06-02T15:32:02.841653+0000","last_became_active":"2023-06-02T15:31:26.758308+0000","last_became_peered":"2023-06-02T15:31:26.758308+0000","last_unstale":"2023-06-02T15:32:02.841653+0000","last_undegraded":"2023-06-02T15:32:02.841653+0000","last_fullsized":"2023-06-02T15:32:02.841653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.841598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.841598+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.841598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.491288+0000","scrub_duration":0.0031874889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.727125+0000","last_change":"2023-06-02T15:31:52.727371+0000","last_active":"2023-06-02T15:31:52.727125+0000","last_peered":"2023-06-02T15:31:52.727125+0000","last_clean":"2023-06-02T15:31:52.727125+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:31:52.727125+0000","last_undegraded":"2023-06-02T15:31:52.727125+0000","last_fullsized":"2023-06-02T15:31:52.727125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.727078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.727078+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.727078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:38.560342+0000","scrub_duration":0.003683974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.589177+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:31:26.589177+0000","last_peered":"2023-06-02T15:31:26.589177+0000","last_clean":"2023-06-02T15:31:26.589177+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:31:26.589177+0000","last_undegraded":"2023-06-02T15:31:26.589177+0000","last_fullsized":"2023-06-02T15:31:26.589177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:26.803806+0000","last_change":"2023-06-02T15:32:26.804050+0000","last_active":"2023-06-02T15:32:26.803806+0000","last_peered":"2023-06-02T15:32:26.803806+0000","last_clean":"2023-06-02T15:32:26.803806+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:32:26.803806+0000","last_undegraded":"2023-06-02T15:32:26.803806+0000","last_fullsized":"2023-06-02T15:32:26.803806+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:26.803750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:26.803750+0000","last_clean_scrub_stamp":"2023-06-02T15:32:26.803750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:16:25.542468+0000","scrub_duration":0.0037377830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:06.778227+0000","last_change":"2023-06-02T15:32:06.778522+0000","last_active":"2023-06-02T15:32:06.778227+0000","last_peered":"2023-06-02T15:32:06.778227+0000","last_clean":"2023-06-02T15:32:06.778227+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:32:06.778227+0000","last_undegraded":"2023-06-02T15:32:06.778227+0000","last_fullsized":"2023-06-02T15:32:06.778227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:06.778176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:06.778176+0000","last_clean_scrub_stamp":"2023-06-02T15:32:06.778176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:26.094996+0000","scrub_duration":0.0036399050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:33.344105+0000","last_change":"2023-06-02T15:32:33.344441+0000","last_active":"2023-06-02T15:32:33.344105+0000","last_peered":"2023-06-02T15:32:33.344105+0000","last_clean":"2023-06-02T15:32:33.344105+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:32:33.344105+0000","last_undegraded":"2023-06-02T15:32:33.344105+0000","last_fullsized":"2023-06-02T15:32:33.344105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:33.344053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:33.344053+0000","last_clean_scrub_stamp":"2023-06-02T15:32:33.344053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:16:32.082771+0000","scrub_duration":0.0043976019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:30.769466+0000","last_change":"2023-06-02T15:32:30.769731+0000","last_active":"2023-06-02T15:32:30.769466+0000","last_peered":"2023-06-02T15:32:30.769466+0000","last_clean":"2023-06-02T15:32:30.769466+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:32:30.769466+0000","last_undegraded":"2023-06-02T15:32:30.769466+0000","last_fullsized":"2023-06-02T15:32:30.769466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:30.769418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:30.769418+0000","last_clean_scrub_stamp":"2023-06-02T15:32:30.769418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:19:14.692332+0000","scrub_duration":0.0035215419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.525360+0000","last_change":"2023-06-02T15:31:45.525640+0000","last_active":"2023-06-02T15:31:45.525360+0000","last_peered":"2023-06-02T15:31:45.525360+0000","last_clean":"2023-06-02T15:31:45.525360+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:31:45.525360+0000","last_undegraded":"2023-06-02T15:31:45.525360+0000","last_fullsized":"2023-06-02T15:31:45.525360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.525308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.525308+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.525308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:22.228881+0000","scrub_duration":0.0032755190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:18.291781+0000","last_change":"2023-06-02T15:32:18.292124+0000","last_active":"2023-06-02T15:32:18.291781+0000","last_peered":"2023-06-02T15:32:18.291781+0000","last_clean":"2023-06-02T15:32:18.291781+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:32:18.291781+0000","last_undegraded":"2023-06-02T15:32:18.291781+0000","last_fullsized":"2023-06-02T15:32:18.291781+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:18.291730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:18.291730+0000","last_clean_scrub_stamp":"2023-06-02T15:32:18.291730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:37.608551+0000","scrub_duration":0.0039707090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:27.822504+0000","last_change":"2023-06-02T15:32:27.822771+0000","last_active":"2023-06-02T15:32:27.822504+0000","last_peered":"2023-06-02T15:32:27.822504+0000","last_clean":"2023-06-02T15:32:27.822504+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:32:27.822504+0000","last_undegraded":"2023-06-02T15:32:27.822504+0000","last_fullsized":"2023-06-02T15:32:27.822504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:27.822452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:27.822452+0000","last_clean_scrub_stamp":"2023-06-02T15:32:27.822452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:01:53.214163+0000","scrub_duration":0.003855701,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.681927+0000","last_change":"2023-06-02T15:31:57.682215+0000","last_active":"2023-06-02T15:31:57.681927+0000","last_peered":"2023-06-02T15:31:57.681927+0000","last_clean":"2023-06-02T15:31:57.681927+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:31:57.681927+0000","last_undegraded":"2023-06-02T15:31:57.681927+0000","last_fullsized":"2023-06-02T15:31:57.681927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:57.681867+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:57.681867+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.681867+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:09.331557+0000","scrub_duration":0.0066385239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:54.709129+0000","last_change":"2023-06-02T15:31:54.709526+0000","last_active":"2023-06-02T15:31:54.709129+0000","last_peered":"2023-06-02T15:31:54.709129+0000","last_clean":"2023-06-02T15:31:54.709129+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:31:54.709129+0000","last_undegraded":"2023-06-02T15:31:54.709129+0000","last_fullsized":"2023-06-02T15:31:54.709129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:54.709024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:54.709024+0000","last_clean_scrub_stamp":"2023-06-02T15:31:54.709024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:34.309032+0000","scrub_duration":0.0044425330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:10.905530+0000","last_change":"2023-06-02T15:32:10.905766+0000","last_active":"2023-06-02T15:32:10.905530+0000","last_peered":"2023-06-02T15:32:10.905530+0000","last_clean":"2023-06-02T15:32:10.905530+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:32:10.905530+0000","last_undegraded":"2023-06-02T15:32:10.905530+0000","last_fullsized":"2023-06-02T15:32:10.905530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:10.905480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:10.905480+0000","last_clean_scrub_stamp":"2023-06-02T15:32:10.905480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:19.827428+0000","scrub_duration":0.0033200590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:01.605460+0000","last_change":"2023-06-02T15:32:01.605705+0000","last_active":"2023-06-02T15:32:01.605460+0000","last_peered":"2023-06-02T15:32:01.605460+0000","last_clean":"2023-06-02T15:32:01.605460+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:32:01.605460+0000","last_undegraded":"2023-06-02T15:32:01.605460+0000","last_fullsized":"2023-06-02T15:32:01.605460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:01.605406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:01.605406+0000","last_clean_scrub_stamp":"2023-06-02T15:32:01.605406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:32.053608+0000","scrub_duration":0.0036437890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.682068+0000","last_change":"2023-06-02T15:31:53.682346+0000","last_active":"2023-06-02T15:31:53.682068+0000","last_peered":"2023-06-02T15:31:53.682068+0000","last_clean":"2023-06-02T15:31:53.682068+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:31:53.682068+0000","last_undegraded":"2023-06-02T15:31:53.682068+0000","last_fullsized":"2023-06-02T15:31:53.682068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:53.682012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:53.682012+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.682012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.841309+0000","scrub_duration":0.003995602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.514711+0000","last_change":"2023-06-02T15:31:56.514954+0000","last_active":"2023-06-02T15:31:56.514711+0000","last_peered":"2023-06-02T15:31:56.514711+0000","last_clean":"2023-06-02T15:31:56.514711+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:31:56.514711+0000","last_undegraded":"2023-06-02T15:31:56.514711+0000","last_fullsized":"2023-06-02T15:31:56.514711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:56.514662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:56.514662+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.514662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:51.622557+0000","scrub_duration":0.0037504259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.132683+0000","last_change":"2023-06-02T15:31:57.132917+0000","last_active":"2023-06-02T15:31:57.132683+0000","last_peered":"2023-06-02T15:31:57.132683+0000","last_clean":"2023-06-02T15:31:57.132683+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:31:57.132683+0000","last_undegraded":"2023-06-02T15:31:57.132683+0000","last_fullsized":"2023-06-02T15:31:57.132683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:31:57.132631+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:31:57.132631+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.132631+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:42.965894+0000","scrub_duration":0.0071564879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.807786+0000","last_change":"2023-06-02T15:31:57.808081+0000","last_active":"2023-06-02T15:31:57.807786+0000","last_peered":"2023-06-02T15:31:57.807786+0000","last_clean":"2023-06-02T15:31:57.807786+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:31:57.807786+0000","last_undegraded":"2023-06-02T15:31:57.807786+0000","last_fullsized":"2023-06-02T15:31:57.807786+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:57.807733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:57.807733+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.807733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:43.640997+0000","scrub_duration":0.0037340979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.793654+0000","last_change":"2023-06-02T15:31:51.794000+0000","last_active":"2023-06-02T15:31:51.793654+0000","last_peered":"2023-06-02T15:31:51.793654+0000","last_clean":"2023-06-02T15:31:51.793654+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:31:51.793654+0000","last_undegraded":"2023-06-02T15:31:51.793654+0000","last_fullsized":"2023-06-02T15:31:51.793654+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.793607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.793607+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.793607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:03.443296+0000","scrub_duration":0.0037644940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.022267+0000","last_change":"2023-06-02T15:32:02.022508+0000","last_active":"2023-06-02T15:32:02.022267+0000","last_peered":"2023-06-02T15:32:02.022267+0000","last_clean":"2023-06-02T15:32:02.022267+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:32:02.022267+0000","last_undegraded":"2023-06-02T15:32:02.022267+0000","last_fullsized":"2023-06-02T15:32:02.022267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:32:02.022211+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:32:02.022211+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.022211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:13.671901+0000","scrub_duration":0.0065549570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.745277+0000","last_change":"2023-06-02T15:31:48.745565+0000","last_active":"2023-06-02T15:31:48.745277+0000","last_peered":"2023-06-02T15:31:48.745277+0000","last_clean":"2023-06-02T15:31:48.745277+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:31:48.745277+0000","last_undegraded":"2023-06-02T15:31:48.745277+0000","last_fullsized":"2023-06-02T15:31:48.745277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.745224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.745224+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.745224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:29.497528+0000","scrub_duration":0.0041717810000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.580577+0000","last_change":"2023-06-02T15:32:05.580802+0000","last_active":"2023-06-02T15:32:05.580577+0000","last_peered":"2023-06-02T15:32:05.580577+0000","last_clean":"2023-06-02T15:32:05.580577+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:32:05.580577+0000","last_undegraded":"2023-06-02T15:32:05.580577+0000","last_fullsized":"2023-06-02T15:32:05.580577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.580528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.580528+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.580528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:30.258580+0000","scrub_duration":0.0033003379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.048276+0000","last_change":"2023-06-02T15:32:03.048495+0000","last_active":"2023-06-02T15:32:03.048276+0000","last_peered":"2023-06-02T15:32:03.048276+0000","last_clean":"2023-06-02T15:32:03.048276+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:32:03.048276+0000","last_undegraded":"2023-06-02T15:32:03.048276+0000","last_fullsized":"2023-06-02T15:32:03.048276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:32:03.048224+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:32:03.048224+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.048224+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:55.657274+0000","scrub_duration":0.0067757360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.095863+0000","last_change":"2023-06-02T15:32:16.096164+0000","last_active":"2023-06-02T15:32:16.095863+0000","last_peered":"2023-06-02T15:32:16.095863+0000","last_clean":"2023-06-02T15:32:16.095863+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:32:16.095863+0000","last_undegraded":"2023-06-02T15:32:16.095863+0000","last_fullsized":"2023-06-02T15:32:16.095863+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.095808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.095808+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.095808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:55.854075+0000","scrub_duration":0.0041363069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:19.324633+0000","last_change":"2023-06-02T15:32:19.325002+0000","last_active":"2023-06-02T15:32:19.324633+0000","last_peered":"2023-06-02T15:32:19.324633+0000","last_clean":"2023-06-02T15:32:19.324633+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:32:19.324633+0000","last_undegraded":"2023-06-02T15:32:19.324633+0000","last_fullsized":"2023-06-02T15:32:19.324633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:19.324579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:19.324579+0000","last_clean_scrub_stamp":"2023-06-02T15:32:19.324579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:22.673602+0000","scrub_duration":0.0040750339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'12","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.534180+0000","last_change":"2023-06-02T15:31:44.534507+0000","last_active":"2023-06-02T15:31:44.534180+0000","last_peered":"2023-06-02T15:31:44.534180+0000","last_clean":"2023-06-02T15:31:44.534180+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:31:44.534180+0000","last_undegraded":"2023-06-02T15:31:44.534180+0000","last_fullsized":"2023-06-02T15:31:44.534180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2023-06-02T15:31:44.534127+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2023-06-02T15:31:44.534127+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.534127+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:13.513282+0000","scrub_duration":0.010992052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.800436+0000","last_change":"2023-06-02T15:32:05.800709+0000","last_active":"2023-06-02T15:32:05.800436+0000","last_peered":"2023-06-02T15:32:05.800436+0000","last_clean":"2023-06-02T15:32:05.800436+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:32:05.800436+0000","last_undegraded":"2023-06-02T15:32:05.800436+0000","last_fullsized":"2023-06-02T15:32:05.800436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.800386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.800386+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.800386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:14.722334+0000","scrub_duration":0.0038761970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:30.682969+0000","last_change":"2023-06-02T15:32:30.683297+0000","last_active":"2023-06-02T15:32:30.682969+0000","last_peered":"2023-06-02T15:32:30.682969+0000","last_clean":"2023-06-02T15:32:30.682969+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:32:30.682969+0000","last_undegraded":"2023-06-02T15:32:30.682969+0000","last_fullsized":"2023-06-02T15:32:30.682969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:30.682913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:30.682913+0000","last_clean_scrub_stamp":"2023-06-02T15:32:30.682913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:16:29.421631+0000","scrub_duration":0.0040783460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:54.070573+0000","last_change":"2023-06-02T15:31:54.070812+0000","last_active":"2023-06-02T15:31:54.070573+0000","last_peered":"2023-06-02T15:31:54.070573+0000","last_clean":"2023-06-02T15:31:54.070573+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:31:54.070573+0000","last_undegraded":"2023-06-02T15:31:54.070573+0000","last_fullsized":"2023-06-02T15:31:54.070573+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:54.070524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:54.070524+0000","last_clean_scrub_stamp":"2023-06-02T15:31:54.070524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:33.670532+0000","scrub_duration":0.003366693,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.886215+0000","last_change":"2023-06-02T15:32:09.886495+0000","last_active":"2023-06-02T15:32:09.886215+0000","last_peered":"2023-06-02T15:32:09.886215+0000","last_clean":"2023-06-02T15:32:09.886215+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:32:09.886215+0000","last_undegraded":"2023-06-02T15:32:09.886215+0000","last_fullsized":"2023-06-02T15:32:09.886215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.886166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.886166+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.886166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:14.273734+0000","scrub_duration":0.003413995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.800790+0000","last_change":"2023-06-02T15:31:43.801035+0000","last_active":"2023-06-02T15:31:43.800790+0000","last_peered":"2023-06-02T15:31:43.800790+0000","last_clean":"2023-06-02T15:31:43.800790+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:31:43.800790+0000","last_undegraded":"2023-06-02T15:31:43.800790+0000","last_fullsized":"2023-06-02T15:31:43.800790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.800740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.800740+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.800740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:20.504313+0000","scrub_duration":0.0039374529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.427238+0000","last_change":"2023-06-02T15:32:09.427459+0000","last_active":"2023-06-02T15:32:09.427238+0000","last_peered":"2023-06-02T15:32:09.427238+0000","last_clean":"2023-06-02T15:32:09.427238+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:32:09.427238+0000","last_undegraded":"2023-06-02T15:32:09.427238+0000","last_fullsized":"2023-06-02T15:32:09.427238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.427191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.427191+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.427191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:04.182383+0000","scrub_duration":0.0032371549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:31.728897+0000","last_change":"2023-06-02T15:32:31.729209+0000","last_active":"2023-06-02T15:32:31.728897+0000","last_peered":"2023-06-02T15:32:31.728897+0000","last_clean":"2023-06-02T15:32:31.728897+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:32:31.728897+0000","last_undegraded":"2023-06-02T15:32:31.728897+0000","last_fullsized":"2023-06-02T15:32:31.728897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:31.728844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:31.728844+0000","last_clean_scrub_stamp":"2023-06-02T15:32:31.728844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:01:57.120555+0000","scrub_duration":0.0039777570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'4","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.110801+0000","last_change":"2023-06-02T15:31:55.111052+0000","last_active":"2023-06-02T15:31:55.110801+0000","last_peered":"2023-06-02T15:31:55.110801+0000","last_clean":"2023-06-02T15:31:55.110801+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:31:55.110801+0000","last_undegraded":"2023-06-02T15:31:55.110801+0000","last_fullsized":"2023-06-02T15:31:55.110801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2023-06-02T15:31:55.110743+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2023-06-02T15:31:55.110743+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.110743+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.218637+0000","scrub_duration":0.0089042889999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:27.266998+0000","last_change":"2023-06-02T15:31:26.924308+0000","last_active":"2023-06-02T15:31:27.266998+0000","last_peered":"2023-06-02T15:31:27.266998+0000","last_clean":"2023-06-02T15:31:27.266998+0000","last_became_active":"2023-06-02T15:31:26.923733+0000","last_became_peered":"2023-06-02T15:31:26.923733+0000","last_unstale":"2023-06-02T15:31:27.266998+0000","last_undegraded":"2023-06-02T15:31:27.266998+0000","last_fullsized":"2023-06-02T15:31:27.266998+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:12.439543+0000","last_change":"2023-06-02T15:32:12.439830+0000","last_active":"2023-06-02T15:32:12.439543+0000","last_peered":"2023-06-02T15:32:12.439543+0000","last_clean":"2023-06-02T15:32:12.439543+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:32:12.439543+0000","last_undegraded":"2023-06-02T15:32:12.439543+0000","last_fullsized":"2023-06-02T15:32:12.439543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:12.439487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:12.439487+0000","last_clean_scrub_stamp":"2023-06-02T15:32:12.439487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:31.756307+0000","scrub_duration":0.0043436109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.568549+0000","last_change":"2023-06-02T15:32:00.568821+0000","last_active":"2023-06-02T15:32:00.568549+0000","last_peered":"2023-06-02T15:32:00.568549+0000","last_clean":"2023-06-02T15:32:00.568549+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:32:00.568549+0000","last_undegraded":"2023-06-02T15:32:00.568549+0000","last_fullsized":"2023-06-02T15:32:00.568549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:00.568499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:00.568499+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.568499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:20.571924+0000","scrub_duration":0.003625372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.739861+0000","last_change":"2023-06-02T15:32:09.740104+0000","last_active":"2023-06-02T15:32:09.739861+0000","last_peered":"2023-06-02T15:32:09.739861+0000","last_clean":"2023-06-02T15:32:09.739861+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:32:09.739861+0000","last_undegraded":"2023-06-02T15:32:09.739861+0000","last_fullsized":"2023-06-02T15:32:09.739861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.739809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.739809+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.739809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:29.056629+0000","scrub_duration":0.0034772800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.809260+0000","last_change":"2023-06-02T15:31:48.809508+0000","last_active":"2023-06-02T15:31:48.809260+0000","last_peered":"2023-06-02T15:31:48.809260+0000","last_clean":"2023-06-02T15:31:48.809260+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:31:48.809260+0000","last_undegraded":"2023-06-02T15:31:48.809260+0000","last_fullsized":"2023-06-02T15:31:48.809260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.809212+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:08.812638+0000","scrub_duration":0.003422675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.712883+0000","last_change":"2023-06-02T15:31:48.713166+0000","last_active":"2023-06-02T15:31:48.712883+0000","last_peered":"2023-06-02T15:31:48.712883+0000","last_clean":"2023-06-02T15:31:48.712883+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:31:48.712883+0000","last_undegraded":"2023-06-02T15:31:48.712883+0000","last_fullsized":"2023-06-02T15:31:48.712883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.712833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.712833+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.712833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:59.872130+0000","scrub_duration":0.0041090880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.357705+0000","last_change":"2023-06-02T15:32:11.357932+0000","last_active":"2023-06-02T15:32:11.357705+0000","last_peered":"2023-06-02T15:32:11.357705+0000","last_clean":"2023-06-02T15:32:11.357705+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:32:11.357705+0000","last_undegraded":"2023-06-02T15:32:11.357705+0000","last_fullsized":"2023-06-02T15:32:11.357705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.357659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.357659+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.357659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:36.035711+0000","scrub_duration":0.003466874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.463187+0000","last_change":"2023-06-02T15:32:11.463479+0000","last_active":"2023-06-02T15:32:11.463187+0000","last_peered":"2023-06-02T15:32:11.463187+0000","last_clean":"2023-06-02T15:32:11.463187+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:32:11.463187+0000","last_undegraded":"2023-06-02T15:32:11.463187+0000","last_fullsized":"2023-06-02T15:32:11.463187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.463140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.463140+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.463140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:19.130250+0000","scrub_duration":0.0031256579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.404861+0000","last_change":"2023-06-02T15:32:02.405088+0000","last_active":"2023-06-02T15:32:02.404861+0000","last_peered":"2023-06-02T15:32:02.404861+0000","last_clean":"2023-06-02T15:32:02.404861+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:32:02.404861+0000","last_undegraded":"2023-06-02T15:32:02.404861+0000","last_fullsized":"2023-06-02T15:32:02.404861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.404814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.404814+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.404814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.054503+0000","scrub_duration":0.003729914,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:59.370456+0000","last_change":"2023-06-02T15:31:59.370686+0000","last_active":"2023-06-02T15:31:59.370456+0000","last_peered":"2023-06-02T15:31:59.370456+0000","last_clean":"2023-06-02T15:31:59.370456+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:31:59.370456+0000","last_undegraded":"2023-06-02T15:31:59.370456+0000","last_fullsized":"2023-06-02T15:31:59.370456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:59.370409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:59.370409+0000","last_clean_scrub_stamp":"2023-06-02T15:31:59.370409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:19.373834+0000","scrub_duration":0.0039692160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.051406+0000","last_change":"2023-06-02T15:32:05.051651+0000","last_active":"2023-06-02T15:32:05.051406+0000","last_peered":"2023-06-02T15:32:05.051406+0000","last_clean":"2023-06-02T15:32:05.051406+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:32:05.051406+0000","last_undegraded":"2023-06-02T15:32:05.051406+0000","last_fullsized":"2023-06-02T15:32:05.051406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.051353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.051353+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.051353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:35.499555+0000","scrub_duration":0.0040453920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.672474+0000","last_change":"2023-06-02T15:32:11.672704+0000","last_active":"2023-06-02T15:32:11.672474+0000","last_peered":"2023-06-02T15:32:11.672474+0000","last_clean":"2023-06-02T15:32:11.672474+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:32:11.672474+0000","last_undegraded":"2023-06-02T15:32:11.672474+0000","last_fullsized":"2023-06-02T15:32:11.672474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.672427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.672427+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.672427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:51.430694+0000","scrub_duration":0.0035935189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:04.015620+0000","last_change":"2023-06-02T15:32:04.015903+0000","last_active":"2023-06-02T15:32:04.015620+0000","last_peered":"2023-06-02T15:32:04.015620+0000","last_clean":"2023-06-02T15:32:04.015620+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:32:04.015620+0000","last_undegraded":"2023-06-02T15:32:04.015620+0000","last_fullsized":"2023-06-02T15:32:04.015620+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:04.015570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:04.015570+0000","last_clean_scrub_stamp":"2023-06-02T15:32:04.015570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:56.624619+0000","scrub_duration":0.0033126750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.055931+0000","last_change":"2023-06-02T15:32:09.056254+0000","last_active":"2023-06-02T15:32:09.055931+0000","last_peered":"2023-06-02T15:32:09.055931+0000","last_clean":"2023-06-02T15:32:09.055931+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:32:09.055931+0000","last_undegraded":"2023-06-02T15:32:09.055931+0000","last_fullsized":"2023-06-02T15:32:09.055931+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.055882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.055882+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.055882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:13.443451+0000","scrub_duration":0.0037959309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.888219+0000","last_change":"2023-06-02T15:31:56.888442+0000","last_active":"2023-06-02T15:31:56.888219+0000","last_peered":"2023-06-02T15:31:56.888219+0000","last_clean":"2023-06-02T15:31:56.888219+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:31:56.888219+0000","last_undegraded":"2023-06-02T15:31:56.888219+0000","last_fullsized":"2023-06-02T15:31:56.888219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:56.888166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:56.888166+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.888166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:27.336368+0000","scrub_duration":0.0032250339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.801078+0000","last_change":"2023-06-02T15:31:37.801217+0000","last_active":"2023-06-02T15:31:37.801078+0000","last_peered":"2023-06-02T15:31:37.801078+0000","last_clean":"2023-06-02T15:31:37.801078+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:31:37.801078+0000","last_undegraded":"2023-06-02T15:31:37.801078+0000","last_fullsized":"2023-06-02T15:31:37.801078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.801043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.801043+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.801043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:46:43.999450+0000","scrub_duration":0.0034263620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588363+0000","last_change":"2023-06-02T15:30:38.637119+0000","last_active":"2023-06-02T15:31:26.588363+0000","last_peered":"2023-06-02T15:31:26.588363+0000","last_clean":"2023-06-02T15:31:26.588363+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:31:26.588363+0000","last_undegraded":"2023-06-02T15:31:26.588363+0000","last_fullsized":"2023-06-02T15:31:26.588363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.005598+0000","last_change":"2023-06-02T15:32:03.005845+0000","last_active":"2023-06-02T15:32:03.005598+0000","last_peered":"2023-06-02T15:32:03.005598+0000","last_clean":"2023-06-02T15:32:03.005598+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:32:03.005598+0000","last_undegraded":"2023-06-02T15:32:03.005598+0000","last_fullsized":"2023-06-02T15:32:03.005598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.005544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.005544+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.005544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.655234+0000","scrub_duration":0.0031069069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.859940+0000","last_change":"2023-06-02T15:32:02.860193+0000","last_active":"2023-06-02T15:32:02.859940+0000","last_peered":"2023-06-02T15:32:02.859940+0000","last_clean":"2023-06-02T15:32:02.859940+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:32:02.859940+0000","last_undegraded":"2023-06-02T15:32:02.859940+0000","last_fullsized":"2023-06-02T15:32:02.859940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.859891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.859891+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.859891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:11.781839+0000","scrub_duration":0.0039529639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:10.100774+0000","last_change":"2023-06-02T15:32:10.101069+0000","last_active":"2023-06-02T15:32:10.100774+0000","last_peered":"2023-06-02T15:32:10.100774+0000","last_clean":"2023-06-02T15:32:10.100774+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:32:10.100774+0000","last_undegraded":"2023-06-02T15:32:10.100774+0000","last_fullsized":"2023-06-02T15:32:10.100774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:10.100721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:10.100721+0000","last_clean_scrub_stamp":"2023-06-02T15:32:10.100721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:19.022669+0000","scrub_duration":0.003560887,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.498288+0000","last_change":"2023-06-02T15:31:41.498607+0000","last_active":"2023-06-02T15:31:41.498288+0000","last_peered":"2023-06-02T15:31:41.498288+0000","last_clean":"2023-06-02T15:31:41.498288+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:31:41.498288+0000","last_undegraded":"2023-06-02T15:31:41.498288+0000","last_fullsized":"2023-06-02T15:31:41.498288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.498234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.498234+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.498234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:22.250537+0000","scrub_duration":0.0032772719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.761820+0000","last_change":"2023-06-02T15:31:41.762119+0000","last_active":"2023-06-02T15:31:41.761820+0000","last_peered":"2023-06-02T15:31:41.761820+0000","last_clean":"2023-06-02T15:31:41.761820+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:31:41.761820+0000","last_undegraded":"2023-06-02T15:31:41.761820+0000","last_fullsized":"2023-06-02T15:31:41.761820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.761771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.761771+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.761771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:10.202482+0000","scrub_duration":0.0033186510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.714050+0000","last_change":"2023-06-02T15:31:45.714297+0000","last_active":"2023-06-02T15:31:45.714050+0000","last_peered":"2023-06-02T15:31:45.714050+0000","last_clean":"2023-06-02T15:31:45.714050+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:31:45.714050+0000","last_undegraded":"2023-06-02T15:31:45.714050+0000","last_fullsized":"2023-06-02T15:31:45.714050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.713996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.713996+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.713996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:22.417569+0000","scrub_duration":0.003800037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2023-06-02T15:31:36.955512+0000","last_change":"2023-06-02T15:32:31.725661+0000","last_active":"2023-06-02T15:31:36.955512+0000","last_peered":"2023-06-02T15:31:36.955512+0000","last_clean":"2023-06-02T15:31:36.955512+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:31:36.955512+0000","last_undegraded":"2023-06-02T15:31:36.955512+0000","last_fullsized":"2023-06-02T15:31:36.955512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.497864+0000","last_change":"2023-06-02T15:31:37.498112+0000","last_active":"2023-06-02T15:31:37.497864+0000","last_peered":"2023-06-02T15:31:37.497864+0000","last_clean":"2023-06-02T15:31:37.497864+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:31:37.497864+0000","last_undegraded":"2023-06-02T15:31:37.497864+0000","last_fullsized":"2023-06-02T15:31:37.497864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.497813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.497813+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.497813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:06.476968+0000","scrub_duration":0.0034432849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:38.779703+0000","last_change":"2023-06-02T15:31:38.779930+0000","last_active":"2023-06-02T15:31:38.779703+0000","last_peered":"2023-06-02T15:31:38.779703+0000","last_clean":"2023-06-02T15:31:38.779703+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:31:38.779703+0000","last_undegraded":"2023-06-02T15:31:38.779703+0000","last_fullsized":"2023-06-02T15:31:38.779703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:38.779654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:38.779654+0000","last_clean_scrub_stamp":"2023-06-02T15:31:38.779654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:07.220365+0000","scrub_duration":0.0031197170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:07.505180+0000","last_change":"2023-06-02T15:32:07.505469+0000","last_active":"2023-06-02T15:32:07.505180+0000","last_peered":"2023-06-02T15:32:07.505180+0000","last_clean":"2023-06-02T15:32:07.505180+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:32:07.505180+0000","last_undegraded":"2023-06-02T15:32:07.505180+0000","last_fullsized":"2023-06-02T15:32:07.505180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:07.505132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:07.505132+0000","last_clean_scrub_stamp":"2023-06-02T15:32:07.505132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:27:05.339584+0000","scrub_duration":0.0034090029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.084596+0000","last_change":"2023-06-02T15:32:11.084825+0000","last_active":"2023-06-02T15:32:11.084596+0000","last_peered":"2023-06-02T15:32:11.084596+0000","last_clean":"2023-06-02T15:32:11.084596+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:32:11.084596+0000","last_undegraded":"2023-06-02T15:32:11.084596+0000","last_fullsized":"2023-06-02T15:32:11.084596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.084549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.084549+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.084549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:05.839740+0000","scrub_duration":0.0037808770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.585297+0000","last_change":"2023-06-02T15:30:38.640191+0000","last_active":"2023-06-02T15:31:26.585297+0000","last_peered":"2023-06-02T15:31:26.585297+0000","last_clean":"2023-06-02T15:31:26.585297+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:31:26.585297+0000","last_undegraded":"2023-06-02T15:31:26.585297+0000","last_fullsized":"2023-06-02T15:31:26.585297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.887243+0000","last_change":"2023-06-02T15:32:11.887491+0000","last_active":"2023-06-02T15:32:11.887243+0000","last_peered":"2023-06-02T15:32:11.887243+0000","last_clean":"2023-06-02T15:32:11.887243+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:32:11.887243+0000","last_undegraded":"2023-06-02T15:32:11.887243+0000","last_fullsized":"2023-06-02T15:32:11.887243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.887196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.887196+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.887196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:06.642387+0000","scrub_duration":0.003596793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.546272+0000","last_change":"2023-06-02T15:31:48.546529+0000","last_active":"2023-06-02T15:31:48.546272+0000","last_peered":"2023-06-02T15:31:48.546272+0000","last_clean":"2023-06-02T15:31:48.546272+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:31:48.546272+0000","last_undegraded":"2023-06-02T15:31:48.546272+0000","last_fullsized":"2023-06-02T15:31:48.546272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.546224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.546224+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.546224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:29.298528+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.588483+0000","last_change":"2023-06-02T15:30:38.641603+0000","last_active":"2023-06-02T15:31:26.588483+0000","last_peered":"2023-06-02T15:31:26.588483+0000","last_clean":"2023-06-02T15:31:26.588483+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:31:26.588483+0000","last_undegraded":"2023-06-02T15:31:26.588483+0000","last_fullsized":"2023-06-02T15:31:26.588483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:38.480377+0000","last_change":"2023-06-02T15:31:38.480659+0000","last_active":"2023-06-02T15:31:38.480377+0000","last_peered":"2023-06-02T15:31:38.480377+0000","last_clean":"2023-06-02T15:31:38.480377+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:31:38.480377+0000","last_undegraded":"2023-06-02T15:31:38.480377+0000","last_fullsized":"2023-06-02T15:31:38.480377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:38.480329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:38.480329+0000","last_clean_scrub_stamp":"2023-06-02T15:31:38.480329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:15.183901+0000","scrub_duration":0.0035440649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.744380+0000","last_change":"2023-06-02T15:31:44.744656+0000","last_active":"2023-06-02T15:31:44.744380+0000","last_peered":"2023-06-02T15:31:44.744380+0000","last_clean":"2023-06-02T15:31:44.744380+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:31:44.744380+0000","last_undegraded":"2023-06-02T15:31:44.744380+0000","last_fullsized":"2023-06-02T15:31:44.744380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:44.744325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:44.744325+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.744325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:13.723480+0000","scrub_duration":0.0037133079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5686,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":389120,"data_stored":719524,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83699999999999997,"15min":0.83799999999999997},"min":{"1min":0.55600000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.83999999999999997,"15min":0.83199999999999996},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.177,"5min":1.538,"15min":1.538},"last":1.087}]},{"osd":1,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.875,"15min":0.86699999999999999},"min":{"1min":0.62,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.252,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.117},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.94099999999999995,"15min":0.94399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.133,"5min":1.198,"15min":1.198},"last":1.008}]},{"osd":2,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.78000000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1679999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92900000000000005,"15min":0.93000000000000005},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.0289999999999999}]},{"osd":3,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.90500000000000003,"15min":0.90900000000000003},"min":{"1min":0.72699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0549999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.0009999999999999,"15min":1},"min":{"1min":0.85199999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.94299999999999995}]},{"osd":4,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.095,"5min":1.343,"15min":1.343},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94199999999999995,"15min":0.94799999999999995},"min":{"1min":0.67000000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.202,"5min":1.649,"15min":1.649},"last":0.71999999999999997}]},{"osd":5,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.069,"15min":1.085},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.419,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.052,"5min":1.135,"15min":1.149},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.266,"5min":1.97,"15min":1.97},"last":0.84799999999999998}]},{"osd":6,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0820000000000001,"15min":1.0980000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.2230000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.998,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.2889999999999999,"5min":1.722,"15min":1.722},"last":0.97199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.753},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.70199999999999996}]},{"osd":1,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.88400000000000001}]},{"osd":2,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.79900000000000004}]},{"osd":4,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.95599999999999996}]},{"osd":5,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.008}]},{"osd":7,"last update":"Fri Jun 2 15:31:35 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.119},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":1.0469999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":294912,"data_stored":123686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86599999999999999,"15min":0.86199999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.133,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.83099999999999996,"15min":0.82199999999999995},"min":{"1min":0.61899999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.0700000000000001}]},{"osd":1,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.66400000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1140000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.159,"15min":1.159},"last":0.83099999999999996}]},{"osd":2,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90500000000000003,"15min":0.90700000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1160000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91300000000000003},"min":{"1min":0.746,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.115,"5min":1.234,"15min":1.234},"last":0.998}]},{"osd":3,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.94599999999999995,"15min":0.94999999999999996},"min":{"1min":0.71199999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.014,"15min":1.01},"min":{"1min":0.82399999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.2,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.012,"15min":1.026},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.216,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.216},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.028,"15min":1.0429999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2370000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.94499999999999995}]},{"osd":6,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.046,"15min":1.0669999999999999},"min":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.1619999999999999,"5min":1.881,"15min":1.881},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.083,"15min":1.0980000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.175,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":1.0309999999999999}]},{"osd":7,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.056,"15min":1.073},"min":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.171,"5min":1.905,"15min":1.905},"last":1.171},{"interface":"front","average":{"1min":1.032,"5min":1.1299999999999999,"15min":1.1459999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.214,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.1539999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8764,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363076,"statfs":{"total":96636764160,"available":96627789824,"internally_reserved":0,"allocated":315392,"data_stored":128996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91600000000000004,"15min":0.91000000000000003},"min":{"1min":0.77100000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.204,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.109,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":1.0529999999999999}]},{"osd":1,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84799999999999998,"15min":0.85199999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.92000000000000004,"15min":0.91400000000000003},"min":{"1min":0.622,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.167,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":1.2}]},{"osd":2,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.61199999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1779999999999999,"5min":1.198,"15min":1.198},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88500000000000001,"15min":0.876},"min":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.0089999999999999}]},{"osd":3,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89300000000000002,"15min":0.89900000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0620000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98199999999999998,"15min":0.97999999999999998},"min":{"1min":0.82399999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.236,"5min":1.379,"15min":1.379},"last":1.131}]},{"osd":5,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.67800000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1930000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.58799999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1719999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.234}]},{"osd":6,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.64100000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2649999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0660000000000001,"15min":1.0720000000000001},"min":{"1min":0.73399999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.296,"5min":1.327,"15min":1.327},"last":1.2769999999999999}]},{"osd":7,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.999,"15min":1.0029999999999999},"min":{"1min":0.72699999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1200000000000001,"15min":1.1240000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1779999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":294912,"data_stored":124126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.59899999999999998}]},{"osd":1,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93500000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.75,"5min":0.64900000000000002,"15min":0.63200000000000001},"min":{"1min":0.29099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.89800000000000002}]},{"osd":2,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.438,"5min":0.25,"15min":0.25},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71899999999999997,"15min":0.70899999999999996},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.71599999999999997}]},{"osd":4,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.89100000000000001,"15min":0.879},"min":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.67500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3480000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.95299999999999996}]},{"osd":5,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.175,"5min":1.375,"15min":1.375},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.004,"15min":1.006},"min":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.387,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0189999999999999}]},{"osd":6,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.94899999999999995,"15min":0.93500000000000005},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.995,"5min":1.028,"15min":1.034},"min":{"1min":0.73599999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.91800000000000004}]},{"osd":7,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0569999999999999,"15min":1.0580000000000001},"min":{"1min":0.76700000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.298,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.071},{"interface":"front","average":{"1min":1.006,"5min":1.0409999999999999,"15min":1.0469999999999999},"min":{"1min":0.625,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3600000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.878}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.443,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.878,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67000000000000004,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.038,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.56699999999999995}]},{"osd":1,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.46300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94899999999999995,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.753}]},{"osd":3,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.163,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.66900000000000004,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.64100000000000001}]},{"osd":4,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92400000000000004,"15min":0.92500000000000004},"min":{"1min":0.66600000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1930000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.93400000000000005,"15min":0.93799999999999994},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.266,"15min":1.266},"last":0.93600000000000005}]},{"osd":5,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.95999999999999996,"15min":0.95299999999999996},"min":{"1min":0.71699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.331,"5min":1.337,"15min":1.337},"last":1.198},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.64400000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2470000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.1659999999999999}]},{"osd":6,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96899999999999997,"15min":0.96299999999999997},"min":{"1min":0.72999999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.034},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0169999999999999,"15min":1.0129999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.296,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":1.145}]},{"osd":7,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0669999999999999,"15min":1.0649999999999999},"min":{"1min":0.84999999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.347,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":1.079},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0289999999999999,"15min":1.0209999999999999},"min":{"1min":0.81100000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.373,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.129}]}]},{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":356352,"data_stored":714404,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57699999999999996,"15min":0.56299999999999994},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97399999999999998,"5min":1.028,"15min":1.028},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.39500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65800000000000003}]},{"osd":3,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.69699999999999995,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0600000000000001,"5min":1.079,"15min":1.079},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.65000000000000002,"15min":0.63400000000000001},"min":{"1min":0.35099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82699999999999996,"15min":0.82499999999999996},"min":{"1min":0.59199999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0609999999999999,"5min":1.266,"15min":1.266},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.018,"5min":0.91300000000000003,"15min":0.89500000000000002},"min":{"1min":0.78500000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.879}]},{"osd":5,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.877,"15min":0.85999999999999999},"min":{"1min":0.68200000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90900000000000003,"15min":0.89900000000000002},"min":{"1min":0.82099999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1739999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.82199999999999995}]},{"osd":6,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.94799999999999995,"15min":0.92800000000000005},"min":{"1min":0.63300000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.93200000000000005,"15min":0.91400000000000003},"min":{"1min":0.70699999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.85299999999999998}]},{"osd":7,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.96699999999999997,"15min":0.95599999999999996},"min":{"1min":0.73199999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.224,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.94999999999999996,"15min":0.94199999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.244,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.77900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8676,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363164,"statfs":{"total":96636764160,"available":96627879936,"internally_reserved":0,"allocated":290816,"data_stored":123616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.53100000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94999999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.042,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.72399999999999998}]},{"osd":2,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.60799999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68500000000000005,"15min":0.67800000000000005},"min":{"1min":0.49299999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.80700000000000005}]},{"osd":3,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.53300000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78200000000000003,"15min":0.77800000000000002},"min":{"1min":0.58899999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1479999999999999,"5min":1.216,"15min":1.216},"last":0.88400000000000001}]},{"osd":4,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93500000000000005,"15min":0.93899999999999995},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0589999999999999,"5min":1.702,"15min":1.702},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.73699999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.155,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.0189999999999999}]},{"osd":5,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.79000000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0740000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.03,"15min":1.036},"min":{"1min":0.70199999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3160000000000001,"5min":1.573,"15min":1.573},"last":1.054}]},{"osd":6,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0720000000000001,"15min":1.081},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.3919999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.135},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.038,"15min":1.046},"min":{"1min":0.85199999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.28,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.085}]},{"osd":7,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.091,"15min":1.101},"min":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.234,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.81200000000000006,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.2929999999999999,"5min":1.363,"15min":1.363},"last":1.1140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:32:39.806 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:39.806 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:39.807 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:39.808 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:39.808 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:39.809 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:39.809 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:39.810 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:39.810 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:32:39.810 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-02T15:32:44.777 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:32:44.780 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:32:44.782 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:32:44.785 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:32:59.811 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:32:59.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc4dcf5640 1 Processor -- start 2023-06-02T15:32:59.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc4dcf5640 1 -- start start 2023-06-02T15:32:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc4dcf5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc48149e00 0x7fdc480a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc4dcf5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc480ba880 0x7fdc480a23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:59.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc4dcf5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc480a2930 0x7fdc4814fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:59.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc4dcf5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4814a1d0 con 0x7fdc48149e00 2023-06-02T15:32:59.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc4dcf5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc480a61d0 con 0x7fdc480ba880 2023-06-02T15:32:59.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc4dcf5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc480a3600 con 0x7fdc480a2930 2023-06-02T15:32:59.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc477fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc48149e00 0x7fdc480a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:59.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc477fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fdc48149e00 0x7fdc480a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47248/0 (socket says 172.21.15.78:47248) 2023-06-02T15:32:59.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc477fe640 1 -- 172.21.15.78:0/3024571179 learned_addr learned my addr 172.21.15.78:0/3024571179 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:32:59.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc46ffd640 1 --2- 172.21.15.78:0/3024571179 >> v2:172.21.15.132:3300/0 conn(0x7fdc480ba880 0x7fdc480a23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:59.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc47fff640 1 --2- 172.21.15.78:0/3024571179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc480a2930 0x7fdc4814fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:59.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc477fe640 1 -- 172.21.15.78:0/3024571179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc480a2930 msgr2=0x7fdc4814fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:32:59.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc477fe640 1 --2- 172.21.15.78:0/3024571179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc480a2930 0x7fdc4814fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:59.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc477fe640 1 -- 172.21.15.78:0/3024571179 >> v2:172.21.15.132:3300/0 conn(0x7fdc480ba880 msgr2=0x7fdc480a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:32:59.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc477fe640 1 --2- 172.21.15.78:0/3024571179 >> v2:172.21.15.132:3300/0 conn(0x7fdc480ba880 0x7fdc480a23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:59.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.937+0000 7fdc477fe640 1 -- 172.21.15.78:0/3024571179 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480bb0e0 con 0x7fdc48149e00 2023-06-02T15:32:59.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc477fe640 1 --2- 172.21.15.78:0/3024571179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48149e00 0x7fdc480a5bd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdc480bcf20 tx=0x7fdc3c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38373ef70531555c server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:32:59.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc467fc640 1 -- 172.21.15.78:0/3024571179 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0ab600 con 0x7fdc48149e00 2023-06-02T15:32:59.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc467fc640 1 -- 172.21.15.78:0/3024571179 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c0a7050 con 0x7fdc48149e00 2023-06-02T15:32:59.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc467fc640 1 -- 172.21.15.78:0/3024571179 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0ab980 con 0x7fdc48149e00 2023-06-02T15:32:59.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/3024571179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48149e00 msgr2=0x7fdc480a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:59.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 --2- 172.21.15.78:0/3024571179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48149e00 0x7fdc480a5bd0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdc480bcf20 tx=0x7fdc3c01c500 comp rx=0 tx=0).stop 2023-06-02T15:32:59.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/3024571179 shutdown_connections 2023-06-02T15:32:59.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 --2- 172.21.15.78:0/3024571179 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc480a2930 0x7fdc4814fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:59.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 --2- 172.21.15.78:0/3024571179 >> v2:172.21.15.132:3300/0 conn(0x7fdc480ba880 0x7fdc480a23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:59.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 --2- 172.21.15.78:0/3024571179 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc48149e00 0x7fdc480a5bd0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:59.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/3024571179 >> 172.21.15.78:0/3024571179 conn(0x7fdc480bcf50 msgr2=0x7fdc480bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:32:59.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/3024571179 shutdown_connections 2023-06-02T15:32:59.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/3024571179 wait complete. 2023-06-02T15:32:59.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 Processor -- start 2023-06-02T15:32:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 -- start start 2023-06-02T15:32:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc480a2930 0x7fdc48155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc480ba880 0x7fdc4814d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc48149e00 0x7fdc481e6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:59.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc481552c0 con 0x7fdc480a2930 2023-06-02T15:32:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4814d550 con 0x7fdc48149e00 2023-06-02T15:32:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc4dcf5640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc48146930 con 0x7fdc480ba880 2023-06-02T15:32:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc480a2930 0x7fdc48155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc480a2930 0x7fdc48155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47252/0 (socket says 172.21.15.78:47252) 2023-06-02T15:32:59.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.941+0000 7fdc477fe640 1 -- 172.21.15.78:0/2025701040 learned_addr learned my addr 172.21.15.78:0/2025701040 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:32:59.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc46ffd640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc480ba880 0x7fdc4814d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:59.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc47fff640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc48149e00 0x7fdc481e6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:59.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc477fe640 1 -- 172.21.15.78:0/2025701040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc480ba880 msgr2=0x7fdc4814d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:59.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc477fe640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc480ba880 0x7fdc4814d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:59.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc477fe640 1 -- 172.21.15.78:0/2025701040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc48149e00 msgr2=0x7fdc481e6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:32:59.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc477fe640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc48149e00 0x7fdc481e6540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:32:59.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc477fe640 1 -- 172.21.15.78:0/2025701040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc3c0094d0 con 0x7fdc480a2930 2023-06-02T15:32:59.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc477fe640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc480a2930 0x7fdc48155750 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0ae040 tx=0x7fdc3c01ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:32:59.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc2ffff640 1 -- 172.21.15.78:0/2025701040 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0b6620 con 0x7fdc480a2930 2023-06-02T15:32:59.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc2ffff640 1 -- 172.21.15.78:0/2025701040 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c0b67a0 con 0x7fdc480a2930 2023-06-02T15:32:59.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/2025701040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc4806c0a0 con 0x7fdc480a2930 2023-06-02T15:32:59.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc2ffff640 1 -- 172.21.15.78:0/2025701040 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c0b6b50 con 0x7fdc480a2930 2023-06-02T15:32:59.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/2025701040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc480a3dd0 con 0x7fdc480a2930 2023-06-02T15:32:59.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/2025701040 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4806c230 con 0x7fdc480a2930 2023-06-02T15:32:59.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc2ffff640 1 -- 172.21.15.78:0/2025701040 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fdc3c0b2040 con 0x7fdc480a2930 2023-06-02T15:32:59.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc2ffff640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdc34065c00 0x7fdc340680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:32:59.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc2ffff640 1 -- 172.21.15.78:0/2025701040 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc3c11db00 con 0x7fdc480a2930 2023-06-02T15:32:59.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc46ffd640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdc34065c00 0x7fdc340680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:32:59.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.945+0000 7fdc46ffd640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdc34065c00 0x7fdc340680b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdc480731f0 tx=0x7fdc38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:32:59.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:32:59.949+0000 7fdc2ffff640 1 -- 172.21.15.78:0/2025701040 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fdc3c0eaf10 con 0x7fdc480a2930 2023-06-02T15:33:00.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.097+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/2025701040 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc48073bc0 con 0x7fdc34065c00 2023-06-02T15:33:00.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.109+0000 7fdc2ffff640 1 -- 172.21.15.78:0/2025701040 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+393703 (secure 0 0 0) 0x7fdc48073bc0 con 0x7fdc34065c00 2023-06-02T15:33:00.115 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:33:00.118 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:33:00.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/2025701040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdc34065c00 msgr2=0x7fdc340680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:00.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdc34065c00 0x7fdc340680b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdc480731f0 tx=0x7fdc38008040 comp rx=0 tx=0).stop 2023-06-02T15:33:00.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/2025701040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc480a2930 msgr2=0x7fdc48155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:00.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc480a2930 0x7fdc48155750 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0ae040 tx=0x7fdc3c01ad40 comp rx=0 tx=0).stop 2023-06-02T15:33:00.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/2025701040 shutdown_connections 2023-06-02T15:33:00.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc48149e00 0x7fdc481e6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:00.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fdc480ba880 0x7fdc4814d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:00.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fdc34065c00 0x7fdc340680b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:00.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 --2- 172.21.15.78:0/2025701040 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc480a2930 0x7fdc48155750 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:00.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/2025701040 >> 172.21.15.78:0/2025701040 conn(0x7fdc480bcf50 msgr2=0x7fdc48144180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:00.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/2025701040 shutdown_connections 2023-06-02T15:33:00.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:00.113+0000 7fdc4dcf5640 1 -- 172.21.15.78:0/2025701040 wait complete. 2023-06-02T15:33:00.134 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-06-02T15:32:59.275853+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596054,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70304,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":67776,"kb_avail":754904416,"statfs":{"total":773094113280,"available":773022121984,"internally_reserved":0,"allocated":2523136,"data_stored":2182424,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69402624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004589"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:17.308033+0000","last_change":"2023-06-02T15:32:17.308306+0000","last_active":"2023-06-02T15:32:17.308033+0000","last_peered":"2023-06-02T15:32:17.308033+0000","last_clean":"2023-06-02T15:32:17.308033+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:32:17.308033+0000","last_undegraded":"2023-06-02T15:32:17.308033+0000","last_fullsized":"2023-06-02T15:32:17.308033+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:17.307977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:17.307977+0000","last_clean_scrub_stamp":"2023-06-02T15:32:17.307977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:24.975088+0000","scrub_duration":0.0040900049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.897745+0000","last_change":"2023-06-02T15:31:52.897745+0000","last_active":"2023-06-02T15:31:52.897745+0000","last_peered":"2023-06-02T15:31:52.897745+0000","last_clean":"2023-06-02T15:31:52.897745+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:31:52.897745+0000","last_undegraded":"2023-06-02T15:31:52.897745+0000","last_fullsized":"2023-06-02T15:31:52.897745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-06-02T15:31:52.897446+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-06-02T15:31:52.897446+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.897446+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:32.497455+0000","scrub_duration":0.010025713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.768317+0000","last_change":"2023-06-02T15:31:41.768563+0000","last_active":"2023-06-02T15:31:41.768317+0000","last_peered":"2023-06-02T15:31:41.768317+0000","last_clean":"2023-06-02T15:31:41.768317+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:31:41.768317+0000","last_undegraded":"2023-06-02T15:31:41.768317+0000","last_fullsized":"2023-06-02T15:31:41.768317+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.768268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.768268+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.768268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:52.927565+0000","scrub_duration":0.003307744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:55.827268+0000","last_change":"2023-06-02T15:32:55.827546+0000","last_active":"2023-06-02T15:32:55.827268+0000","last_peered":"2023-06-02T15:32:55.827268+0000","last_clean":"2023-06-02T15:32:55.827268+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:32:55.827268+0000","last_undegraded":"2023-06-02T15:32:55.827268+0000","last_fullsized":"2023-06-02T15:32:55.827268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:55.827217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:55.827217+0000","last_clean_scrub_stamp":"2023-06-02T15:32:55.827217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:46:12.884386+0000","scrub_duration":0.0039186430000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:50.674223+0000","last_change":"2023-06-02T15:31:50.674223+0000","last_active":"2023-06-02T15:31:50.674223+0000","last_peered":"2023-06-02T15:31:50.674223+0000","last_clean":"2023-06-02T15:31:50.674223+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:31:50.674223+0000","last_undegraded":"2023-06-02T15:31:50.674223+0000","last_fullsized":"2023-06-02T15:31:50.674223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:31:50.673816+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:31:50.673816+0000","last_clean_scrub_stamp":"2023-06-02T15:31:50.673816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:45.781711+0000","scrub_duration":0.0040557650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.766596+0000","last_change":"2023-06-02T15:32:08.766821+0000","last_active":"2023-06-02T15:32:08.766596+0000","last_peered":"2023-06-02T15:32:08.766596+0000","last_clean":"2023-06-02T15:32:08.766596+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:32:08.766596+0000","last_undegraded":"2023-06-02T15:32:08.766596+0000","last_fullsized":"2023-06-02T15:32:08.766596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:08.766547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:08.766547+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.766547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:16.433658+0000","scrub_duration":0.0038415820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.351238+0000","last_change":"2023-06-02T15:32:14.351572+0000","last_active":"2023-06-02T15:32:14.351238+0000","last_peered":"2023-06-02T15:32:14.351238+0000","last_clean":"2023-06-02T15:32:14.351238+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:32:14.351238+0000","last_undegraded":"2023-06-02T15:32:14.351238+0000","last_fullsized":"2023-06-02T15:32:14.351238+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.351188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.351188+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.351188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:54.109455+0000","scrub_duration":0.0037757120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.644002+0000","last_change":"2023-06-02T15:31:53.644353+0000","last_active":"2023-06-02T15:31:53.644002+0000","last_peered":"2023-06-02T15:31:53.644002+0000","last_clean":"2023-06-02T15:31:53.644002+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:31:53.644002+0000","last_undegraded":"2023-06-02T15:31:53.644002+0000","last_fullsized":"2023-06-02T15:31:53.644002+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:53.643891+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:53.643891+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.643891+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:13.647317+0000","scrub_duration":0.0067897779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:42.741168+0000","last_change":"2023-06-02T15:31:42.741474+0000","last_active":"2023-06-02T15:31:42.741168+0000","last_peered":"2023-06-02T15:31:42.741168+0000","last_clean":"2023-06-02T15:31:42.741168+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:31:42.741168+0000","last_undegraded":"2023-06-02T15:31:42.741168+0000","last_fullsized":"2023-06-02T15:31:42.741168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:42.741115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:42.741115+0000","last_clean_scrub_stamp":"2023-06-02T15:31:42.741115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:22.341123+0000","scrub_duration":0.0040099519999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:21.225274+0000","last_change":"2023-06-02T15:32:21.225588+0000","last_active":"2023-06-02T15:32:21.225274+0000","last_peered":"2023-06-02T15:32:21.225274+0000","last_clean":"2023-06-02T15:32:21.225274+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:32:21.225274+0000","last_undegraded":"2023-06-02T15:32:21.225274+0000","last_fullsized":"2023-06-02T15:32:21.225274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:21.225222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:21.225222+0000","last_clean_scrub_stamp":"2023-06-02T15:32:21.225222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:24.574245+0000","scrub_duration":0.0040298850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.593085+0000","last_change":"2023-06-02T15:31:56.593314+0000","last_active":"2023-06-02T15:31:56.593085+0000","last_peered":"2023-06-02T15:31:56.593085+0000","last_clean":"2023-06-02T15:31:56.593085+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:31:56.593085+0000","last_undegraded":"2023-06-02T15:31:56.593085+0000","last_fullsized":"2023-06-02T15:31:56.593085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:56.593030+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:56.593030+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.593030+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:08.242720+0000","scrub_duration":0.0068701040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:40.768267+0000","last_change":"2023-06-02T15:31:40.768497+0000","last_active":"2023-06-02T15:31:40.768267+0000","last_peered":"2023-06-02T15:31:40.768267+0000","last_clean":"2023-06-02T15:31:40.768267+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:31:40.768267+0000","last_undegraded":"2023-06-02T15:31:40.768267+0000","last_fullsized":"2023-06-02T15:31:40.768267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:40.768219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:40.768219+0000","last_clean_scrub_stamp":"2023-06-02T15:31:40.768219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:29:50.472958+0000","scrub_duration":0.0035921740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.349663+0000","last_change":"2023-06-02T15:32:13.349940+0000","last_active":"2023-06-02T15:32:13.349663+0000","last_peered":"2023-06-02T15:32:13.349663+0000","last_clean":"2023-06-02T15:32:13.349663+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:32:13.349663+0000","last_undegraded":"2023-06-02T15:32:13.349663+0000","last_fullsized":"2023-06-02T15:32:13.349663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.349610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.349610+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.349610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:27:11.184062+0000","scrub_duration":0.0039129899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.968715+0000","last_change":"2023-06-02T15:31:57.968954+0000","last_active":"2023-06-02T15:31:57.968715+0000","last_peered":"2023-06-02T15:31:57.968715+0000","last_clean":"2023-06-02T15:31:57.968715+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:31:57.968715+0000","last_undegraded":"2023-06-02T15:31:57.968715+0000","last_fullsized":"2023-06-02T15:31:57.968715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:31:57.968663+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:31:57.968663+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.968663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:43.801926+0000","scrub_duration":0.003851307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.770706+0000","last_change":"2023-06-02T15:31:36.770926+0000","last_active":"2023-06-02T15:31:36.770706+0000","last_peered":"2023-06-02T15:31:36.770706+0000","last_clean":"2023-06-02T15:31:36.770706+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:31:36.770706+0000","last_undegraded":"2023-06-02T15:31:36.770706+0000","last_fullsized":"2023-06-02T15:31:36.770706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:36.770650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:36.770650+0000","last_clean_scrub_stamp":"2023-06-02T15:31:36.770650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:01:52.784223+0000","scrub_duration":0.0030208169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:26.587870+0000","last_change":"2023-06-02T15:30:42.695951+0000","last_active":"2023-06-02T15:31:26.587870+0000","last_peered":"2023-06-02T15:31:26.587870+0000","last_clean":"2023-06-02T15:31:26.587870+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:31:26.587870+0000","last_undegraded":"2023-06-02T15:31:26.587870+0000","last_fullsized":"2023-06-02T15:31:26.587870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.718833+0000","last_change":"2023-06-02T15:32:13.719090+0000","last_active":"2023-06-02T15:32:13.718833+0000","last_peered":"2023-06-02T15:32:13.718833+0000","last_clean":"2023-06-02T15:32:13.718833+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:32:13.718833+0000","last_undegraded":"2023-06-02T15:32:13.718833+0000","last_fullsized":"2023-06-02T15:32:13.718833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:32:13.718779+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:32:13.718779+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.718779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:17.067801+0000","scrub_duration":0.0036400669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.724754+0000","last_change":"2023-06-02T15:31:43.724985+0000","last_active":"2023-06-02T15:31:43.724754+0000","last_peered":"2023-06-02T15:31:43.724754+0000","last_clean":"2023-06-02T15:31:43.724754+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:31:43.724754+0000","last_undegraded":"2023-06-02T15:31:43.724754+0000","last_fullsized":"2023-06-02T15:31:43.724754+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.724701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.724701+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.724701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:24.477005+0000","scrub_duration":0.0034074370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.609423+0000","last_change":"2023-06-02T15:32:03.609423+0000","last_active":"2023-06-02T15:32:03.609423+0000","last_peered":"2023-06-02T15:32:03.609423+0000","last_clean":"2023-06-02T15:32:03.609423+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:32:03.609423+0000","last_undegraded":"2023-06-02T15:32:03.609423+0000","last_fullsized":"2023-06-02T15:32:03.609423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.609111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.609111+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.609111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:15.258800+0000","scrub_duration":0.0036874350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.171811+0000","last_change":"2023-06-02T15:31:37.171911+0000","last_active":"2023-06-02T15:31:37.171811+0000","last_peered":"2023-06-02T15:31:37.171811+0000","last_clean":"2023-06-02T15:31:37.171811+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:31:37.171811+0000","last_undegraded":"2023-06-02T15:31:37.171811+0000","last_fullsized":"2023-06-02T15:31:37.171811+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.171792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.171792+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.171792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:05.612504+0000","scrub_duration":0.00141092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.879735+0000","last_change":"2023-06-02T15:32:13.879735+0000","last_active":"2023-06-02T15:32:13.879735+0000","last_peered":"2023-06-02T15:32:13.879735+0000","last_clean":"2023-06-02T15:32:13.879735+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:32:13.879735+0000","last_undegraded":"2023-06-02T15:32:13.879735+0000","last_fullsized":"2023-06-02T15:32:13.879735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.879426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.879426+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.879426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:21.546537+0000","scrub_duration":0.003456967,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.953226+0000","last_change":"2023-06-02T15:32:16.953226+0000","last_active":"2023-06-02T15:32:16.953226+0000","last_peered":"2023-06-02T15:32:16.953226+0000","last_clean":"2023-06-02T15:32:16.953226+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:32:16.953226+0000","last_undegraded":"2023-06-02T15:32:16.953226+0000","last_fullsized":"2023-06-02T15:32:16.953226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.952905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.952905+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.952905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:56.711172+0000","scrub_duration":0.0040503359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:04.775444+0000","last_change":"2023-06-02T15:32:04.775742+0000","last_active":"2023-06-02T15:32:04.775444+0000","last_peered":"2023-06-02T15:32:04.775444+0000","last_clean":"2023-06-02T15:32:04.775444+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:32:04.775444+0000","last_undegraded":"2023-06-02T15:32:04.775444+0000","last_fullsized":"2023-06-02T15:32:04.775444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:04.775390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:04.775390+0000","last_clean_scrub_stamp":"2023-06-02T15:32:04.775390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:09.162959+0000","scrub_duration":0.0032928110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.518146+0000","last_change":"2023-06-02T15:31:53.518146+0000","last_active":"2023-06-02T15:31:53.518146+0000","last_peered":"2023-06-02T15:31:53.518146+0000","last_clean":"2023-06-02T15:31:53.518146+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:31:53.518146+0000","last_undegraded":"2023-06-02T15:31:53.518146+0000","last_fullsized":"2023-06-02T15:31:53.518146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:53.517854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:53.517854+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.517854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.677151+0000","scrub_duration":0.0031286759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:39.691357+0000","last_change":"2023-06-02T15:31:39.691651+0000","last_active":"2023-06-02T15:31:39.691357+0000","last_peered":"2023-06-02T15:31:39.691357+0000","last_clean":"2023-06-02T15:31:39.691357+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:31:39.691357+0000","last_undegraded":"2023-06-02T15:31:39.691357+0000","last_fullsized":"2023-06-02T15:31:39.691357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:39.691303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:39.691303+0000","last_clean_scrub_stamp":"2023-06-02T15:31:39.691303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:08.670458+0000","scrub_duration":0.0032675849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:46.866855+0000","last_change":"2023-06-02T15:31:46.867109+0000","last_active":"2023-06-02T15:31:46.866855+0000","last_peered":"2023-06-02T15:31:46.866855+0000","last_clean":"2023-06-02T15:31:46.866855+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:31:46.866855+0000","last_undegraded":"2023-06-02T15:31:46.866855+0000","last_fullsized":"2023-06-02T15:31:46.866855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:46.866803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:46.866803+0000","last_clean_scrub_stamp":"2023-06-02T15:31:46.866803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:27.619106+0000","scrub_duration":0.0038372440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:12.762729+0000","last_change":"2023-06-02T15:32:12.762960+0000","last_active":"2023-06-02T15:32:12.762729+0000","last_peered":"2023-06-02T15:32:12.762729+0000","last_clean":"2023-06-02T15:32:12.762729+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:32:12.762729+0000","last_undegraded":"2023-06-02T15:32:12.762729+0000","last_fullsized":"2023-06-02T15:32:12.762729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:12.762690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:12.762690+0000","last_clean_scrub_stamp":"2023-06-02T15:32:12.762690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:37.440741+0000","scrub_duration":0.0035931549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:06.764347+0000","last_change":"2023-06-02T15:32:06.764696+0000","last_active":"2023-06-02T15:32:06.764347+0000","last_peered":"2023-06-02T15:32:06.764347+0000","last_clean":"2023-06-02T15:32:06.764347+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:32:06.764347+0000","last_undegraded":"2023-06-02T15:32:06.764347+0000","last_fullsized":"2023-06-02T15:32:06.764347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:06.764295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:06.764295+0000","last_clean_scrub_stamp":"2023-06-02T15:32:06.764295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:01.519486+0000","scrub_duration":0.0036305719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:46.537638+0000","last_change":"2023-06-02T15:31:46.537878+0000","last_active":"2023-06-02T15:31:46.537638+0000","last_peered":"2023-06-02T15:31:46.537638+0000","last_clean":"2023-06-02T15:31:46.537638+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:31:46.537638+0000","last_undegraded":"2023-06-02T15:31:46.537638+0000","last_fullsized":"2023-06-02T15:31:46.537638+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:46.537583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:46.537583+0000","last_clean_scrub_stamp":"2023-06-02T15:31:46.537583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:57.696880+0000","scrub_duration":0.0033143180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.135482+0000","last_change":"2023-06-02T15:32:13.135793+0000","last_active":"2023-06-02T15:32:13.135482+0000","last_peered":"2023-06-02T15:32:13.135482+0000","last_clean":"2023-06-02T15:32:13.135482+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:32:13.135482+0000","last_undegraded":"2023-06-02T15:32:13.135482+0000","last_fullsized":"2023-06-02T15:32:13.135482+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.135430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.135430+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.135430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:20.802541+0000","scrub_duration":0.0040929599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.000626+0000","last_change":"2023-06-02T15:31:44.000867+0000","last_active":"2023-06-02T15:31:44.000626+0000","last_peered":"2023-06-02T15:31:44.000626+0000","last_clean":"2023-06-02T15:31:44.000626+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:31:44.000626+0000","last_undegraded":"2023-06-02T15:31:44.000626+0000","last_fullsized":"2023-06-02T15:31:44.000626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-06-02T15:31:44.000570+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-06-02T15:31:44.000570+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.000570+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:12.979725+0000","scrub_duration":0.0085722809999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:07.319600+0000","last_change":"2023-06-02T15:32:07.319836+0000","last_active":"2023-06-02T15:32:07.319600+0000","last_peered":"2023-06-02T15:32:07.319600+0000","last_clean":"2023-06-02T15:32:07.319600+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:32:07.319600+0000","last_undegraded":"2023-06-02T15:32:07.319600+0000","last_fullsized":"2023-06-02T15:32:07.319600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:07.319552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:07.319552+0000","last_clean_scrub_stamp":"2023-06-02T15:32:07.319552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:37.767754+0000","scrub_duration":0.0036772110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:27.684976+0000","last_change":"2023-06-02T15:32:27.685321+0000","last_active":"2023-06-02T15:32:27.684976+0000","last_peered":"2023-06-02T15:32:27.684976+0000","last_clean":"2023-06-02T15:32:27.684976+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:32:27.684976+0000","last_undegraded":"2023-06-02T15:32:27.684976+0000","last_fullsized":"2023-06-02T15:32:27.684976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:27.684926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:27.684926+0000","last_clean_scrub_stamp":"2023-06-02T15:32:27.684926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:02:57.805759+0000","scrub_duration":0.0043116439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'19","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.805341+0000","last_change":"2023-06-02T15:32:08.805341+0000","last_active":"2023-06-02T15:32:08.805341+0000","last_peered":"2023-06-02T15:32:08.805341+0000","last_clean":"2023-06-02T15:32:08.805341+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:32:08.805341+0000","last_undegraded":"2023-06-02T15:32:08.805341+0000","last_fullsized":"2023-06-02T15:32:08.805341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2023-06-02T15:32:08.805041+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2023-06-02T15:32:08.805041+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.805041+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:48.563308+0000","scrub_duration":0.01113798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4904,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.873703+0000","last_change":"2023-06-02T15:32:03.873928+0000","last_active":"2023-06-02T15:32:03.873703+0000","last_peered":"2023-06-02T15:32:03.873703+0000","last_clean":"2023-06-02T15:32:03.873703+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:32:03.873703+0000","last_undegraded":"2023-06-02T15:32:03.873703+0000","last_fullsized":"2023-06-02T15:32:03.873703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.873651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.873651+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.873651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:07:58.628843+0000","scrub_duration":0.0075517730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:15.379094+0000","last_change":"2023-06-02T15:32:15.379438+0000","last_active":"2023-06-02T15:32:15.379094+0000","last_peered":"2023-06-02T15:32:15.379094+0000","last_clean":"2023-06-02T15:32:15.379094+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:32:15.379094+0000","last_undegraded":"2023-06-02T15:32:15.379094+0000","last_fullsized":"2023-06-02T15:32:15.379094+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:15.379039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:15.379039+0000","last_clean_scrub_stamp":"2023-06-02T15:32:15.379039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:10.134230+0000","scrub_duration":0.0041123649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.270419+0000","last_change":"2023-06-02T15:31:51.270419+0000","last_active":"2023-06-02T15:31:51.270419+0000","last_peered":"2023-06-02T15:31:51.270419+0000","last_clean":"2023-06-02T15:31:51.270419+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:31:51.270419+0000","last_undegraded":"2023-06-02T15:31:51.270419+0000","last_fullsized":"2023-06-02T15:31:51.270419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.270125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.270125+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.270125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:30:00.974864+0000","scrub_duration":0.0038244239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.494671+0000","last_change":"2023-06-02T15:31:41.494671+0000","last_active":"2023-06-02T15:31:41.494671+0000","last_peered":"2023-06-02T15:31:41.494671+0000","last_clean":"2023-06-02T15:31:41.494671+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:31:41.494671+0000","last_undegraded":"2023-06-02T15:31:41.494671+0000","last_fullsized":"2023-06-02T15:31:41.494671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.494318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.494318+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.494318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:09.935029+0000","scrub_duration":0.0040292009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:49.597169+0000","last_change":"2023-06-02T15:31:49.597169+0000","last_active":"2023-06-02T15:31:49.597169+0000","last_peered":"2023-06-02T15:31:49.597169+0000","last_clean":"2023-06-02T15:31:49.597169+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:31:49.597169+0000","last_undegraded":"2023-06-02T15:31:49.597169+0000","last_fullsized":"2023-06-02T15:31:49.597169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:49.596840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:49.596840+0000","last_clean_scrub_stamp":"2023-06-02T15:31:49.596840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:44.704735+0000","scrub_duration":0.0034677010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.886646+0000","last_change":"2023-06-02T15:32:14.886646+0000","last_active":"2023-06-02T15:32:14.886646+0000","last_peered":"2023-06-02T15:32:14.886646+0000","last_clean":"2023-06-02T15:32:14.886646+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:32:14.886646+0000","last_undegraded":"2023-06-02T15:32:14.886646+0000","last_fullsized":"2023-06-02T15:32:14.886646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.886241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.886241+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.886241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:34.203061+0000","scrub_duration":0.0039836819999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.999085+0000","last_change":"2023-06-02T15:32:05.999085+0000","last_active":"2023-06-02T15:32:05.999085+0000","last_peered":"2023-06-02T15:32:05.999085+0000","last_clean":"2023-06-02T15:32:05.999085+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:32:05.999085+0000","last_undegraded":"2023-06-02T15:32:05.999085+0000","last_fullsized":"2023-06-02T15:32:05.999085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.998798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.998798+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.998798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:36.447000+0000","scrub_duration":0.0035371059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:39.527934+0000","last_change":"2023-06-02T15:31:39.527934+0000","last_active":"2023-06-02T15:31:39.527934+0000","last_peered":"2023-06-02T15:31:39.527934+0000","last_clean":"2023-06-02T15:31:39.527934+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:31:39.527934+0000","last_undegraded":"2023-06-02T15:31:39.527934+0000","last_fullsized":"2023-06-02T15:31:39.527934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:39.527621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:39.527621+0000","last_clean_scrub_stamp":"2023-06-02T15:31:39.527621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:31:08.870956+0000","scrub_duration":0.0040577269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.314179+0000","last_change":"2023-06-02T15:31:48.314179+0000","last_active":"2023-06-02T15:31:48.314179+0000","last_peered":"2023-06-02T15:31:48.314179+0000","last_clean":"2023-06-02T15:31:48.314179+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:31:48.314179+0000","last_undegraded":"2023-06-02T15:31:48.314179+0000","last_fullsized":"2023-06-02T15:31:48.314179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.313862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.313862+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.313862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:19:57.371808+0000","scrub_duration":0.003324671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.724804+0000","last_change":"2023-06-02T15:32:08.724804+0000","last_active":"2023-06-02T15:32:08.724804+0000","last_peered":"2023-06-02T15:32:08.724804+0000","last_clean":"2023-06-02T15:32:08.724804+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:32:08.724804+0000","last_undegraded":"2023-06-02T15:32:08.724804+0000","last_fullsized":"2023-06-02T15:32:08.724804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:08.724428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:08.724428+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.724428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:39.172630+0000","scrub_duration":0.0040007369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:40.702502+0000","last_change":"2023-06-02T15:31:40.702502+0000","last_active":"2023-06-02T15:31:40.702502+0000","last_peered":"2023-06-02T15:31:40.702502+0000","last_clean":"2023-06-02T15:31:40.702502+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:31:40.702502+0000","last_undegraded":"2023-06-02T15:31:40.702502+0000","last_fullsized":"2023-06-02T15:31:40.702502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:40.702183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:40.702183+0000","last_clean_scrub_stamp":"2023-06-02T15:31:40.702183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:17.405756+0000","scrub_duration":0.0083223120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.826457+0000","last_change":"2023-06-02T15:32:05.826457+0000","last_active":"2023-06-02T15:32:05.826457+0000","last_peered":"2023-06-02T15:32:05.826457+0000","last_clean":"2023-06-02T15:32:05.826457+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:32:05.826457+0000","last_undegraded":"2023-06-02T15:32:05.826457+0000","last_fullsized":"2023-06-02T15:32:05.826457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.826140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.826140+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.826140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:13.493251+0000","scrub_duration":0.0034698720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.692667+0000","last_change":"2023-06-02T15:32:00.692667+0000","last_active":"2023-06-02T15:32:00.692667+0000","last_peered":"2023-06-02T15:32:00.692667+0000","last_clean":"2023-06-02T15:32:00.692667+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:32:00.692667+0000","last_undegraded":"2023-06-02T15:32:00.692667+0000","last_fullsized":"2023-06-02T15:32:00.692667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:32:00.692346+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:32:00.692346+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.692346+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:31.140548+0000","scrub_duration":0.0085621840000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:56.799130+0000","last_change":"2023-06-02T15:32:56.799493+0000","last_active":"2023-06-02T15:32:56.799130+0000","last_peered":"2023-06-02T15:32:56.799130+0000","last_clean":"2023-06-02T15:32:56.799130+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:32:56.799130+0000","last_undegraded":"2023-06-02T15:32:56.799130+0000","last_fullsized":"2023-06-02T15:32:56.799130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:56.799071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:56.799071+0000","last_clean_scrub_stamp":"2023-06-02T15:32:56.799071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:06:24.230535+0000","scrub_duration":0.0042619700000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.850871+0000","last_change":"2023-06-02T15:32:00.850871+0000","last_active":"2023-06-02T15:32:00.850871+0000","last_peered":"2023-06-02T15:32:00.850871+0000","last_clean":"2023-06-02T15:32:00.850871+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:32:00.850871+0000","last_undegraded":"2023-06-02T15:32:00.850871+0000","last_fullsized":"2023-06-02T15:32:00.850871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:00.850599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:00.850599+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.850599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:25.528650+0000","scrub_duration":0.0036098129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:49.712018+0000","last_change":"2023-06-02T15:31:49.712018+0000","last_active":"2023-06-02T15:31:49.712018+0000","last_peered":"2023-06-02T15:31:49.712018+0000","last_clean":"2023-06-02T15:31:49.712018+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:31:49.712018+0000","last_undegraded":"2023-06-02T15:31:49.712018+0000","last_fullsized":"2023-06-02T15:31:49.712018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:49.711487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:49.711487+0000","last_clean_scrub_stamp":"2023-06-02T15:31:49.711487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:29.311495+0000","scrub_duration":0.0044216419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:42.817844+0000","last_change":"2023-06-02T15:31:42.817844+0000","last_active":"2023-06-02T15:31:42.817844+0000","last_peered":"2023-06-02T15:31:42.817844+0000","last_clean":"2023-06-02T15:31:42.817844+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:31:42.817844+0000","last_undegraded":"2023-06-02T15:31:42.817844+0000","last_fullsized":"2023-06-02T15:31:42.817844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:31:42.817550+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:31:42.817550+0000","last_clean_scrub_stamp":"2023-06-02T15:31:42.817550+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:11.796705+0000","scrub_duration":0.0085183749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.742059+0000","last_change":"2023-06-02T15:32:16.742059+0000","last_active":"2023-06-02T15:32:16.742059+0000","last_peered":"2023-06-02T15:32:16.742059+0000","last_clean":"2023-06-02T15:32:16.742059+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:32:16.742059+0000","last_undegraded":"2023-06-02T15:32:16.742059+0000","last_fullsized":"2023-06-02T15:32:16.742059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.741672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.741672+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.741672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:20.090695+0000","scrub_duration":0.004709123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:35.675333+0000","last_change":"2023-06-02T15:31:35.675333+0000","last_active":"2023-06-02T15:31:35.675333+0000","last_peered":"2023-06-02T15:31:35.675333+0000","last_clean":"2023-06-02T15:31:35.675333+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:31:35.675333+0000","last_undegraded":"2023-06-02T15:31:35.675333+0000","last_fullsized":"2023-06-02T15:31:35.675333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:35.675220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:35.675220+0000","last_clean_scrub_stamp":"2023-06-02T15:31:35.675220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:46:41.873628+0000","scrub_duration":0.001699594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.893605+0000","last_change":"2023-06-02T15:31:51.893605+0000","last_active":"2023-06-02T15:31:51.893605+0000","last_peered":"2023-06-02T15:31:51.893605+0000","last_clean":"2023-06-02T15:31:51.893605+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:31:51.893605+0000","last_undegraded":"2023-06-02T15:31:51.893605+0000","last_fullsized":"2023-06-02T15:31:51.893605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.893317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.893317+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.893317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:03.052614+0000","scrub_duration":0.0037955900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'119","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.046295+0000","last_change":"2023-06-02T15:31:53.046295+0000","last_active":"2023-06-02T15:31:53.046295+0000","last_peered":"2023-06-02T15:31:53.046295+0000","last_clean":"2023-06-02T15:31:53.046295+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:31:53.046295+0000","last_undegraded":"2023-06-02T15:31:53.046295+0000","last_fullsized":"2023-06-02T15:31:53.046295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-06-02T15:31:53.045988+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-06-02T15:31:53.045988+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.045988+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.205286+0000","scrub_duration":0.014250489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.176680+0000","last_change":"2023-06-02T15:31:36.176680+0000","last_active":"2023-06-02T15:31:36.176680+0000","last_peered":"2023-06-02T15:31:36.176680+0000","last_clean":"2023-06-02T15:31:36.176680+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:31:36.176680+0000","last_undegraded":"2023-06-02T15:31:36.176680+0000","last_fullsized":"2023-06-02T15:31:36.176680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:36.176579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:36.176579+0000","last_clean_scrub_stamp":"2023-06-02T15:31:36.176579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:31:05.519914+0000","scrub_duration":0.0032385439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:30.351352+0000","last_change":"2023-06-02T15:32:30.351352+0000","last_active":"2023-06-02T15:32:30.351352+0000","last_peered":"2023-06-02T15:32:30.351352+0000","last_clean":"2023-06-02T15:32:30.351352+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:32:30.351352+0000","last_undegraded":"2023-06-02T15:32:30.351352+0000","last_fullsized":"2023-06-02T15:32:30.351352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:30.350951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:30.350951+0000","last_clean_scrub_stamp":"2023-06-02T15:32:30.350951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:03:00.471783+0000","scrub_duration":0.0043598769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.306444+0000","last_change":"2023-06-02T15:31:55.306444+0000","last_active":"2023-06-02T15:31:55.306444+0000","last_peered":"2023-06-02T15:31:55.306444+0000","last_clean":"2023-06-02T15:31:55.306444+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:31:55.306444+0000","last_undegraded":"2023-06-02T15:31:55.306444+0000","last_fullsized":"2023-06-02T15:31:55.306444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:55.306148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:55.306148+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.306148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.414043+0000","scrub_duration":0.0036463979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.316509+0000","last_change":"2023-06-02T15:31:43.316509+0000","last_active":"2023-06-02T15:31:43.316509+0000","last_peered":"2023-06-02T15:31:43.316509+0000","last_clean":"2023-06-02T15:31:43.316509+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:31:43.316509+0000","last_undegraded":"2023-06-02T15:31:43.316509+0000","last_fullsized":"2023-06-02T15:31:43.316509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.316233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.316233+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.316233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:55:51.972560+0000","scrub_duration":0.0081781270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.031260+0000","last_change":"2023-06-02T15:31:45.031260+0000","last_active":"2023-06-02T15:31:45.031260+0000","last_peered":"2023-06-02T15:31:45.031260+0000","last_clean":"2023-06-02T15:31:45.031260+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:31:45.031260+0000","last_undegraded":"2023-06-02T15:31:45.031260+0000","last_fullsized":"2023-06-02T15:31:45.031260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.030964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.030964+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.030964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:21.734537+0000","scrub_duration":0.0035987649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.736848+0000","last_change":"2023-06-02T15:31:55.736848+0000","last_active":"2023-06-02T15:31:55.736848+0000","last_peered":"2023-06-02T15:31:55.736848+0000","last_clean":"2023-06-02T15:31:55.736848+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:31:55.736848+0000","last_undegraded":"2023-06-02T15:31:55.736848+0000","last_fullsized":"2023-06-02T15:31:55.736848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:55.736507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:55.736507+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.736507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.844402+0000","scrub_duration":0.004192884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.289872+0000","last_change":"2023-06-02T15:31:52.289872+0000","last_active":"2023-06-02T15:31:52.289872+0000","last_peered":"2023-06-02T15:31:52.289872+0000","last_clean":"2023-06-02T15:31:52.289872+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:31:52.289872+0000","last_undegraded":"2023-06-02T15:31:52.289872+0000","last_fullsized":"2023-06-02T15:31:52.289872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.289531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.289531+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.289531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:03.448828+0000","scrub_duration":0.0032206029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:24.859872+0000","last_change":"2023-06-02T15:32:24.859872+0000","last_active":"2023-06-02T15:32:24.859872+0000","last_peered":"2023-06-02T15:32:24.859872+0000","last_clean":"2023-06-02T15:32:24.859872+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:32:24.859872+0000","last_undegraded":"2023-06-02T15:32:24.859872+0000","last_fullsized":"2023-06-02T15:32:24.859872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:24.859585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:24.859585+0000","last_clean_scrub_stamp":"2023-06-02T15:32:24.859585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:02:54.980417+0000","scrub_duration":0.003862814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.531411+0000","last_change":"2023-06-02T15:31:45.531411+0000","last_active":"2023-06-02T15:31:45.531411+0000","last_peered":"2023-06-02T15:31:45.531411+0000","last_clean":"2023-06-02T15:31:45.531411+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:31:45.531411+0000","last_undegraded":"2023-06-02T15:31:45.531411+0000","last_fullsized":"2023-06-02T15:31:45.531411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.531079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.531079+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.531079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:29:55.235818+0000","scrub_duration":0.0038552180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:21.924439+0000","last_change":"2023-06-02T15:32:21.924439+0000","last_active":"2023-06-02T15:32:21.924439+0000","last_peered":"2023-06-02T15:32:21.924439+0000","last_clean":"2023-06-02T15:32:21.924439+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:32:21.924439+0000","last_undegraded":"2023-06-02T15:32:21.924439+0000","last_fullsized":"2023-06-02T15:32:21.924439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:21.924109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:21.924109+0000","last_clean_scrub_stamp":"2023-06-02T15:32:21.924109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:25.273132+0000","scrub_duration":0.0041237380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.555827+0000","last_change":"2023-06-02T15:31:52.555827+0000","last_active":"2023-06-02T15:31:52.555827+0000","last_peered":"2023-06-02T15:31:52.555827+0000","last_clean":"2023-06-02T15:31:52.555827+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:31:52.555827+0000","last_undegraded":"2023-06-02T15:31:52.555827+0000","last_fullsized":"2023-06-02T15:31:52.555827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.555485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.555485+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.555485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:30:02.260224+0000","scrub_duration":0.0031645419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:58.638743+0000","last_change":"2023-06-02T15:31:58.638743+0000","last_active":"2023-06-02T15:31:58.638743+0000","last_peered":"2023-06-02T15:31:58.638743+0000","last_clean":"2023-06-02T15:31:58.638743+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:31:58.638743+0000","last_undegraded":"2023-06-02T15:31:58.638743+0000","last_fullsized":"2023-06-02T15:31:58.638743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:58.638110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:58.638110+0000","last_clean_scrub_stamp":"2023-06-02T15:31:58.638110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:51.247160+0000","scrub_duration":0.0035255070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.102141+0000","last_change":"2023-06-02T15:31:48.102141+0000","last_active":"2023-06-02T15:31:48.102141+0000","last_peered":"2023-06-02T15:31:48.102141+0000","last_clean":"2023-06-02T15:31:48.102141+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:31:48.102141+0000","last_undegraded":"2023-06-02T15:31:48.102141+0000","last_fullsized":"2023-06-02T15:31:48.102141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.101830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.101830+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.101830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:28.854133+0000","scrub_duration":0.0082640209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.095296+0000","last_change":"2023-06-02T15:32:14.095296+0000","last_active":"2023-06-02T15:32:14.095296+0000","last_peered":"2023-06-02T15:32:14.095296+0000","last_clean":"2023-06-02T15:32:14.095296+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:32:14.095296+0000","last_undegraded":"2023-06-02T15:32:14.095296+0000","last_fullsized":"2023-06-02T15:32:14.095296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.094929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.094929+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.094929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:33.411749+0000","scrub_duration":0.0041825120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.841653+0000","last_change":"2023-06-02T15:32:02.841867+0000","last_active":"2023-06-02T15:32:02.841653+0000","last_peered":"2023-06-02T15:32:02.841653+0000","last_clean":"2023-06-02T15:32:02.841653+0000","last_became_active":"2023-06-02T15:31:26.758308+0000","last_became_peered":"2023-06-02T15:31:26.758308+0000","last_unstale":"2023-06-02T15:32:02.841653+0000","last_undegraded":"2023-06-02T15:32:02.841653+0000","last_fullsized":"2023-06-02T15:32:02.841653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.841598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.841598+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.841598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.491288+0000","scrub_duration":0.0031874889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.727371+0000","last_change":"2023-06-02T15:31:52.727371+0000","last_active":"2023-06-02T15:31:52.727371+0000","last_peered":"2023-06-02T15:31:52.727371+0000","last_clean":"2023-06-02T15:31:52.727371+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:31:52.727371+0000","last_undegraded":"2023-06-02T15:31:52.727371+0000","last_fullsized":"2023-06-02T15:31:52.727371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.727078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.727078+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.727078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:38.560342+0000","scrub_duration":0.003683974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":16,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.955573+0000","last_change":"2023-06-02T15:30:42.702845+0000","last_active":"2023-06-02T15:31:36.955573+0000","last_peered":"2023-06-02T15:31:36.955573+0000","last_clean":"2023-06-02T15:31:36.955573+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:31:36.955573+0000","last_undegraded":"2023-06-02T15:31:36.955573+0000","last_fullsized":"2023-06-02T15:31:36.955573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:41.633480+0000","last_clean_scrub_stamp":"2023-06-02T15:30:41.633480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:26.804050+0000","last_change":"2023-06-02T15:32:26.804050+0000","last_active":"2023-06-02T15:32:26.804050+0000","last_peered":"2023-06-02T15:32:26.804050+0000","last_clean":"2023-06-02T15:32:26.804050+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:32:26.804050+0000","last_undegraded":"2023-06-02T15:32:26.804050+0000","last_fullsized":"2023-06-02T15:32:26.804050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:26.803750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:26.803750+0000","last_clean_scrub_stamp":"2023-06-02T15:32:26.803750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:16:25.542468+0000","scrub_duration":0.0037377830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:06.778522+0000","last_change":"2023-06-02T15:32:06.778522+0000","last_active":"2023-06-02T15:32:06.778522+0000","last_peered":"2023-06-02T15:32:06.778522+0000","last_clean":"2023-06-02T15:32:06.778522+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:32:06.778522+0000","last_undegraded":"2023-06-02T15:32:06.778522+0000","last_fullsized":"2023-06-02T15:32:06.778522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:06.778176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:06.778176+0000","last_clean_scrub_stamp":"2023-06-02T15:32:06.778176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:26.094996+0000","scrub_duration":0.0036399050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:33.344441+0000","last_change":"2023-06-02T15:32:33.344441+0000","last_active":"2023-06-02T15:32:33.344441+0000","last_peered":"2023-06-02T15:32:33.344441+0000","last_clean":"2023-06-02T15:32:33.344441+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:32:33.344441+0000","last_undegraded":"2023-06-02T15:32:33.344441+0000","last_fullsized":"2023-06-02T15:32:33.344441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:33.344053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:33.344053+0000","last_clean_scrub_stamp":"2023-06-02T15:32:33.344053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:16:32.082771+0000","scrub_duration":0.0043976019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:30.769731+0000","last_change":"2023-06-02T15:32:30.769731+0000","last_active":"2023-06-02T15:32:30.769731+0000","last_peered":"2023-06-02T15:32:30.769731+0000","last_clean":"2023-06-02T15:32:30.769731+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:32:30.769731+0000","last_undegraded":"2023-06-02T15:32:30.769731+0000","last_fullsized":"2023-06-02T15:32:30.769731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:30.769418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:30.769418+0000","last_clean_scrub_stamp":"2023-06-02T15:32:30.769418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:19:14.692332+0000","scrub_duration":0.0035215419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.525640+0000","last_change":"2023-06-02T15:31:45.525640+0000","last_active":"2023-06-02T15:31:45.525640+0000","last_peered":"2023-06-02T15:31:45.525640+0000","last_clean":"2023-06-02T15:31:45.525640+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:31:45.525640+0000","last_undegraded":"2023-06-02T15:31:45.525640+0000","last_fullsized":"2023-06-02T15:31:45.525640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.525308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.525308+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.525308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:22.228881+0000","scrub_duration":0.0032755190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:18.292124+0000","last_change":"2023-06-02T15:32:18.292124+0000","last_active":"2023-06-02T15:32:18.292124+0000","last_peered":"2023-06-02T15:32:18.292124+0000","last_clean":"2023-06-02T15:32:18.292124+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:32:18.292124+0000","last_undegraded":"2023-06-02T15:32:18.292124+0000","last_fullsized":"2023-06-02T15:32:18.292124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:18.291730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:18.291730+0000","last_clean_scrub_stamp":"2023-06-02T15:32:18.291730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:37.608551+0000","scrub_duration":0.0039707090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:27.822771+0000","last_change":"2023-06-02T15:32:27.822771+0000","last_active":"2023-06-02T15:32:27.822771+0000","last_peered":"2023-06-02T15:32:27.822771+0000","last_clean":"2023-06-02T15:32:27.822771+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:32:27.822771+0000","last_undegraded":"2023-06-02T15:32:27.822771+0000","last_fullsized":"2023-06-02T15:32:27.822771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:27.822452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:27.822452+0000","last_clean_scrub_stamp":"2023-06-02T15:32:27.822452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:01:53.214163+0000","scrub_duration":0.003855701,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.682215+0000","last_change":"2023-06-02T15:31:57.682215+0000","last_active":"2023-06-02T15:31:57.682215+0000","last_peered":"2023-06-02T15:31:57.682215+0000","last_clean":"2023-06-02T15:31:57.682215+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:31:57.682215+0000","last_undegraded":"2023-06-02T15:31:57.682215+0000","last_fullsized":"2023-06-02T15:31:57.682215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:57.681867+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:57.681867+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.681867+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:09.331557+0000","scrub_duration":0.0066385239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:54.709526+0000","last_change":"2023-06-02T15:31:54.709526+0000","last_active":"2023-06-02T15:31:54.709526+0000","last_peered":"2023-06-02T15:31:54.709526+0000","last_clean":"2023-06-02T15:31:54.709526+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:31:54.709526+0000","last_undegraded":"2023-06-02T15:31:54.709526+0000","last_fullsized":"2023-06-02T15:31:54.709526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:54.709024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:54.709024+0000","last_clean_scrub_stamp":"2023-06-02T15:31:54.709024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:34.309032+0000","scrub_duration":0.0044425330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:10.905766+0000","last_change":"2023-06-02T15:32:10.905766+0000","last_active":"2023-06-02T15:32:10.905766+0000","last_peered":"2023-06-02T15:32:10.905766+0000","last_clean":"2023-06-02T15:32:10.905766+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:32:10.905766+0000","last_undegraded":"2023-06-02T15:32:10.905766+0000","last_fullsized":"2023-06-02T15:32:10.905766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:10.905480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:10.905480+0000","last_clean_scrub_stamp":"2023-06-02T15:32:10.905480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:19.827428+0000","scrub_duration":0.0033200590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:01.605705+0000","last_change":"2023-06-02T15:32:01.605705+0000","last_active":"2023-06-02T15:32:01.605705+0000","last_peered":"2023-06-02T15:32:01.605705+0000","last_clean":"2023-06-02T15:32:01.605705+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:32:01.605705+0000","last_undegraded":"2023-06-02T15:32:01.605705+0000","last_fullsized":"2023-06-02T15:32:01.605705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:01.605406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:01.605406+0000","last_clean_scrub_stamp":"2023-06-02T15:32:01.605406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:32.053608+0000","scrub_duration":0.0036437890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.682346+0000","last_change":"2023-06-02T15:31:53.682346+0000","last_active":"2023-06-02T15:31:53.682346+0000","last_peered":"2023-06-02T15:31:53.682346+0000","last_clean":"2023-06-02T15:31:53.682346+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:31:53.682346+0000","last_undegraded":"2023-06-02T15:31:53.682346+0000","last_fullsized":"2023-06-02T15:31:53.682346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:53.682012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:53.682012+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.682012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.841309+0000","scrub_duration":0.003995602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.514954+0000","last_change":"2023-06-02T15:31:56.514954+0000","last_active":"2023-06-02T15:31:56.514954+0000","last_peered":"2023-06-02T15:31:56.514954+0000","last_clean":"2023-06-02T15:31:56.514954+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:31:56.514954+0000","last_undegraded":"2023-06-02T15:31:56.514954+0000","last_fullsized":"2023-06-02T15:31:56.514954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:56.514662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:56.514662+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.514662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:51.622557+0000","scrub_duration":0.0037504259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.132917+0000","last_change":"2023-06-02T15:31:57.132917+0000","last_active":"2023-06-02T15:31:57.132917+0000","last_peered":"2023-06-02T15:31:57.132917+0000","last_clean":"2023-06-02T15:31:57.132917+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:31:57.132917+0000","last_undegraded":"2023-06-02T15:31:57.132917+0000","last_fullsized":"2023-06-02T15:31:57.132917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:31:57.132631+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:31:57.132631+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.132631+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:42.965894+0000","scrub_duration":0.0071564879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.808081+0000","last_change":"2023-06-02T15:31:57.808081+0000","last_active":"2023-06-02T15:31:57.808081+0000","last_peered":"2023-06-02T15:31:57.808081+0000","last_clean":"2023-06-02T15:31:57.808081+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:31:57.808081+0000","last_undegraded":"2023-06-02T15:31:57.808081+0000","last_fullsized":"2023-06-02T15:31:57.808081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:57.807733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:57.807733+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.807733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:43.640997+0000","scrub_duration":0.0037340979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.794000+0000","last_change":"2023-06-02T15:31:51.794000+0000","last_active":"2023-06-02T15:31:51.794000+0000","last_peered":"2023-06-02T15:31:51.794000+0000","last_clean":"2023-06-02T15:31:51.794000+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:31:51.794000+0000","last_undegraded":"2023-06-02T15:31:51.794000+0000","last_fullsized":"2023-06-02T15:31:51.794000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.793607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.793607+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.793607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:03.443296+0000","scrub_duration":0.0037644940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.022508+0000","last_change":"2023-06-02T15:32:02.022508+0000","last_active":"2023-06-02T15:32:02.022508+0000","last_peered":"2023-06-02T15:32:02.022508+0000","last_clean":"2023-06-02T15:32:02.022508+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:32:02.022508+0000","last_undegraded":"2023-06-02T15:32:02.022508+0000","last_fullsized":"2023-06-02T15:32:02.022508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:32:02.022211+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:32:02.022211+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.022211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:13.671901+0000","scrub_duration":0.0065549570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.745565+0000","last_change":"2023-06-02T15:31:48.745565+0000","last_active":"2023-06-02T15:31:48.745565+0000","last_peered":"2023-06-02T15:31:48.745565+0000","last_clean":"2023-06-02T15:31:48.745565+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:31:48.745565+0000","last_undegraded":"2023-06-02T15:31:48.745565+0000","last_fullsized":"2023-06-02T15:31:48.745565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.745224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.745224+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.745224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:29.497528+0000","scrub_duration":0.0041717810000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.580802+0000","last_change":"2023-06-02T15:32:05.580802+0000","last_active":"2023-06-02T15:32:05.580802+0000","last_peered":"2023-06-02T15:32:05.580802+0000","last_clean":"2023-06-02T15:32:05.580802+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:32:05.580802+0000","last_undegraded":"2023-06-02T15:32:05.580802+0000","last_fullsized":"2023-06-02T15:32:05.580802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.580528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.580528+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.580528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:30.258580+0000","scrub_duration":0.0033003379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.048495+0000","last_change":"2023-06-02T15:32:03.048495+0000","last_active":"2023-06-02T15:32:03.048495+0000","last_peered":"2023-06-02T15:32:03.048495+0000","last_clean":"2023-06-02T15:32:03.048495+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:32:03.048495+0000","last_undegraded":"2023-06-02T15:32:03.048495+0000","last_fullsized":"2023-06-02T15:32:03.048495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:32:03.048224+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:32:03.048224+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.048224+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:55.657274+0000","scrub_duration":0.0067757360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.096164+0000","last_change":"2023-06-02T15:32:16.096164+0000","last_active":"2023-06-02T15:32:16.096164+0000","last_peered":"2023-06-02T15:32:16.096164+0000","last_clean":"2023-06-02T15:32:16.096164+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:32:16.096164+0000","last_undegraded":"2023-06-02T15:32:16.096164+0000","last_fullsized":"2023-06-02T15:32:16.096164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.095808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.095808+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.095808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:55.854075+0000","scrub_duration":0.0041363069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:19.324633+0000","last_change":"2023-06-02T15:32:19.325002+0000","last_active":"2023-06-02T15:32:19.324633+0000","last_peered":"2023-06-02T15:32:19.324633+0000","last_clean":"2023-06-02T15:32:19.324633+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:32:19.324633+0000","last_undegraded":"2023-06-02T15:32:19.324633+0000","last_fullsized":"2023-06-02T15:32:19.324633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:19.324579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:19.324579+0000","last_clean_scrub_stamp":"2023-06-02T15:32:19.324579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:22.673602+0000","scrub_duration":0.0040750339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'12","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.534507+0000","last_change":"2023-06-02T15:31:44.534507+0000","last_active":"2023-06-02T15:31:44.534507+0000","last_peered":"2023-06-02T15:31:44.534507+0000","last_clean":"2023-06-02T15:31:44.534507+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:31:44.534507+0000","last_undegraded":"2023-06-02T15:31:44.534507+0000","last_fullsized":"2023-06-02T15:31:44.534507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2023-06-02T15:31:44.534127+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2023-06-02T15:31:44.534127+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.534127+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:13.513282+0000","scrub_duration":0.010992052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.800436+0000","last_change":"2023-06-02T15:32:05.800709+0000","last_active":"2023-06-02T15:32:05.800436+0000","last_peered":"2023-06-02T15:32:05.800436+0000","last_clean":"2023-06-02T15:32:05.800436+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:32:05.800436+0000","last_undegraded":"2023-06-02T15:32:05.800436+0000","last_fullsized":"2023-06-02T15:32:05.800436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.800386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.800386+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.800386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:14.722334+0000","scrub_duration":0.0038761970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:30.682969+0000","last_change":"2023-06-02T15:32:30.683297+0000","last_active":"2023-06-02T15:32:30.682969+0000","last_peered":"2023-06-02T15:32:30.682969+0000","last_clean":"2023-06-02T15:32:30.682969+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:32:30.682969+0000","last_undegraded":"2023-06-02T15:32:30.682969+0000","last_fullsized":"2023-06-02T15:32:30.682969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:30.682913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:30.682913+0000","last_clean_scrub_stamp":"2023-06-02T15:32:30.682913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:16:29.421631+0000","scrub_duration":0.0040783460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:54.070812+0000","last_change":"2023-06-02T15:31:54.070812+0000","last_active":"2023-06-02T15:31:54.070812+0000","last_peered":"2023-06-02T15:31:54.070812+0000","last_clean":"2023-06-02T15:31:54.070812+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:31:54.070812+0000","last_undegraded":"2023-06-02T15:31:54.070812+0000","last_fullsized":"2023-06-02T15:31:54.070812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:54.070524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:54.070524+0000","last_clean_scrub_stamp":"2023-06-02T15:31:54.070524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:33.670532+0000","scrub_duration":0.003366693,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.886215+0000","last_change":"2023-06-02T15:32:09.886495+0000","last_active":"2023-06-02T15:32:09.886215+0000","last_peered":"2023-06-02T15:32:09.886215+0000","last_clean":"2023-06-02T15:32:09.886215+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:32:09.886215+0000","last_undegraded":"2023-06-02T15:32:09.886215+0000","last_fullsized":"2023-06-02T15:32:09.886215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.886166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.886166+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.886166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:14.273734+0000","scrub_duration":0.003413995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.801035+0000","last_change":"2023-06-02T15:31:43.801035+0000","last_active":"2023-06-02T15:31:43.801035+0000","last_peered":"2023-06-02T15:31:43.801035+0000","last_clean":"2023-06-02T15:31:43.801035+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:31:43.801035+0000","last_undegraded":"2023-06-02T15:31:43.801035+0000","last_fullsized":"2023-06-02T15:31:43.801035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.800740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.800740+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.800740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:20.504313+0000","scrub_duration":0.0039374529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.427238+0000","last_change":"2023-06-02T15:32:09.427459+0000","last_active":"2023-06-02T15:32:09.427238+0000","last_peered":"2023-06-02T15:32:09.427238+0000","last_clean":"2023-06-02T15:32:09.427238+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:32:09.427238+0000","last_undegraded":"2023-06-02T15:32:09.427238+0000","last_fullsized":"2023-06-02T15:32:09.427238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.427191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.427191+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.427191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:04.182383+0000","scrub_duration":0.0032371549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:31.728897+0000","last_change":"2023-06-02T15:32:31.729209+0000","last_active":"2023-06-02T15:32:31.728897+0000","last_peered":"2023-06-02T15:32:31.728897+0000","last_clean":"2023-06-02T15:32:31.728897+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:32:31.728897+0000","last_undegraded":"2023-06-02T15:32:31.728897+0000","last_fullsized":"2023-06-02T15:32:31.728897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:31.728844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:31.728844+0000","last_clean_scrub_stamp":"2023-06-02T15:32:31.728844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:01:57.120555+0000","scrub_duration":0.0039777570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.111052+0000","last_change":"2023-06-02T15:31:55.111052+0000","last_active":"2023-06-02T15:31:55.111052+0000","last_peered":"2023-06-02T15:31:55.111052+0000","last_clean":"2023-06-02T15:31:55.111052+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:31:55.111052+0000","last_undegraded":"2023-06-02T15:31:55.111052+0000","last_fullsized":"2023-06-02T15:31:55.111052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2023-06-02T15:31:55.110743+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2023-06-02T15:31:55.110743+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.110743+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.218637+0000","scrub_duration":0.0089042889999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:38.259845+0000","last_change":"2023-06-02T15:32:38.260189+0000","last_active":"2023-06-02T15:32:38.259845+0000","last_peered":"2023-06-02T15:32:38.259845+0000","last_clean":"2023-06-02T15:32:38.259845+0000","last_became_active":"2023-06-02T15:31:26.923733+0000","last_became_peered":"2023-06-02T15:31:26.923733+0000","last_unstale":"2023-06-02T15:32:38.259845+0000","last_undegraded":"2023-06-02T15:32:38.259845+0000","last_fullsized":"2023-06-02T15:32:38.259845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:38.259747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:38.259747+0000","last_clean_scrub_stamp":"2023-06-02T15:32:38.259747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:19:22.182661+0000","scrub_duration":0.0040724389999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:12.439543+0000","last_change":"2023-06-02T15:32:12.439830+0000","last_active":"2023-06-02T15:32:12.439543+0000","last_peered":"2023-06-02T15:32:12.439543+0000","last_clean":"2023-06-02T15:32:12.439543+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:32:12.439543+0000","last_undegraded":"2023-06-02T15:32:12.439543+0000","last_fullsized":"2023-06-02T15:32:12.439543+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:12.439487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:12.439487+0000","last_clean_scrub_stamp":"2023-06-02T15:32:12.439487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:31.756307+0000","scrub_duration":0.0043436109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.568821+0000","last_change":"2023-06-02T15:32:00.568821+0000","last_active":"2023-06-02T15:32:00.568821+0000","last_peered":"2023-06-02T15:32:00.568821+0000","last_clean":"2023-06-02T15:32:00.568821+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:32:00.568821+0000","last_undegraded":"2023-06-02T15:32:00.568821+0000","last_fullsized":"2023-06-02T15:32:00.568821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:00.568499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:00.568499+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.568499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:20.571924+0000","scrub_duration":0.003625372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.740104+0000","last_change":"2023-06-02T15:32:09.740104+0000","last_active":"2023-06-02T15:32:09.740104+0000","last_peered":"2023-06-02T15:32:09.740104+0000","last_clean":"2023-06-02T15:32:09.740104+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:32:09.740104+0000","last_undegraded":"2023-06-02T15:32:09.740104+0000","last_fullsized":"2023-06-02T15:32:09.740104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.739809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.739809+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.739809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:29.056629+0000","scrub_duration":0.0034772800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.809508+0000","last_change":"2023-06-02T15:31:48.809508+0000","last_active":"2023-06-02T15:31:48.809508+0000","last_peered":"2023-06-02T15:31:48.809508+0000","last_clean":"2023-06-02T15:31:48.809508+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:31:48.809508+0000","last_undegraded":"2023-06-02T15:31:48.809508+0000","last_fullsized":"2023-06-02T15:31:48.809508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.809212+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:08.812638+0000","scrub_duration":0.003422675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.713166+0000","last_change":"2023-06-02T15:31:48.713166+0000","last_active":"2023-06-02T15:31:48.713166+0000","last_peered":"2023-06-02T15:31:48.713166+0000","last_clean":"2023-06-02T15:31:48.713166+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:31:48.713166+0000","last_undegraded":"2023-06-02T15:31:48.713166+0000","last_fullsized":"2023-06-02T15:31:48.713166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.712833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.712833+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.712833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:59.872130+0000","scrub_duration":0.0041090880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.357932+0000","last_change":"2023-06-02T15:32:11.357932+0000","last_active":"2023-06-02T15:32:11.357932+0000","last_peered":"2023-06-02T15:32:11.357932+0000","last_clean":"2023-06-02T15:32:11.357932+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:32:11.357932+0000","last_undegraded":"2023-06-02T15:32:11.357932+0000","last_fullsized":"2023-06-02T15:32:11.357932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.357659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.357659+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.357659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:36.035711+0000","scrub_duration":0.003466874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.463479+0000","last_change":"2023-06-02T15:32:11.463479+0000","last_active":"2023-06-02T15:32:11.463479+0000","last_peered":"2023-06-02T15:32:11.463479+0000","last_clean":"2023-06-02T15:32:11.463479+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:32:11.463479+0000","last_undegraded":"2023-06-02T15:32:11.463479+0000","last_fullsized":"2023-06-02T15:32:11.463479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.463140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.463140+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.463140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:19.130250+0000","scrub_duration":0.0031256579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.405088+0000","last_change":"2023-06-02T15:32:02.405088+0000","last_active":"2023-06-02T15:32:02.405088+0000","last_peered":"2023-06-02T15:32:02.405088+0000","last_clean":"2023-06-02T15:32:02.405088+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:32:02.405088+0000","last_undegraded":"2023-06-02T15:32:02.405088+0000","last_fullsized":"2023-06-02T15:32:02.405088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.404814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.404814+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.404814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.054503+0000","scrub_duration":0.003729914,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:59.370686+0000","last_change":"2023-06-02T15:31:59.370686+0000","last_active":"2023-06-02T15:31:59.370686+0000","last_peered":"2023-06-02T15:31:59.370686+0000","last_clean":"2023-06-02T15:31:59.370686+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:31:59.370686+0000","last_undegraded":"2023-06-02T15:31:59.370686+0000","last_fullsized":"2023-06-02T15:31:59.370686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:59.370409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:59.370409+0000","last_clean_scrub_stamp":"2023-06-02T15:31:59.370409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:19.373834+0000","scrub_duration":0.0039692160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.051651+0000","last_change":"2023-06-02T15:32:05.051651+0000","last_active":"2023-06-02T15:32:05.051651+0000","last_peered":"2023-06-02T15:32:05.051651+0000","last_clean":"2023-06-02T15:32:05.051651+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:32:05.051651+0000","last_undegraded":"2023-06-02T15:32:05.051651+0000","last_fullsized":"2023-06-02T15:32:05.051651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.051353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.051353+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.051353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:35.499555+0000","scrub_duration":0.0040453920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.672704+0000","last_change":"2023-06-02T15:32:11.672704+0000","last_active":"2023-06-02T15:32:11.672704+0000","last_peered":"2023-06-02T15:32:11.672704+0000","last_clean":"2023-06-02T15:32:11.672704+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:32:11.672704+0000","last_undegraded":"2023-06-02T15:32:11.672704+0000","last_fullsized":"2023-06-02T15:32:11.672704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.672427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.672427+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.672427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:51.430694+0000","scrub_duration":0.0035935189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:04.015903+0000","last_change":"2023-06-02T15:32:04.015903+0000","last_active":"2023-06-02T15:32:04.015903+0000","last_peered":"2023-06-02T15:32:04.015903+0000","last_clean":"2023-06-02T15:32:04.015903+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:32:04.015903+0000","last_undegraded":"2023-06-02T15:32:04.015903+0000","last_fullsized":"2023-06-02T15:32:04.015903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:04.015570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:04.015570+0000","last_clean_scrub_stamp":"2023-06-02T15:32:04.015570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:56.624619+0000","scrub_duration":0.0033126750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.056254+0000","last_change":"2023-06-02T15:32:09.056254+0000","last_active":"2023-06-02T15:32:09.056254+0000","last_peered":"2023-06-02T15:32:09.056254+0000","last_clean":"2023-06-02T15:32:09.056254+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:32:09.056254+0000","last_undegraded":"2023-06-02T15:32:09.056254+0000","last_fullsized":"2023-06-02T15:32:09.056254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.055882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.055882+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.055882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:13.443451+0000","scrub_duration":0.0037959309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.888442+0000","last_change":"2023-06-02T15:31:56.888442+0000","last_active":"2023-06-02T15:31:56.888442+0000","last_peered":"2023-06-02T15:31:56.888442+0000","last_clean":"2023-06-02T15:31:56.888442+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:31:56.888442+0000","last_undegraded":"2023-06-02T15:31:56.888442+0000","last_fullsized":"2023-06-02T15:31:56.888442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:56.888166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:56.888166+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.888166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:27.336368+0000","scrub_duration":0.0032250339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.801217+0000","last_change":"2023-06-02T15:31:37.801217+0000","last_active":"2023-06-02T15:31:37.801217+0000","last_peered":"2023-06-02T15:31:37.801217+0000","last_clean":"2023-06-02T15:31:37.801217+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:31:37.801217+0000","last_undegraded":"2023-06-02T15:31:37.801217+0000","last_fullsized":"2023-06-02T15:31:37.801217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.801043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.801043+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.801043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:46:43.999450+0000","scrub_duration":0.0034263620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:40.658977+0000","last_change":"2023-06-02T15:32:40.659256+0000","last_active":"2023-06-02T15:32:40.658977+0000","last_peered":"2023-06-02T15:32:40.658977+0000","last_clean":"2023-06-02T15:32:40.658977+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:32:40.658977+0000","last_undegraded":"2023-06-02T15:32:40.658977+0000","last_fullsized":"2023-06-02T15:32:40.658977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:40.658927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:40.658927+0000","last_clean_scrub_stamp":"2023-06-02T15:32:40.658927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:25:20.839380+0000","scrub_duration":0.003771178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.005598+0000","last_change":"2023-06-02T15:32:03.005845+0000","last_active":"2023-06-02T15:32:03.005598+0000","last_peered":"2023-06-02T15:32:03.005598+0000","last_clean":"2023-06-02T15:32:03.005598+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:32:03.005598+0000","last_undegraded":"2023-06-02T15:32:03.005598+0000","last_fullsized":"2023-06-02T15:32:03.005598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.005544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.005544+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.005544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.655234+0000","scrub_duration":0.0031069069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.859940+0000","last_change":"2023-06-02T15:32:02.860193+0000","last_active":"2023-06-02T15:32:02.859940+0000","last_peered":"2023-06-02T15:32:02.859940+0000","last_clean":"2023-06-02T15:32:02.859940+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:32:02.859940+0000","last_undegraded":"2023-06-02T15:32:02.859940+0000","last_fullsized":"2023-06-02T15:32:02.859940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.859891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.859891+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.859891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:11.781839+0000","scrub_duration":0.0039529639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:10.100774+0000","last_change":"2023-06-02T15:32:10.101069+0000","last_active":"2023-06-02T15:32:10.100774+0000","last_peered":"2023-06-02T15:32:10.100774+0000","last_clean":"2023-06-02T15:32:10.100774+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:32:10.100774+0000","last_undegraded":"2023-06-02T15:32:10.100774+0000","last_fullsized":"2023-06-02T15:32:10.100774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:10.100721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:10.100721+0000","last_clean_scrub_stamp":"2023-06-02T15:32:10.100721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:19.022669+0000","scrub_duration":0.003560887,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.498288+0000","last_change":"2023-06-02T15:31:41.498607+0000","last_active":"2023-06-02T15:31:41.498288+0000","last_peered":"2023-06-02T15:31:41.498288+0000","last_clean":"2023-06-02T15:31:41.498288+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:31:41.498288+0000","last_undegraded":"2023-06-02T15:31:41.498288+0000","last_fullsized":"2023-06-02T15:31:41.498288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.498234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.498234+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.498234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:22.250537+0000","scrub_duration":0.0032772719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.761820+0000","last_change":"2023-06-02T15:31:41.762119+0000","last_active":"2023-06-02T15:31:41.761820+0000","last_peered":"2023-06-02T15:31:41.761820+0000","last_clean":"2023-06-02T15:31:41.761820+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:31:41.761820+0000","last_undegraded":"2023-06-02T15:31:41.761820+0000","last_fullsized":"2023-06-02T15:31:41.761820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.761771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.761771+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.761771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:10.202482+0000","scrub_duration":0.0033186510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.714050+0000","last_change":"2023-06-02T15:31:45.714297+0000","last_active":"2023-06-02T15:31:45.714050+0000","last_peered":"2023-06-02T15:31:45.714050+0000","last_clean":"2023-06-02T15:31:45.714050+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:31:45.714050+0000","last_undegraded":"2023-06-02T15:31:45.714050+0000","last_fullsized":"2023-06-02T15:31:45.714050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.713996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.713996+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.713996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:22.417569+0000","scrub_duration":0.003800037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean+scrubbing+deep","last_fresh":"2023-06-02T15:31:36.955512+0000","last_change":"2023-06-02T15:32:31.725661+0000","last_active":"2023-06-02T15:31:36.955512+0000","last_peered":"2023-06-02T15:31:36.955512+0000","last_clean":"2023-06-02T15:31:36.955512+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:31:36.955512+0000","last_undegraded":"2023-06-02T15:31:36.955512+0000","last_fullsized":"2023-06-02T15:31:36.955512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:30:38.230562+0000","last_clean_scrub_stamp":"2023-06-02T15:30:38.230562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.497864+0000","last_change":"2023-06-02T15:31:37.498112+0000","last_active":"2023-06-02T15:31:37.497864+0000","last_peered":"2023-06-02T15:31:37.497864+0000","last_clean":"2023-06-02T15:31:37.497864+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:31:37.497864+0000","last_undegraded":"2023-06-02T15:31:37.497864+0000","last_fullsized":"2023-06-02T15:31:37.497864+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.497813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.497813+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.497813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:06.476968+0000","scrub_duration":0.0034432849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:38.779703+0000","last_change":"2023-06-02T15:31:38.779930+0000","last_active":"2023-06-02T15:31:38.779703+0000","last_peered":"2023-06-02T15:31:38.779703+0000","last_clean":"2023-06-02T15:31:38.779703+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:31:38.779703+0000","last_undegraded":"2023-06-02T15:31:38.779703+0000","last_fullsized":"2023-06-02T15:31:38.779703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:38.779654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:38.779654+0000","last_clean_scrub_stamp":"2023-06-02T15:31:38.779654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:07.220365+0000","scrub_duration":0.0031197170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:07.505180+0000","last_change":"2023-06-02T15:32:07.505469+0000","last_active":"2023-06-02T15:32:07.505180+0000","last_peered":"2023-06-02T15:32:07.505180+0000","last_clean":"2023-06-02T15:32:07.505180+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:32:07.505180+0000","last_undegraded":"2023-06-02T15:32:07.505180+0000","last_fullsized":"2023-06-02T15:32:07.505180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:07.505132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:07.505132+0000","last_clean_scrub_stamp":"2023-06-02T15:32:07.505132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:27:05.339584+0000","scrub_duration":0.0034090029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.084596+0000","last_change":"2023-06-02T15:32:11.084825+0000","last_active":"2023-06-02T15:32:11.084596+0000","last_peered":"2023-06-02T15:32:11.084596+0000","last_clean":"2023-06-02T15:32:11.084596+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:32:11.084596+0000","last_undegraded":"2023-06-02T15:32:11.084596+0000","last_fullsized":"2023-06-02T15:32:11.084596+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.084549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.084549+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.084549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:05.839740+0000","scrub_duration":0.0037808770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:42.739228+0000","last_change":"2023-06-02T15:32:42.739497+0000","last_active":"2023-06-02T15:32:42.739228+0000","last_peered":"2023-06-02T15:32:42.739228+0000","last_clean":"2023-06-02T15:32:42.739228+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:32:42.739228+0000","last_undegraded":"2023-06-02T15:32:42.739228+0000","last_fullsized":"2023-06-02T15:32:42.739228+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:42.739181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:42.739181+0000","last_clean_scrub_stamp":"2023-06-02T15:32:42.739181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:16:59.479400+0000","scrub_duration":0.0038148140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.887243+0000","last_change":"2023-06-02T15:32:11.887491+0000","last_active":"2023-06-02T15:32:11.887243+0000","last_peered":"2023-06-02T15:32:11.887243+0000","last_clean":"2023-06-02T15:32:11.887243+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:32:11.887243+0000","last_undegraded":"2023-06-02T15:32:11.887243+0000","last_fullsized":"2023-06-02T15:32:11.887243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.887196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.887196+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.887196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:06.642387+0000","scrub_duration":0.003596793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.546529+0000","last_change":"2023-06-02T15:31:48.546529+0000","last_active":"2023-06-02T15:31:48.546529+0000","last_peered":"2023-06-02T15:31:48.546529+0000","last_clean":"2023-06-02T15:31:48.546529+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:31:48.546529+0000","last_undegraded":"2023-06-02T15:31:48.546529+0000","last_fullsized":"2023-06-02T15:31:48.546529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.546224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.546224+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.546224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:29.298528+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:45.754760+0000","last_change":"2023-06-02T15:32:45.754760+0000","last_active":"2023-06-02T15:32:45.754760+0000","last_peered":"2023-06-02T15:32:45.754760+0000","last_clean":"2023-06-02T15:32:45.754760+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:32:45.754760+0000","last_undegraded":"2023-06-02T15:32:45.754760+0000","last_fullsized":"2023-06-02T15:32:45.754760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:45.754458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:45.754458+0000","last_clean_scrub_stamp":"2023-06-02T15:32:45.754458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:47:05.712913+0000","scrub_duration":0.003734781,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:38.480659+0000","last_change":"2023-06-02T15:31:38.480659+0000","last_active":"2023-06-02T15:31:38.480659+0000","last_peered":"2023-06-02T15:31:38.480659+0000","last_clean":"2023-06-02T15:31:38.480659+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:31:38.480659+0000","last_undegraded":"2023-06-02T15:31:38.480659+0000","last_fullsized":"2023-06-02T15:31:38.480659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:38.480329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:38.480329+0000","last_clean_scrub_stamp":"2023-06-02T15:31:38.480329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:15.183901+0000","scrub_duration":0.0035440649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.744656+0000","last_change":"2023-06-02T15:31:44.744656+0000","last_active":"2023-06-02T15:31:44.744656+0000","last_peered":"2023-06-02T15:31:44.744656+0000","last_clean":"2023-06-02T15:31:44.744656+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:31:44.744656+0000","last_undegraded":"2023-06-02T15:31:44.744656+0000","last_fullsized":"2023-06-02T15:31:44.744656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:44.744325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:44.744325+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.744325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:13.723480+0000","scrub_duration":0.0037133079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5686,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574879,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":389120,"data_stored":719524,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83699999999999997,"15min":0.83799999999999997},"min":{"1min":0.55600000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.83999999999999997,"15min":0.83199999999999996},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.177,"5min":1.538,"15min":1.538},"last":0.79800000000000004}]},{"osd":1,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.875,"15min":0.86699999999999999},"min":{"1min":0.62,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.252,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.94099999999999995,"15min":0.94399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.133,"5min":1.198,"15min":1.198},"last":1.0049999999999999}]},{"osd":2,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.78000000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1679999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92900000000000005,"15min":0.93000000000000005},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.0269999999999999}]},{"osd":3,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.90500000000000003,"15min":0.90900000000000003},"min":{"1min":0.72699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0549999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.008,"5min":1.0009999999999999,"15min":1},"min":{"1min":0.85199999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.98199999999999998}]},{"osd":4,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.095,"5min":1.343,"15min":1.343},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94199999999999995,"15min":0.94799999999999995},"min":{"1min":0.67000000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.202,"5min":1.649,"15min":1.649},"last":0.94799999999999995}]},{"osd":5,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.069,"15min":1.085},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.419,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.135,"15min":1.149},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.266,"5min":1.97,"15min":1.97},"last":1.0680000000000001}]},{"osd":6,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0820000000000001,"15min":1.0980000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.2230000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.2889999999999999,"5min":1.722,"15min":1.722},"last":1.048}]}]},{"osd":6,"up_from":13,"seq":55834574881,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85799999999999998,"15min":0.85099999999999998},"min":{"1min":0.65500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1539999999999999,"5min":1.252,"15min":1.252},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84099999999999997,"15min":0.83799999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.68700000000000006}]},{"osd":1,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.82299999999999995,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.127,"5min":1.165,"15min":1.165},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92100000000000004,"15min":0.92000000000000004},"min":{"1min":0.65400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.141,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.875}]},{"osd":2,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1899999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93100000000000005,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.89300000000000002,"15min":0.88100000000000001},"min":{"1min":0.73699999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.749,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1220000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.131}]},{"osd":4,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.98599999999999999,"15min":1.0049999999999999},"min":{"1min":0.60299999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.1080000000000001},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0109999999999999,"15min":1.0189999999999999},"min":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.77900000000000003}]},{"osd":5,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.97999999999999998,"15min":0.98599999999999999},"min":{"1min":0.70499999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1140000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1080000000000001,"15min":1.109},"min":{"1min":0.85999999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3029999999999999,"5min":1.365,"15min":1.365},"last":1.1539999999999999}]},{"osd":7,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.115,"15min":1.1240000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.28,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.087},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0920000000000001,"15min":1.097},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.3420000000000001,"5min":1.429,"15min":1.429},"last":1.4259999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":294912,"data_stored":123686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86599999999999999,"15min":0.86199999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.133,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.83099999999999996,"15min":0.82199999999999995},"min":{"1min":0.61899999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94699999999999995}]},{"osd":1,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.66400000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1140000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.159,"15min":1.159},"last":0.68100000000000005}]},{"osd":2,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90500000000000003,"15min":0.90700000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1160000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":1.026},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91300000000000003},"min":{"1min":0.746,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.115,"5min":1.234,"15min":1.234},"last":0.81399999999999995}]},{"osd":3,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.94599999999999995,"15min":0.94999999999999996},"min":{"1min":0.71199999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.014,"15min":1.01},"min":{"1min":0.82399999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.2,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.083}]},{"osd":4,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.012,"15min":1.026},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.216,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":0.875},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.028,"15min":1.0429999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2370000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":0.84699999999999998}]},{"osd":6,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.046,"15min":1.0669999999999999},"min":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.1619999999999999,"5min":1.881,"15min":1.881},"last":1.125},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.083,"15min":1.0980000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.175,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.77500000000000002}]},{"osd":7,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.056,"15min":1.073},"min":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.171,"5min":1.905,"15min":1.905},"last":1.006},{"interface":"front","average":{"1min":1.032,"5min":1.1299999999999999,"15min":1.1459999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.214,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.175}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8764,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363076,"statfs":{"total":96636764160,"available":96627789824,"internally_reserved":0,"allocated":315392,"data_stored":128996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91600000000000004,"15min":0.91000000000000003},"min":{"1min":0.77100000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.204,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":1.008},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.109,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.85399999999999998}]},{"osd":1,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84799999999999998,"15min":0.85199999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.92000000000000004,"15min":0.91400000000000003},"min":{"1min":0.622,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.167,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.92400000000000004}]},{"osd":2,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.61199999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1779999999999999,"5min":1.198,"15min":1.198},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88500000000000001,"15min":0.876},"min":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.1459999999999999}]},{"osd":3,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89300000000000002,"15min":0.89900000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0620000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":1.0580000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98199999999999998,"15min":0.97999999999999998},"min":{"1min":0.82399999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.236,"5min":1.379,"15min":1.379},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.67800000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1930000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.58799999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1719999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.70199999999999996}]},{"osd":6,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.64100000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2649999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":1.03,"5min":1.0660000000000001,"15min":1.0720000000000001},"min":{"1min":0.73399999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.296,"5min":1.327,"15min":1.327},"last":1.083}]},{"osd":7,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.999,"15min":1.0029999999999999},"min":{"1min":0.72699999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1200000000000001,"15min":1.1240000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":0.98299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":294912,"data_stored":124126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.73999999999999999}]},{"osd":1,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93500000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.75,"5min":0.64900000000000002,"15min":0.63200000000000001},"min":{"1min":0.29099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.65400000000000003}]},{"osd":2,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.438,"5min":0.25,"15min":0.25},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71899999999999997,"15min":0.70899999999999996},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.89100000000000001,"15min":0.879},"min":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.67500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3480000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.98199999999999998}]},{"osd":5,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.175,"5min":1.375,"15min":1.375},"last":1.105},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.004,"15min":1.006},"min":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.387,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.079}]},{"osd":6,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.94899999999999995,"15min":0.93500000000000005},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":1.1379999999999999},{"interface":"front","average":{"1min":0.995,"5min":1.028,"15min":1.034},"min":{"1min":0.73599999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.93999999999999995}]},{"osd":7,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0569999999999999,"15min":1.0580000000000001},"min":{"1min":0.76700000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.298,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.006,"5min":1.0409999999999999,"15min":1.0469999999999999},"min":{"1min":0.625,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3600000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.1910000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.443,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.878,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.623},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67000000000000004,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.038,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.58299999999999996}]},{"osd":1,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.46300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94899999999999995,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.68799999999999994}]},{"osd":3,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.163,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.66900000000000004,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.82799999999999996}]},{"osd":4,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92400000000000004,"15min":0.92500000000000004},"min":{"1min":0.66600000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1930000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.93400000000000005,"15min":0.93799999999999994},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.266,"15min":1.266},"last":0.79600000000000004}]},{"osd":5,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.95999999999999996,"15min":0.95299999999999996},"min":{"1min":0.71699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.331,"5min":1.337,"15min":1.337},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.64400000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2470000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":0.96499999999999997}]},{"osd":6,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96899999999999997,"15min":0.96299999999999997},"min":{"1min":0.72999999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0169999999999999,"15min":1.0129999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.296,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.999}]},{"osd":7,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0669999999999999,"15min":1.0649999999999999},"min":{"1min":0.84999999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.347,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0289999999999999,"15min":1.0209999999999999},"min":{"1min":0.81100000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.373,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":1.0349999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":356352,"data_stored":714404,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57699999999999996,"15min":0.56299999999999994},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97399999999999998,"5min":1.028,"15min":1.028},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.755,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.39500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.78600000000000003}]},{"osd":3,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.69699999999999995,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0600000000000001,"5min":1.079,"15min":1.079},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.65000000000000002,"15min":0.63400000000000001},"min":{"1min":0.35099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.72399999999999998}]},{"osd":4,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82699999999999996,"15min":0.82499999999999996},"min":{"1min":0.59199999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0609999999999999,"5min":1.266,"15min":1.266},"last":0.85799999999999998},{"interface":"front","average":{"1min":1.018,"5min":0.91300000000000003,"15min":0.89500000000000002},"min":{"1min":0.78500000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.84599999999999997}]},{"osd":5,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.877,"15min":0.85999999999999999},"min":{"1min":0.68200000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90900000000000003,"15min":0.89900000000000002},"min":{"1min":0.82099999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1739999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.93600000000000005}]},{"osd":6,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.94799999999999995,"15min":0.92800000000000005},"min":{"1min":0.63300000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.93200000000000005,"15min":0.91400000000000003},"min":{"1min":0.70699999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.82699999999999996}]},{"osd":7,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.96699999999999997,"15min":0.95599999999999996},"min":{"1min":0.73199999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.224,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.96399999999999997},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.94999999999999996,"15min":0.94199999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.244,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.75900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8676,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363164,"statfs":{"total":96636764160,"available":96627879936,"internally_reserved":0,"allocated":290816,"data_stored":123616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.53100000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94999999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.042,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.84099999999999997}]},{"osd":2,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.60799999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68500000000000005,"15min":0.67800000000000005},"min":{"1min":0.49299999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.63900000000000001}]},{"osd":3,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.53300000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78200000000000003,"15min":0.77800000000000002},"min":{"1min":0.58899999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1479999999999999,"5min":1.216,"15min":1.216},"last":0.68200000000000005}]},{"osd":4,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93500000000000005,"15min":0.93899999999999995},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0589999999999999,"5min":1.702,"15min":1.702},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.73699999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.155,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.79000000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0740000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.03,"15min":1.036},"min":{"1min":0.70199999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3160000000000001,"5min":1.573,"15min":1.573},"last":1.2}]},{"osd":6,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0720000000000001,"15min":1.081},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.3919999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":1.252},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.038,"15min":1.046},"min":{"1min":0.85199999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.28,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.0660000000000001}]},{"osd":7,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.091,"15min":1.101},"min":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.234,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.117},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.81200000000000006,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.2929999999999999,"5min":1.363,"15min":1.363},"last":0.91000000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:33:00.146 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:33:00.147 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-06-02T15:30:41.633480+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=41, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:33:00.148 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-06-02T15:30:38.230562+0000 time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=30, tm_sec=38, tm_wday=4, tm_yday=153, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=6, tm_mday=2, tm_hour=15, tm_min=31, tm_sec=33, tm_wday=4, tm_yday=153, tm_isdst=0) 2023-06-02T15:33:00.148 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-06-02T15:33:14.899 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:14.902 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:14.905 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:14.907 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:20.149 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-06-02T15:33:20.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f946bf8d640 1 Processor -- start 2023-06-02T15:33:20.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f946bf8d640 1 -- start start 2023-06-02T15:33:20.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f946bf8d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94640ba880 0x7f94640a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f946bf8d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 0x7f94641502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f946bf8d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94640bb0e0 con 0x7f9464149e00 2023-06-02T15:33:20.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f946bf8d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946414a1d0 con 0x7f94640ba880 2023-06-02T15:33:20.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f946bf8d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94640a61d0 con 0x7f946414fe20 2023-06-02T15:33:20.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f9469528640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94640ba880 0x7f94640a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f9469528640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f94640ba880 0x7f94640a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59178/0 (socket says 172.21.15.78:59178) 2023-06-02T15:33:20.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f9469528640 1 -- 172.21.15.78:0/1094818604 learned_addr learned my addr 172.21.15.78:0/1094818604 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:20.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f946a52a640 1 --2- 172.21.15.78:0/1094818604 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 0x7f94641502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f9469528640 1 -- 172.21.15.78:0/1094818604 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 msgr2=0x7f94641502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:20.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f9469528640 1 --2- 172.21.15.78:0/1094818604 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 0x7f94641502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f9469528640 1 -- 172.21.15.78:0/1094818604 >> v1:172.21.15.132:6789/0 conn(0x7f9464149e00 legacy=0x7f94640a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:20.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f9469528640 1 -- 172.21.15.78:0/1094818604 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94640a3810 con 0x7f94640ba880 2023-06-02T15:33:20.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.277+0000 7f946a52a640 1 --2- 172.21.15.78:0/1094818604 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 0x7f94641502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:33:20.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f9469528640 1 --2- 172.21.15.78:0/1094818604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 0x7f94640a5bd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9454009870 tx=0x7f945401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69289f082f20c46c server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:20.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f9468d27640 1 -- 172.21.15.78:0/1094818604 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540ab600 con 0x7f94640ba880 2023-06-02T15:33:20.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f9468d27640 1 -- 172.21.15.78:0/1094818604 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94540a7050 con 0x7f94640ba880 2023-06-02T15:33:20.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f9468d27640 1 -- 172.21.15.78:0/1094818604 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94540ab980 con 0x7f94640ba880 2023-06-02T15:33:20.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 -- 172.21.15.78:0/1094818604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 msgr2=0x7f94640a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 --2- 172.21.15.78:0/1094818604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 0x7f94640a5bd0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9454009870 tx=0x7f945401c500 comp rx=0 tx=0).stop 2023-06-02T15:33:20.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 -- 172.21.15.78:0/1094818604 shutdown_connections 2023-06-02T15:33:20.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 --2- 172.21.15.78:0/1094818604 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 0x7f94641502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 --2- 172.21.15.78:0/1094818604 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 0x7f94640a5bd0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 -- 172.21.15.78:0/1094818604 >> 172.21.15.78:0/1094818604 conn(0x7f94640bcf50 msgr2=0x7f94640bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:20.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 -- 172.21.15.78:0/1094818604 shutdown_connections 2023-06-02T15:33:20.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 -- 172.21.15.78:0/1094818604 wait complete. 2023-06-02T15:33:20.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 Processor -- start 2023-06-02T15:33:20.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 -- start start 2023-06-02T15:33:20.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 0x7f9464146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464149e00 0x7f946413fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 0x7f94640bf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94641e5800 con 0x7f94640ba880 2023-06-02T15:33:20.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94640c0540 con 0x7f9464149e00 2023-06-02T15:33:20.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946bf8d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94641e5280 con 0x7f946414fe20 2023-06-02T15:33:20.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f9469d29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 0x7f9464146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f9469d29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 0x7f9464146ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59182/0 (socket says 172.21.15.78:59182) 2023-06-02T15:33:20.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f9469d29640 1 -- 172.21.15.78:0/3144953885 learned_addr learned my addr 172.21.15.78:0/3144953885 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:20.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f946a52a640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 0x7f94640bf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.281+0000 7f9469528640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464149e00 0x7f946413fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f9469d29640 1 -- 172.21.15.78:0/3144953885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 msgr2=0x7f94640bf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f9469d29640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 0x7f94640bf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f9469d29640 1 -- 172.21.15.78:0/3144953885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464149e00 msgr2=0x7f946413fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f9469d29640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464149e00 0x7f946413fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f9469d29640 1 -- 172.21.15.78:0/3144953885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94540094d0 con 0x7f94640ba880 2023-06-02T15:33:20.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f9469528640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464149e00 0x7f946413fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-06-02T15:33:20.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f9469d29640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 0x7f9464146ae0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f946000c450 tx=0x7f946000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:20.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f945a7fc640 1 -- 172.21.15.78:0/3144953885 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460012830 con 0x7f94640ba880 2023-06-02T15:33:20.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f945a7fc640 1 -- 172.21.15.78:0/3144953885 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94600129b0 con 0x7f94640ba880 2023-06-02T15:33:20.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f946bf8d640 1 -- 172.21.15.78:0/3144953885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9464159700 con 0x7f94640ba880 2023-06-02T15:33:20.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f945a7fc640 1 -- 172.21.15.78:0/3144953885 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460012d60 con 0x7f94640ba880 2023-06-02T15:33:20.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f946bf8d640 1 -- 172.21.15.78:0/3144953885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94640a2b00 con 0x7f94640ba880 2023-06-02T15:33:20.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f946bf8d640 1 -- 172.21.15.78:0/3144953885 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9464159890 con 0x7f94640ba880 2023-06-02T15:33:20.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f945a7fc640 1 -- 172.21.15.78:0/3144953885 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f946001c460 con 0x7f94640ba880 2023-06-02T15:33:20.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f945a7fc640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9448065c00 0x7f94480680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f945a7fc640 1 -- 172.21.15.78:0/3144953885 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9460083380 con 0x7f94640ba880 2023-06-02T15:33:20.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f9469528640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9448065c00 0x7f94480680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.285+0000 7f9469528640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9448065c00 0x7f94480680b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f94540ad000 tx=0x7f94540a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:20.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.289+0000 7f945a7fc640 1 -- 172.21.15.78:0/3144953885 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f94600508b0 con 0x7f94640ba880 2023-06-02T15:33:20.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.433+0000 7f946bf8d640 1 -- 172.21.15.78:0/3144953885 --> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9464073bc0 con 0x7f9448065c00 2023-06-02T15:33:20.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.441+0000 7f945a7fc640 1 -- 172.21.15.78:0/3144953885 <== mgr.4103 v2:172.21.15.78:6832/37044 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+393724 (secure 0 0 0) 0x7f9464073bc0 con 0x7f9448065c00 2023-06-02T15:33:20.451 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:33:20.452 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-06-02T15:33:20.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 -- 172.21.15.78:0/3144953885 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9448065c00 msgr2=0x7f94480680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9448065c00 0x7f94480680b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f94540ad000 tx=0x7f94540a6000 comp rx=0 tx=0).stop 2023-06-02T15:33:20.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 -- 172.21.15.78:0/3144953885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 msgr2=0x7f9464146ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 0x7f9464146ae0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f946000c450 tx=0x7f946000c910 comp rx=0 tx=0).stop 2023-06-02T15:33:20.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 -- 172.21.15.78:0/3144953885 shutdown_connections 2023-06-02T15:33:20.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f946414fe20 0x7f94640bf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9464149e00 0x7f946413fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9448065c00 0x7f94480680b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 --2- 172.21.15.78:0/3144953885 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f94640ba880 0x7f9464146ae0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 -- 172.21.15.78:0/3144953885 >> 172.21.15.78:0/3144953885 conn(0x7f94640bcf50 msgr2=0x7f9464156110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:20.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 -- 172.21.15.78:0/3144953885 shutdown_connections 2023-06-02T15:33:20.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.449+0000 7f946bf8d640 1 -- 172.21.15.78:0/3144953885 wait complete. 2023-06-02T15:33:20.467 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2023-06-02T15:33:19.284236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596054,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":70304,"kb_used_data":2464,"kb_used_omap":0,"kb_used_meta":67776,"kb_avail":754904416,"statfs":{"total":773094113280,"available":773022121984,"internally_reserved":0,"allocated":2523136,"data_stored":2182424,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":69402624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004945"},"pg_stats":[{"pgid":"5.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:17.308306+0000","last_change":"2023-06-02T15:32:17.308306+0000","last_active":"2023-06-02T15:32:17.308306+0000","last_peered":"2023-06-02T15:32:17.308306+0000","last_clean":"2023-06-02T15:32:17.308306+0000","last_became_active":"2023-06-02T15:30:42.710819+0000","last_became_peered":"2023-06-02T15:30:42.710819+0000","last_unstale":"2023-06-02T15:32:17.308306+0000","last_undegraded":"2023-06-02T15:32:17.308306+0000","last_fullsized":"2023-06-02T15:32:17.308306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:17.307977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:17.307977+0000","last_clean_scrub_stamp":"2023-06-02T15:32:17.307977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:24.975088+0000","scrub_duration":0.0040900049999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.897745+0000","last_change":"2023-06-02T15:31:52.897745+0000","last_active":"2023-06-02T15:31:52.897745+0000","last_peered":"2023-06-02T15:31:52.897745+0000","last_clean":"2023-06-02T15:31:52.897745+0000","last_became_active":"2023-06-02T15:30:38.274205+0000","last_became_peered":"2023-06-02T15:30:38.274205+0000","last_unstale":"2023-06-02T15:31:52.897745+0000","last_undegraded":"2023-06-02T15:31:52.897745+0000","last_fullsized":"2023-06-02T15:31:52.897745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2023-06-02T15:31:52.897446+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2023-06-02T15:31:52.897446+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.897446+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:32.497455+0000","scrub_duration":0.010025713,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.768563+0000","last_change":"2023-06-02T15:31:41.768563+0000","last_active":"2023-06-02T15:31:41.768563+0000","last_peered":"2023-06-02T15:31:41.768563+0000","last_clean":"2023-06-02T15:31:41.768563+0000","last_became_active":"2023-06-02T15:30:38.638506+0000","last_became_peered":"2023-06-02T15:30:38.638506+0000","last_unstale":"2023-06-02T15:31:41.768563+0000","last_undegraded":"2023-06-02T15:31:41.768563+0000","last_fullsized":"2023-06-02T15:31:41.768563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.768268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.768268+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.768268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:52.927565+0000","scrub_duration":0.003307744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:55.827546+0000","last_change":"2023-06-02T15:32:55.827546+0000","last_active":"2023-06-02T15:32:55.827546+0000","last_peered":"2023-06-02T15:32:55.827546+0000","last_clean":"2023-06-02T15:32:55.827546+0000","last_became_active":"2023-06-02T15:30:42.695031+0000","last_became_peered":"2023-06-02T15:30:42.695031+0000","last_unstale":"2023-06-02T15:32:55.827546+0000","last_undegraded":"2023-06-02T15:32:55.827546+0000","last_fullsized":"2023-06-02T15:32:55.827546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:55.827217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:55.827217+0000","last_clean_scrub_stamp":"2023-06-02T15:32:55.827217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:46:12.884386+0000","scrub_duration":0.0039186430000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:50.674223+0000","last_change":"2023-06-02T15:31:50.674223+0000","last_active":"2023-06-02T15:31:50.674223+0000","last_peered":"2023-06-02T15:31:50.674223+0000","last_clean":"2023-06-02T15:31:50.674223+0000","last_became_active":"2023-06-02T15:30:38.273397+0000","last_became_peered":"2023-06-02T15:30:38.273397+0000","last_unstale":"2023-06-02T15:31:50.674223+0000","last_undegraded":"2023-06-02T15:31:50.674223+0000","last_fullsized":"2023-06-02T15:31:50.674223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:31:50.673816+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:31:50.673816+0000","last_clean_scrub_stamp":"2023-06-02T15:31:50.673816+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:45.781711+0000","scrub_duration":0.0040557650000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.766821+0000","last_change":"2023-06-02T15:32:08.766821+0000","last_active":"2023-06-02T15:32:08.766821+0000","last_peered":"2023-06-02T15:32:08.766821+0000","last_clean":"2023-06-02T15:32:08.766821+0000","last_became_active":"2023-06-02T15:30:38.638043+0000","last_became_peered":"2023-06-02T15:30:38.638043+0000","last_unstale":"2023-06-02T15:32:08.766821+0000","last_undegraded":"2023-06-02T15:32:08.766821+0000","last_fullsized":"2023-06-02T15:32:08.766821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:08.766547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:08.766547+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.766547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:16.433658+0000","scrub_duration":0.0038415820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.351572+0000","last_change":"2023-06-02T15:32:14.351572+0000","last_active":"2023-06-02T15:32:14.351572+0000","last_peered":"2023-06-02T15:32:14.351572+0000","last_clean":"2023-06-02T15:32:14.351572+0000","last_became_active":"2023-06-02T15:30:42.707897+0000","last_became_peered":"2023-06-02T15:30:42.707897+0000","last_unstale":"2023-06-02T15:32:14.351572+0000","last_undegraded":"2023-06-02T15:32:14.351572+0000","last_fullsized":"2023-06-02T15:32:14.351572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.351188+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.351188+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.351188+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:54.109455+0000","scrub_duration":0.0037757120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.644353+0000","last_change":"2023-06-02T15:31:53.644353+0000","last_active":"2023-06-02T15:31:53.644353+0000","last_peered":"2023-06-02T15:31:53.644353+0000","last_clean":"2023-06-02T15:31:53.644353+0000","last_became_active":"2023-06-02T15:30:38.275583+0000","last_became_peered":"2023-06-02T15:30:38.275583+0000","last_unstale":"2023-06-02T15:31:53.644353+0000","last_undegraded":"2023-06-02T15:31:53.644353+0000","last_fullsized":"2023-06-02T15:31:53.644353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:53.643891+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:53.643891+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.643891+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:13.647317+0000","scrub_duration":0.0067897779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:42.741474+0000","last_change":"2023-06-02T15:31:42.741474+0000","last_active":"2023-06-02T15:31:42.741474+0000","last_peered":"2023-06-02T15:31:42.741474+0000","last_clean":"2023-06-02T15:31:42.741474+0000","last_became_active":"2023-06-02T15:30:38.644244+0000","last_became_peered":"2023-06-02T15:30:38.644244+0000","last_unstale":"2023-06-02T15:31:42.741474+0000","last_undegraded":"2023-06-02T15:31:42.741474+0000","last_fullsized":"2023-06-02T15:31:42.741474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:42.741115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:42.741115+0000","last_clean_scrub_stamp":"2023-06-02T15:31:42.741115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:22.341123+0000","scrub_duration":0.0040099519999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:21.225588+0000","last_change":"2023-06-02T15:32:21.225588+0000","last_active":"2023-06-02T15:32:21.225588+0000","last_peered":"2023-06-02T15:32:21.225588+0000","last_clean":"2023-06-02T15:32:21.225588+0000","last_became_active":"2023-06-02T15:30:42.706048+0000","last_became_peered":"2023-06-02T15:30:42.706048+0000","last_unstale":"2023-06-02T15:32:21.225588+0000","last_undegraded":"2023-06-02T15:32:21.225588+0000","last_fullsized":"2023-06-02T15:32:21.225588+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:21.225222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:21.225222+0000","last_clean_scrub_stamp":"2023-06-02T15:32:21.225222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:24.574245+0000","scrub_duration":0.0040298850000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.593314+0000","last_change":"2023-06-02T15:31:56.593314+0000","last_active":"2023-06-02T15:31:56.593314+0000","last_peered":"2023-06-02T15:31:56.593314+0000","last_clean":"2023-06-02T15:31:56.593314+0000","last_became_active":"2023-06-02T15:30:38.269147+0000","last_became_peered":"2023-06-02T15:30:38.269147+0000","last_unstale":"2023-06-02T15:31:56.593314+0000","last_undegraded":"2023-06-02T15:31:56.593314+0000","last_fullsized":"2023-06-02T15:31:56.593314+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:56.593030+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:56.593030+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.593030+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:08.242720+0000","scrub_duration":0.0068701040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:40.768497+0000","last_change":"2023-06-02T15:31:40.768497+0000","last_active":"2023-06-02T15:31:40.768497+0000","last_peered":"2023-06-02T15:31:40.768497+0000","last_clean":"2023-06-02T15:31:40.768497+0000","last_became_active":"2023-06-02T15:30:38.639071+0000","last_became_peered":"2023-06-02T15:30:38.639071+0000","last_unstale":"2023-06-02T15:31:40.768497+0000","last_undegraded":"2023-06-02T15:31:40.768497+0000","last_fullsized":"2023-06-02T15:31:40.768497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:40.768219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:40.768219+0000","last_clean_scrub_stamp":"2023-06-02T15:31:40.768219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:29:50.472958+0000","scrub_duration":0.0035921740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.349940+0000","last_change":"2023-06-02T15:32:13.349940+0000","last_active":"2023-06-02T15:32:13.349940+0000","last_peered":"2023-06-02T15:32:13.349940+0000","last_clean":"2023-06-02T15:32:13.349940+0000","last_became_active":"2023-06-02T15:30:42.698733+0000","last_became_peered":"2023-06-02T15:30:42.698733+0000","last_unstale":"2023-06-02T15:32:13.349940+0000","last_undegraded":"2023-06-02T15:32:13.349940+0000","last_fullsized":"2023-06-02T15:32:13.349940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.349610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.349610+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.349610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:27:11.184062+0000","scrub_duration":0.0039129899999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.968954+0000","last_change":"2023-06-02T15:31:57.968954+0000","last_active":"2023-06-02T15:31:57.968954+0000","last_peered":"2023-06-02T15:31:57.968954+0000","last_clean":"2023-06-02T15:31:57.968954+0000","last_became_active":"2023-06-02T15:30:38.263142+0000","last_became_peered":"2023-06-02T15:30:38.263142+0000","last_unstale":"2023-06-02T15:31:57.968954+0000","last_undegraded":"2023-06-02T15:31:57.968954+0000","last_fullsized":"2023-06-02T15:31:57.968954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:31:57.968663+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:31:57.968663+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.968663+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:43.801926+0000","scrub_duration":0.003851307,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.770926+0000","last_change":"2023-06-02T15:31:36.770926+0000","last_active":"2023-06-02T15:31:36.770926+0000","last_peered":"2023-06-02T15:31:36.770926+0000","last_clean":"2023-06-02T15:31:36.770926+0000","last_became_active":"2023-06-02T15:30:38.643543+0000","last_became_peered":"2023-06-02T15:30:38.643543+0000","last_unstale":"2023-06-02T15:31:36.770926+0000","last_undegraded":"2023-06-02T15:31:36.770926+0000","last_fullsized":"2023-06-02T15:31:36.770926+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:36.770650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:36.770650+0000","last_clean_scrub_stamp":"2023-06-02T15:31:36.770650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:01:52.784223+0000","scrub_duration":0.0030208169999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:33:00.798808+0000","last_change":"2023-06-02T15:33:00.798808+0000","last_active":"2023-06-02T15:33:00.798808+0000","last_peered":"2023-06-02T15:33:00.798808+0000","last_clean":"2023-06-02T15:33:00.798808+0000","last_became_active":"2023-06-02T15:30:42.694965+0000","last_became_peered":"2023-06-02T15:30:42.694965+0000","last_unstale":"2023-06-02T15:33:00.798808+0000","last_undegraded":"2023-06-02T15:33:00.798808+0000","last_fullsized":"2023-06-02T15:33:00.798808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:33:00.798505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:33:00.798505+0000","last_clean_scrub_stamp":"2023-06-02T15:33:00.798505+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:11:01.973178+0000","scrub_duration":0.0045948789999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.719090+0000","last_change":"2023-06-02T15:32:13.719090+0000","last_active":"2023-06-02T15:32:13.719090+0000","last_peered":"2023-06-02T15:32:13.719090+0000","last_clean":"2023-06-02T15:32:13.719090+0000","last_became_active":"2023-06-02T15:30:38.271395+0000","last_became_peered":"2023-06-02T15:30:38.271395+0000","last_unstale":"2023-06-02T15:32:13.719090+0000","last_undegraded":"2023-06-02T15:32:13.719090+0000","last_fullsized":"2023-06-02T15:32:13.719090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2023-06-02T15:32:13.718779+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2023-06-02T15:32:13.718779+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.718779+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:17.067801+0000","scrub_duration":0.0036400669999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.724985+0000","last_change":"2023-06-02T15:31:43.724985+0000","last_active":"2023-06-02T15:31:43.724985+0000","last_peered":"2023-06-02T15:31:43.724985+0000","last_clean":"2023-06-02T15:31:43.724985+0000","last_became_active":"2023-06-02T15:30:38.650456+0000","last_became_peered":"2023-06-02T15:30:38.650456+0000","last_unstale":"2023-06-02T15:31:43.724985+0000","last_undegraded":"2023-06-02T15:31:43.724985+0000","last_fullsized":"2023-06-02T15:31:43.724985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.724701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.724701+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.724701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:24.477005+0000","scrub_duration":0.0034074370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.609423+0000","last_change":"2023-06-02T15:32:03.609423+0000","last_active":"2023-06-02T15:32:03.609423+0000","last_peered":"2023-06-02T15:32:03.609423+0000","last_clean":"2023-06-02T15:32:03.609423+0000","last_became_active":"2023-06-02T15:30:42.706027+0000","last_became_peered":"2023-06-02T15:30:42.706027+0000","last_unstale":"2023-06-02T15:32:03.609423+0000","last_undegraded":"2023-06-02T15:32:03.609423+0000","last_fullsized":"2023-06-02T15:32:03.609423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.609111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.609111+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.609111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:15.258800+0000","scrub_duration":0.0036874350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.171911+0000","last_change":"2023-06-02T15:31:37.171911+0000","last_active":"2023-06-02T15:31:37.171911+0000","last_peered":"2023-06-02T15:31:37.171911+0000","last_clean":"2023-06-02T15:31:37.171911+0000","last_became_active":"2023-06-02T15:30:38.289722+0000","last_became_peered":"2023-06-02T15:30:38.289722+0000","last_unstale":"2023-06-02T15:31:37.171911+0000","last_undegraded":"2023-06-02T15:31:37.171911+0000","last_fullsized":"2023-06-02T15:31:37.171911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.171792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.171792+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.171792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:05.612504+0000","scrub_duration":0.00141092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.879735+0000","last_change":"2023-06-02T15:32:13.879735+0000","last_active":"2023-06-02T15:32:13.879735+0000","last_peered":"2023-06-02T15:32:13.879735+0000","last_clean":"2023-06-02T15:32:13.879735+0000","last_became_active":"2023-06-02T15:30:38.655586+0000","last_became_peered":"2023-06-02T15:30:38.655586+0000","last_unstale":"2023-06-02T15:32:13.879735+0000","last_undegraded":"2023-06-02T15:32:13.879735+0000","last_fullsized":"2023-06-02T15:32:13.879735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.879426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.879426+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.879426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:21.546537+0000","scrub_duration":0.003456967,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.953226+0000","last_change":"2023-06-02T15:32:16.953226+0000","last_active":"2023-06-02T15:32:16.953226+0000","last_peered":"2023-06-02T15:32:16.953226+0000","last_clean":"2023-06-02T15:32:16.953226+0000","last_became_active":"2023-06-02T15:30:42.704877+0000","last_became_peered":"2023-06-02T15:30:42.704877+0000","last_unstale":"2023-06-02T15:32:16.953226+0000","last_undegraded":"2023-06-02T15:32:16.953226+0000","last_fullsized":"2023-06-02T15:32:16.953226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.952905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.952905+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.952905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:56.711172+0000","scrub_duration":0.0040503359999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:04.775742+0000","last_change":"2023-06-02T15:32:04.775742+0000","last_active":"2023-06-02T15:32:04.775742+0000","last_peered":"2023-06-02T15:32:04.775742+0000","last_clean":"2023-06-02T15:32:04.775742+0000","last_became_active":"2023-06-02T15:30:38.272655+0000","last_became_peered":"2023-06-02T15:30:38.272655+0000","last_unstale":"2023-06-02T15:32:04.775742+0000","last_undegraded":"2023-06-02T15:32:04.775742+0000","last_fullsized":"2023-06-02T15:32:04.775742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:04.775390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:04.775390+0000","last_clean_scrub_stamp":"2023-06-02T15:32:04.775390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:09.162959+0000","scrub_duration":0.0032928110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.518146+0000","last_change":"2023-06-02T15:31:53.518146+0000","last_active":"2023-06-02T15:31:53.518146+0000","last_peered":"2023-06-02T15:31:53.518146+0000","last_clean":"2023-06-02T15:31:53.518146+0000","last_became_active":"2023-06-02T15:30:38.647168+0000","last_became_peered":"2023-06-02T15:30:38.647168+0000","last_unstale":"2023-06-02T15:31:53.518146+0000","last_undegraded":"2023-06-02T15:31:53.518146+0000","last_fullsized":"2023-06-02T15:31:53.518146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:53.517854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:53.517854+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.517854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.677151+0000","scrub_duration":0.0031286759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:39.691651+0000","last_change":"2023-06-02T15:31:39.691651+0000","last_active":"2023-06-02T15:31:39.691651+0000","last_peered":"2023-06-02T15:31:39.691651+0000","last_clean":"2023-06-02T15:31:39.691651+0000","last_became_active":"2023-06-02T15:30:38.650533+0000","last_became_peered":"2023-06-02T15:30:38.650533+0000","last_unstale":"2023-06-02T15:31:39.691651+0000","last_undegraded":"2023-06-02T15:31:39.691651+0000","last_fullsized":"2023-06-02T15:31:39.691651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:39.691303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:39.691303+0000","last_clean_scrub_stamp":"2023-06-02T15:31:39.691303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:08.670458+0000","scrub_duration":0.0032675849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:46.867109+0000","last_change":"2023-06-02T15:31:46.867109+0000","last_active":"2023-06-02T15:31:46.867109+0000","last_peered":"2023-06-02T15:31:46.867109+0000","last_clean":"2023-06-02T15:31:46.867109+0000","last_became_active":"2023-06-02T15:30:38.274061+0000","last_became_peered":"2023-06-02T15:30:38.274061+0000","last_unstale":"2023-06-02T15:31:46.867109+0000","last_undegraded":"2023-06-02T15:31:46.867109+0000","last_fullsized":"2023-06-02T15:31:46.867109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:46.866803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:46.866803+0000","last_clean_scrub_stamp":"2023-06-02T15:31:46.866803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:27.619106+0000","scrub_duration":0.0038372440000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:12.762960+0000","last_change":"2023-06-02T15:32:12.762960+0000","last_active":"2023-06-02T15:32:12.762960+0000","last_peered":"2023-06-02T15:32:12.762960+0000","last_clean":"2023-06-02T15:32:12.762960+0000","last_became_active":"2023-06-02T15:30:42.709109+0000","last_became_peered":"2023-06-02T15:30:42.709109+0000","last_unstale":"2023-06-02T15:32:12.762960+0000","last_undegraded":"2023-06-02T15:32:12.762960+0000","last_fullsized":"2023-06-02T15:32:12.762960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:12.762690+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:12.762690+0000","last_clean_scrub_stamp":"2023-06-02T15:32:12.762690+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:37.440741+0000","scrub_duration":0.0035931549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:06.764696+0000","last_change":"2023-06-02T15:32:06.764696+0000","last_active":"2023-06-02T15:32:06.764696+0000","last_peered":"2023-06-02T15:32:06.764696+0000","last_clean":"2023-06-02T15:32:06.764696+0000","last_became_active":"2023-06-02T15:30:38.656451+0000","last_became_peered":"2023-06-02T15:30:38.656451+0000","last_unstale":"2023-06-02T15:32:06.764696+0000","last_undegraded":"2023-06-02T15:32:06.764696+0000","last_fullsized":"2023-06-02T15:32:06.764696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:06.764295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:06.764295+0000","last_clean_scrub_stamp":"2023-06-02T15:32:06.764295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:01.519486+0000","scrub_duration":0.0036305719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:46.537878+0000","last_change":"2023-06-02T15:31:46.537878+0000","last_active":"2023-06-02T15:31:46.537878+0000","last_peered":"2023-06-02T15:31:46.537878+0000","last_clean":"2023-06-02T15:31:46.537878+0000","last_became_active":"2023-06-02T15:30:38.274590+0000","last_became_peered":"2023-06-02T15:30:38.274590+0000","last_unstale":"2023-06-02T15:31:46.537878+0000","last_undegraded":"2023-06-02T15:31:46.537878+0000","last_fullsized":"2023-06-02T15:31:46.537878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:46.537583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:46.537583+0000","last_clean_scrub_stamp":"2023-06-02T15:31:46.537583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:57.696880+0000","scrub_duration":0.0033143180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:13.135793+0000","last_change":"2023-06-02T15:32:13.135793+0000","last_active":"2023-06-02T15:32:13.135793+0000","last_peered":"2023-06-02T15:32:13.135793+0000","last_clean":"2023-06-02T15:32:13.135793+0000","last_became_active":"2023-06-02T15:30:42.705736+0000","last_became_peered":"2023-06-02T15:30:42.705736+0000","last_unstale":"2023-06-02T15:32:13.135793+0000","last_undegraded":"2023-06-02T15:32:13.135793+0000","last_fullsized":"2023-06-02T15:32:13.135793+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:13.135430+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:13.135430+0000","last_clean_scrub_stamp":"2023-06-02T15:32:13.135430+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:20.802541+0000","scrub_duration":0.0040929599999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.15","version":"27'5","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.000867+0000","last_change":"2023-06-02T15:31:44.000867+0000","last_active":"2023-06-02T15:31:44.000867+0000","last_peered":"2023-06-02T15:31:44.000867+0000","last_clean":"2023-06-02T15:31:44.000867+0000","last_became_active":"2023-06-02T15:30:38.289267+0000","last_became_peered":"2023-06-02T15:30:38.289267+0000","last_unstale":"2023-06-02T15:31:44.000867+0000","last_undegraded":"2023-06-02T15:31:44.000867+0000","last_fullsized":"2023-06-02T15:31:44.000867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2023-06-02T15:31:44.000570+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2023-06-02T15:31:44.000570+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.000570+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:12.979725+0000","scrub_duration":0.0085722809999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:07.319836+0000","last_change":"2023-06-02T15:32:07.319836+0000","last_active":"2023-06-02T15:32:07.319836+0000","last_peered":"2023-06-02T15:32:07.319836+0000","last_clean":"2023-06-02T15:32:07.319836+0000","last_became_active":"2023-06-02T15:30:38.642510+0000","last_became_peered":"2023-06-02T15:30:38.642510+0000","last_unstale":"2023-06-02T15:32:07.319836+0000","last_undegraded":"2023-06-02T15:32:07.319836+0000","last_fullsized":"2023-06-02T15:32:07.319836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:07.319552+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:07.319552+0000","last_clean_scrub_stamp":"2023-06-02T15:32:07.319552+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:37.767754+0000","scrub_duration":0.0036772110000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:27.685321+0000","last_change":"2023-06-02T15:32:27.685321+0000","last_active":"2023-06-02T15:32:27.685321+0000","last_peered":"2023-06-02T15:32:27.685321+0000","last_clean":"2023-06-02T15:32:27.685321+0000","last_became_active":"2023-06-02T15:30:42.720142+0000","last_became_peered":"2023-06-02T15:30:42.720142+0000","last_unstale":"2023-06-02T15:32:27.685321+0000","last_undegraded":"2023-06-02T15:32:27.685321+0000","last_fullsized":"2023-06-02T15:32:27.685321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:27.684926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:27.684926+0000","last_clean_scrub_stamp":"2023-06-02T15:32:27.684926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:02:57.805759+0000","scrub_duration":0.0043116439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.14","version":"27'19","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.805341+0000","last_change":"2023-06-02T15:32:08.805341+0000","last_active":"2023-06-02T15:32:08.805341+0000","last_peered":"2023-06-02T15:32:08.805341+0000","last_clean":"2023-06-02T15:32:08.805341+0000","last_became_active":"2023-06-02T15:30:38.276017+0000","last_became_peered":"2023-06-02T15:30:38.276017+0000","last_unstale":"2023-06-02T15:32:08.805341+0000","last_undegraded":"2023-06-02T15:32:08.805341+0000","last_fullsized":"2023-06-02T15:32:08.805341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'19","last_scrub_stamp":"2023-06-02T15:32:08.805041+0000","last_deep_scrub":"27'19","last_deep_scrub_stamp":"2023-06-02T15:32:08.805041+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.805041+0000","objects_scrubbed":4,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:48.563308+0000","scrub_duration":0.01113798,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4904,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.873928+0000","last_change":"2023-06-02T15:32:03.873928+0000","last_active":"2023-06-02T15:32:03.873928+0000","last_peered":"2023-06-02T15:32:03.873928+0000","last_clean":"2023-06-02T15:32:03.873928+0000","last_became_active":"2023-06-02T15:30:38.634126+0000","last_became_peered":"2023-06-02T15:30:38.634126+0000","last_unstale":"2023-06-02T15:32:03.873928+0000","last_undegraded":"2023-06-02T15:32:03.873928+0000","last_fullsized":"2023-06-02T15:32:03.873928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.873651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.873651+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.873651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:07:58.628843+0000","scrub_duration":0.0075517730000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:15.379438+0000","last_change":"2023-06-02T15:32:15.379438+0000","last_active":"2023-06-02T15:32:15.379438+0000","last_peered":"2023-06-02T15:32:15.379438+0000","last_clean":"2023-06-02T15:32:15.379438+0000","last_became_active":"2023-06-02T15:30:42.706186+0000","last_became_peered":"2023-06-02T15:30:42.706186+0000","last_unstale":"2023-06-02T15:32:15.379438+0000","last_undegraded":"2023-06-02T15:32:15.379438+0000","last_fullsized":"2023-06-02T15:32:15.379438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:15.379039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:15.379039+0000","last_clean_scrub_stamp":"2023-06-02T15:32:15.379039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:10.134230+0000","scrub_duration":0.0041123649999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.270419+0000","last_change":"2023-06-02T15:31:51.270419+0000","last_active":"2023-06-02T15:31:51.270419+0000","last_peered":"2023-06-02T15:31:51.270419+0000","last_clean":"2023-06-02T15:31:51.270419+0000","last_became_active":"2023-06-02T15:30:38.648984+0000","last_became_peered":"2023-06-02T15:30:38.648984+0000","last_unstale":"2023-06-02T15:31:51.270419+0000","last_undegraded":"2023-06-02T15:31:51.270419+0000","last_fullsized":"2023-06-02T15:31:51.270419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.270125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.270125+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.270125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:30:00.974864+0000","scrub_duration":0.0038244239999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.494671+0000","last_change":"2023-06-02T15:31:41.494671+0000","last_active":"2023-06-02T15:31:41.494671+0000","last_peered":"2023-06-02T15:31:41.494671+0000","last_clean":"2023-06-02T15:31:41.494671+0000","last_became_active":"2023-06-02T15:30:33.406453+0000","last_became_peered":"2023-06-02T15:30:33.406453+0000","last_unstale":"2023-06-02T15:31:41.494671+0000","last_undegraded":"2023-06-02T15:31:41.494671+0000","last_fullsized":"2023-06-02T15:31:41.494671+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.494318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.494318+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.494318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:09.935029+0000","scrub_duration":0.0040292009999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:49.597169+0000","last_change":"2023-06-02T15:31:49.597169+0000","last_active":"2023-06-02T15:31:49.597169+0000","last_peered":"2023-06-02T15:31:49.597169+0000","last_clean":"2023-06-02T15:31:49.597169+0000","last_became_active":"2023-06-02T15:30:38.278219+0000","last_became_peered":"2023-06-02T15:30:38.278219+0000","last_unstale":"2023-06-02T15:31:49.597169+0000","last_undegraded":"2023-06-02T15:31:49.597169+0000","last_fullsized":"2023-06-02T15:31:49.597169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:49.596840+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:49.596840+0000","last_clean_scrub_stamp":"2023-06-02T15:31:49.596840+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:44.704735+0000","scrub_duration":0.0034677010000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.886646+0000","last_change":"2023-06-02T15:32:14.886646+0000","last_active":"2023-06-02T15:32:14.886646+0000","last_peered":"2023-06-02T15:32:14.886646+0000","last_clean":"2023-06-02T15:32:14.886646+0000","last_became_active":"2023-06-02T15:30:42.715401+0000","last_became_peered":"2023-06-02T15:30:42.715401+0000","last_unstale":"2023-06-02T15:32:14.886646+0000","last_undegraded":"2023-06-02T15:32:14.886646+0000","last_fullsized":"2023-06-02T15:32:14.886646+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.886241+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.886241+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.886241+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:34.203061+0000","scrub_duration":0.0039836819999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.999085+0000","last_change":"2023-06-02T15:32:05.999085+0000","last_active":"2023-06-02T15:32:05.999085+0000","last_peered":"2023-06-02T15:32:05.999085+0000","last_clean":"2023-06-02T15:32:05.999085+0000","last_became_active":"2023-06-02T15:30:38.631550+0000","last_became_peered":"2023-06-02T15:30:38.631550+0000","last_unstale":"2023-06-02T15:32:05.999085+0000","last_undegraded":"2023-06-02T15:32:05.999085+0000","last_fullsized":"2023-06-02T15:32:05.999085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.998798+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.998798+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.998798+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:36.447000+0000","scrub_duration":0.0035371059999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:39.527934+0000","last_change":"2023-06-02T15:31:39.527934+0000","last_active":"2023-06-02T15:31:39.527934+0000","last_peered":"2023-06-02T15:31:39.527934+0000","last_clean":"2023-06-02T15:31:39.527934+0000","last_became_active":"2023-06-02T15:30:33.654664+0000","last_became_peered":"2023-06-02T15:30:33.654664+0000","last_unstale":"2023-06-02T15:31:39.527934+0000","last_undegraded":"2023-06-02T15:31:39.527934+0000","last_fullsized":"2023-06-02T15:31:39.527934+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:39.527621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:39.527621+0000","last_clean_scrub_stamp":"2023-06-02T15:31:39.527621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:31:08.870956+0000","scrub_duration":0.0040577269999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.314179+0000","last_change":"2023-06-02T15:31:48.314179+0000","last_active":"2023-06-02T15:31:48.314179+0000","last_peered":"2023-06-02T15:31:48.314179+0000","last_clean":"2023-06-02T15:31:48.314179+0000","last_became_active":"2023-06-02T15:30:38.276700+0000","last_became_peered":"2023-06-02T15:30:38.276700+0000","last_unstale":"2023-06-02T15:31:48.314179+0000","last_undegraded":"2023-06-02T15:31:48.314179+0000","last_fullsized":"2023-06-02T15:31:48.314179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.313862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.313862+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.313862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:19:57.371808+0000","scrub_duration":0.003324671,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:08.724804+0000","last_change":"2023-06-02T15:32:08.724804+0000","last_active":"2023-06-02T15:32:08.724804+0000","last_peered":"2023-06-02T15:32:08.724804+0000","last_clean":"2023-06-02T15:32:08.724804+0000","last_became_active":"2023-06-02T15:30:42.697990+0000","last_became_peered":"2023-06-02T15:30:42.697990+0000","last_unstale":"2023-06-02T15:32:08.724804+0000","last_undegraded":"2023-06-02T15:32:08.724804+0000","last_fullsized":"2023-06-02T15:32:08.724804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:08.724428+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:08.724428+0000","last_clean_scrub_stamp":"2023-06-02T15:32:08.724428+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:39.172630+0000","scrub_duration":0.0040007369999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:40.702502+0000","last_change":"2023-06-02T15:31:40.702502+0000","last_active":"2023-06-02T15:31:40.702502+0000","last_peered":"2023-06-02T15:31:40.702502+0000","last_clean":"2023-06-02T15:31:40.702502+0000","last_became_active":"2023-06-02T15:30:38.656052+0000","last_became_peered":"2023-06-02T15:30:38.656052+0000","last_unstale":"2023-06-02T15:31:40.702502+0000","last_undegraded":"2023-06-02T15:31:40.702502+0000","last_fullsized":"2023-06-02T15:31:40.702502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:40.702183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:40.702183+0000","last_clean_scrub_stamp":"2023-06-02T15:31:40.702183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:17.405756+0000","scrub_duration":0.0083223120000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.826457+0000","last_change":"2023-06-02T15:32:05.826457+0000","last_active":"2023-06-02T15:32:05.826457+0000","last_peered":"2023-06-02T15:32:05.826457+0000","last_clean":"2023-06-02T15:32:05.826457+0000","last_became_active":"2023-06-02T15:30:33.958891+0000","last_became_peered":"2023-06-02T15:30:33.958891+0000","last_unstale":"2023-06-02T15:32:05.826457+0000","last_undegraded":"2023-06-02T15:32:05.826457+0000","last_fullsized":"2023-06-02T15:32:05.826457+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.826140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.826140+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.826140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:13.493251+0000","scrub_duration":0.0034698720000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.692667+0000","last_change":"2023-06-02T15:32:00.692667+0000","last_active":"2023-06-02T15:32:00.692667+0000","last_peered":"2023-06-02T15:32:00.692667+0000","last_clean":"2023-06-02T15:32:00.692667+0000","last_became_active":"2023-06-02T15:30:38.274258+0000","last_became_peered":"2023-06-02T15:30:38.274258+0000","last_unstale":"2023-06-02T15:32:00.692667+0000","last_undegraded":"2023-06-02T15:32:00.692667+0000","last_fullsized":"2023-06-02T15:32:00.692667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:32:00.692346+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:32:00.692346+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.692346+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:31.140548+0000","scrub_duration":0.0085621840000000005,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:56.799130+0000","last_change":"2023-06-02T15:32:56.799493+0000","last_active":"2023-06-02T15:32:56.799130+0000","last_peered":"2023-06-02T15:32:56.799130+0000","last_clean":"2023-06-02T15:32:56.799130+0000","last_became_active":"2023-06-02T15:30:42.708671+0000","last_became_peered":"2023-06-02T15:30:42.708671+0000","last_unstale":"2023-06-02T15:32:56.799130+0000","last_undegraded":"2023-06-02T15:32:56.799130+0000","last_fullsized":"2023-06-02T15:32:56.799130+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:56.799071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:56.799071+0000","last_clean_scrub_stamp":"2023-06-02T15:32:56.799071+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:06:24.230535+0000","scrub_duration":0.0042619700000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.850871+0000","last_change":"2023-06-02T15:32:00.850871+0000","last_active":"2023-06-02T15:32:00.850871+0000","last_peered":"2023-06-02T15:32:00.850871+0000","last_clean":"2023-06-02T15:32:00.850871+0000","last_became_active":"2023-06-02T15:30:38.645627+0000","last_became_peered":"2023-06-02T15:30:38.645627+0000","last_unstale":"2023-06-02T15:32:00.850871+0000","last_undegraded":"2023-06-02T15:32:00.850871+0000","last_fullsized":"2023-06-02T15:32:00.850871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:00.850599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:00.850599+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.850599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:25.528650+0000","scrub_duration":0.0036098129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:49.712018+0000","last_change":"2023-06-02T15:31:49.712018+0000","last_active":"2023-06-02T15:31:49.712018+0000","last_peered":"2023-06-02T15:31:49.712018+0000","last_clean":"2023-06-02T15:31:49.712018+0000","last_became_active":"2023-06-02T15:30:33.413135+0000","last_became_peered":"2023-06-02T15:30:33.413135+0000","last_unstale":"2023-06-02T15:31:49.712018+0000","last_undegraded":"2023-06-02T15:31:49.712018+0000","last_fullsized":"2023-06-02T15:31:49.712018+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:49.711487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:49.711487+0000","last_clean_scrub_stamp":"2023-06-02T15:31:49.711487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:29.311495+0000","scrub_duration":0.0044216419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:42.817844+0000","last_change":"2023-06-02T15:31:42.817844+0000","last_active":"2023-06-02T15:31:42.817844+0000","last_peered":"2023-06-02T15:31:42.817844+0000","last_clean":"2023-06-02T15:31:42.817844+0000","last_became_active":"2023-06-02T15:30:38.270392+0000","last_became_peered":"2023-06-02T15:30:38.270392+0000","last_unstale":"2023-06-02T15:31:42.817844+0000","last_undegraded":"2023-06-02T15:31:42.817844+0000","last_fullsized":"2023-06-02T15:31:42.817844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:31:42.817550+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:31:42.817550+0000","last_clean_scrub_stamp":"2023-06-02T15:31:42.817550+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:11.796705+0000","scrub_duration":0.0085183749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.742059+0000","last_change":"2023-06-02T15:32:16.742059+0000","last_active":"2023-06-02T15:32:16.742059+0000","last_peered":"2023-06-02T15:32:16.742059+0000","last_clean":"2023-06-02T15:32:16.742059+0000","last_became_active":"2023-06-02T15:30:42.700787+0000","last_became_peered":"2023-06-02T15:30:42.700787+0000","last_unstale":"2023-06-02T15:32:16.742059+0000","last_undegraded":"2023-06-02T15:32:16.742059+0000","last_fullsized":"2023-06-02T15:32:16.742059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.741672+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.741672+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.741672+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:20.090695+0000","scrub_duration":0.004709123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:35.675333+0000","last_change":"2023-06-02T15:31:35.675333+0000","last_active":"2023-06-02T15:31:35.675333+0000","last_peered":"2023-06-02T15:31:35.675333+0000","last_clean":"2023-06-02T15:31:35.675333+0000","last_became_active":"2023-06-02T15:30:38.642019+0000","last_became_peered":"2023-06-02T15:30:38.642019+0000","last_unstale":"2023-06-02T15:31:35.675333+0000","last_undegraded":"2023-06-02T15:31:35.675333+0000","last_fullsized":"2023-06-02T15:31:35.675333+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:35.675220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:35.675220+0000","last_clean_scrub_stamp":"2023-06-02T15:31:35.675220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:46:41.873628+0000","scrub_duration":0.001699594,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.893605+0000","last_change":"2023-06-02T15:31:51.893605+0000","last_active":"2023-06-02T15:31:51.893605+0000","last_peered":"2023-06-02T15:31:51.893605+0000","last_clean":"2023-06-02T15:31:51.893605+0000","last_became_active":"2023-06-02T15:30:38.263199+0000","last_became_peered":"2023-06-02T15:30:38.263199+0000","last_unstale":"2023-06-02T15:31:51.893605+0000","last_undegraded":"2023-06-02T15:31:51.893605+0000","last_fullsized":"2023-06-02T15:31:51.893605+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.893317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.893317+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.893317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:03.052614+0000","scrub_duration":0.0037955900000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"27'119","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.046295+0000","last_change":"2023-06-02T15:31:53.046295+0000","last_active":"2023-06-02T15:31:53.046295+0000","last_peered":"2023-06-02T15:31:53.046295+0000","last_clean":"2023-06-02T15:31:53.046295+0000","last_became_active":"2023-06-02T15:30:34.411670+0000","last_became_peered":"2023-06-02T15:30:34.411670+0000","last_unstale":"2023-06-02T15:31:53.046295+0000","last_undegraded":"2023-06-02T15:31:53.046295+0000","last_fullsized":"2023-06-02T15:31:53.046295+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2023-06-02T15:31:53.045988+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2023-06-02T15:31:53.045988+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.045988+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.205286+0000","scrub_duration":0.014250489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:36.176680+0000","last_change":"2023-06-02T15:31:36.176680+0000","last_active":"2023-06-02T15:31:36.176680+0000","last_peered":"2023-06-02T15:31:36.176680+0000","last_clean":"2023-06-02T15:31:36.176680+0000","last_became_active":"2023-06-02T15:30:33.411640+0000","last_became_peered":"2023-06-02T15:30:33.411640+0000","last_unstale":"2023-06-02T15:31:36.176680+0000","last_undegraded":"2023-06-02T15:31:36.176680+0000","last_fullsized":"2023-06-02T15:31:36.176680+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:36.176579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:36.176579+0000","last_clean_scrub_stamp":"2023-06-02T15:31:36.176579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:31:05.519914+0000","scrub_duration":0.0032385439999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:30.351352+0000","last_change":"2023-06-02T15:32:30.351352+0000","last_active":"2023-06-02T15:32:30.351352+0000","last_peered":"2023-06-02T15:32:30.351352+0000","last_clean":"2023-06-02T15:32:30.351352+0000","last_became_active":"2023-06-02T15:30:42.710147+0000","last_became_peered":"2023-06-02T15:30:42.710147+0000","last_unstale":"2023-06-02T15:32:30.351352+0000","last_undegraded":"2023-06-02T15:32:30.351352+0000","last_fullsized":"2023-06-02T15:32:30.351352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:30.350951+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:30.350951+0000","last_clean_scrub_stamp":"2023-06-02T15:32:30.350951+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:03:00.471783+0000","scrub_duration":0.0043598769999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.306444+0000","last_change":"2023-06-02T15:31:55.306444+0000","last_active":"2023-06-02T15:31:55.306444+0000","last_peered":"2023-06-02T15:31:55.306444+0000","last_clean":"2023-06-02T15:31:55.306444+0000","last_became_active":"2023-06-02T15:30:38.649584+0000","last_became_peered":"2023-06-02T15:30:38.649584+0000","last_unstale":"2023-06-02T15:31:55.306444+0000","last_undegraded":"2023-06-02T15:31:55.306444+0000","last_fullsized":"2023-06-02T15:31:55.306444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:55.306148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:55.306148+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.306148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.414043+0000","scrub_duration":0.0036463979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.316509+0000","last_change":"2023-06-02T15:31:43.316509+0000","last_active":"2023-06-02T15:31:43.316509+0000","last_peered":"2023-06-02T15:31:43.316509+0000","last_clean":"2023-06-02T15:31:43.316509+0000","last_became_active":"2023-06-02T15:30:38.269308+0000","last_became_peered":"2023-06-02T15:30:38.269308+0000","last_unstale":"2023-06-02T15:31:43.316509+0000","last_undegraded":"2023-06-02T15:31:43.316509+0000","last_fullsized":"2023-06-02T15:31:43.316509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.316233+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.316233+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.316233+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:55:51.972560+0000","scrub_duration":0.0081781270000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.031260+0000","last_change":"2023-06-02T15:31:45.031260+0000","last_active":"2023-06-02T15:31:45.031260+0000","last_peered":"2023-06-02T15:31:45.031260+0000","last_clean":"2023-06-02T15:31:45.031260+0000","last_became_active":"2023-06-02T15:30:33.654336+0000","last_became_peered":"2023-06-02T15:30:33.654336+0000","last_unstale":"2023-06-02T15:31:45.031260+0000","last_undegraded":"2023-06-02T15:31:45.031260+0000","last_fullsized":"2023-06-02T15:31:45.031260+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.030964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.030964+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.030964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:21.734537+0000","scrub_duration":0.0035987649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.736848+0000","last_change":"2023-06-02T15:31:55.736848+0000","last_active":"2023-06-02T15:31:55.736848+0000","last_peered":"2023-06-02T15:31:55.736848+0000","last_clean":"2023-06-02T15:31:55.736848+0000","last_became_active":"2023-06-02T15:30:42.704609+0000","last_became_peered":"2023-06-02T15:30:42.704609+0000","last_unstale":"2023-06-02T15:31:55.736848+0000","last_undegraded":"2023-06-02T15:31:55.736848+0000","last_fullsized":"2023-06-02T15:31:55.736848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:55.736507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:55.736507+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.736507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.844402+0000","scrub_duration":0.004192884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.289872+0000","last_change":"2023-06-02T15:31:52.289872+0000","last_active":"2023-06-02T15:31:52.289872+0000","last_peered":"2023-06-02T15:31:52.289872+0000","last_clean":"2023-06-02T15:31:52.289872+0000","last_became_active":"2023-06-02T15:30:38.639934+0000","last_became_peered":"2023-06-02T15:30:38.639934+0000","last_unstale":"2023-06-02T15:31:52.289872+0000","last_undegraded":"2023-06-02T15:31:52.289872+0000","last_fullsized":"2023-06-02T15:31:52.289872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.289531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.289531+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.289531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:03.448828+0000","scrub_duration":0.0032206029999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:24.859872+0000","last_change":"2023-06-02T15:32:24.859872+0000","last_active":"2023-06-02T15:32:24.859872+0000","last_peered":"2023-06-02T15:32:24.859872+0000","last_clean":"2023-06-02T15:32:24.859872+0000","last_became_active":"2023-06-02T15:30:38.256812+0000","last_became_peered":"2023-06-02T15:30:38.256812+0000","last_unstale":"2023-06-02T15:32:24.859872+0000","last_undegraded":"2023-06-02T15:32:24.859872+0000","last_fullsized":"2023-06-02T15:32:24.859872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:24.859585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:24.859585+0000","last_clean_scrub_stamp":"2023-06-02T15:32:24.859585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:02:54.980417+0000","scrub_duration":0.003862814,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.531411+0000","last_change":"2023-06-02T15:31:45.531411+0000","last_active":"2023-06-02T15:31:45.531411+0000","last_peered":"2023-06-02T15:31:45.531411+0000","last_clean":"2023-06-02T15:31:45.531411+0000","last_became_active":"2023-06-02T15:30:33.654561+0000","last_became_peered":"2023-06-02T15:30:33.654561+0000","last_unstale":"2023-06-02T15:31:45.531411+0000","last_undegraded":"2023-06-02T15:31:45.531411+0000","last_fullsized":"2023-06-02T15:31:45.531411+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.531079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.531079+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.531079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:29:55.235818+0000","scrub_duration":0.0038552180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:21.924439+0000","last_change":"2023-06-02T15:32:21.924439+0000","last_active":"2023-06-02T15:32:21.924439+0000","last_peered":"2023-06-02T15:32:21.924439+0000","last_clean":"2023-06-02T15:32:21.924439+0000","last_became_active":"2023-06-02T15:30:42.693039+0000","last_became_peered":"2023-06-02T15:30:42.693039+0000","last_unstale":"2023-06-02T15:32:21.924439+0000","last_undegraded":"2023-06-02T15:32:21.924439+0000","last_fullsized":"2023-06-02T15:32:21.924439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:21.924109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:21.924109+0000","last_clean_scrub_stamp":"2023-06-02T15:32:21.924109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:25.273132+0000","scrub_duration":0.0041237380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.555827+0000","last_change":"2023-06-02T15:31:52.555827+0000","last_active":"2023-06-02T15:31:52.555827+0000","last_peered":"2023-06-02T15:31:52.555827+0000","last_clean":"2023-06-02T15:31:52.555827+0000","last_became_active":"2023-06-02T15:30:38.645178+0000","last_became_peered":"2023-06-02T15:30:38.645178+0000","last_unstale":"2023-06-02T15:31:52.555827+0000","last_undegraded":"2023-06-02T15:31:52.555827+0000","last_fullsized":"2023-06-02T15:31:52.555827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.555485+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.555485+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.555485+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:30:02.260224+0000","scrub_duration":0.0031645419999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:58.638743+0000","last_change":"2023-06-02T15:31:58.638743+0000","last_active":"2023-06-02T15:31:58.638743+0000","last_peered":"2023-06-02T15:31:58.638743+0000","last_clean":"2023-06-02T15:31:58.638743+0000","last_became_active":"2023-06-02T15:30:38.275855+0000","last_became_peered":"2023-06-02T15:30:38.275855+0000","last_unstale":"2023-06-02T15:31:58.638743+0000","last_undegraded":"2023-06-02T15:31:58.638743+0000","last_fullsized":"2023-06-02T15:31:58.638743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:58.638110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:58.638110+0000","last_clean_scrub_stamp":"2023-06-02T15:31:58.638110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:51.247160+0000","scrub_duration":0.0035255070000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.102141+0000","last_change":"2023-06-02T15:31:48.102141+0000","last_active":"2023-06-02T15:31:48.102141+0000","last_peered":"2023-06-02T15:31:48.102141+0000","last_clean":"2023-06-02T15:31:48.102141+0000","last_became_active":"2023-06-02T15:30:33.653626+0000","last_became_peered":"2023-06-02T15:30:33.653626+0000","last_unstale":"2023-06-02T15:31:48.102141+0000","last_undegraded":"2023-06-02T15:31:48.102141+0000","last_fullsized":"2023-06-02T15:31:48.102141+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.101830+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.101830+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.101830+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:28.854133+0000","scrub_duration":0.0082640209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:14.095296+0000","last_change":"2023-06-02T15:32:14.095296+0000","last_active":"2023-06-02T15:32:14.095296+0000","last_peered":"2023-06-02T15:32:14.095296+0000","last_clean":"2023-06-02T15:32:14.095296+0000","last_became_active":"2023-06-02T15:30:42.722064+0000","last_became_peered":"2023-06-02T15:30:42.722064+0000","last_unstale":"2023-06-02T15:32:14.095296+0000","last_undegraded":"2023-06-02T15:32:14.095296+0000","last_fullsized":"2023-06-02T15:32:14.095296+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:14.094929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:14.094929+0000","last_clean_scrub_stamp":"2023-06-02T15:32:14.094929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:33.411749+0000","scrub_duration":0.0041825120000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.841653+0000","last_change":"2023-06-02T15:32:02.841867+0000","last_active":"2023-06-02T15:32:02.841653+0000","last_peered":"2023-06-02T15:32:02.841653+0000","last_clean":"2023-06-02T15:32:02.841653+0000","last_became_active":"2023-06-02T15:31:26.758308+0000","last_became_peered":"2023-06-02T15:31:26.758308+0000","last_unstale":"2023-06-02T15:32:02.841653+0000","last_undegraded":"2023-06-02T15:32:02.841653+0000","last_fullsized":"2023-06-02T15:32:02.841653+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.841598+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.841598+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.841598+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.491288+0000","scrub_duration":0.0031874889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:52.727371+0000","last_change":"2023-06-02T15:31:52.727371+0000","last_active":"2023-06-02T15:31:52.727371+0000","last_peered":"2023-06-02T15:31:52.727371+0000","last_clean":"2023-06-02T15:31:52.727371+0000","last_became_active":"2023-06-02T15:30:38.281413+0000","last_became_peered":"2023-06-02T15:30:38.281413+0000","last_unstale":"2023-06-02T15:31:52.727371+0000","last_undegraded":"2023-06-02T15:31:52.727371+0000","last_fullsized":"2023-06-02T15:31:52.727371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:52.727078+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:52.727078+0000","last_clean_scrub_stamp":"2023-06-02T15:31:52.727078+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:38.560342+0000","scrub_duration":0.003683974,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:59.759802+0000","last_change":"2023-06-02T15:32:59.760152+0000","last_active":"2023-06-02T15:32:59.759802+0000","last_peered":"2023-06-02T15:32:59.759802+0000","last_clean":"2023-06-02T15:32:59.759802+0000","last_became_active":"2023-06-02T15:30:42.697869+0000","last_became_peered":"2023-06-02T15:30:42.697869+0000","last_unstale":"2023-06-02T15:32:59.759802+0000","last_undegraded":"2023-06-02T15:32:59.759802+0000","last_fullsized":"2023-06-02T15:32:59.759802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:59.759697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:59.759697+0000","last_clean_scrub_stamp":"2023-06-02T15:32:59.759697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:59:00.496289+0000","scrub_duration":0.0040207580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:26.804050+0000","last_change":"2023-06-02T15:32:26.804050+0000","last_active":"2023-06-02T15:32:26.804050+0000","last_peered":"2023-06-02T15:32:26.804050+0000","last_clean":"2023-06-02T15:32:26.804050+0000","last_became_active":"2023-06-02T15:30:38.638372+0000","last_became_peered":"2023-06-02T15:30:38.638372+0000","last_unstale":"2023-06-02T15:32:26.804050+0000","last_undegraded":"2023-06-02T15:32:26.804050+0000","last_fullsized":"2023-06-02T15:32:26.804050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:26.803750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:26.803750+0000","last_clean_scrub_stamp":"2023-06-02T15:32:26.803750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:16:25.542468+0000","scrub_duration":0.0037377830000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:06.778522+0000","last_change":"2023-06-02T15:32:06.778522+0000","last_active":"2023-06-02T15:32:06.778522+0000","last_peered":"2023-06-02T15:32:06.778522+0000","last_clean":"2023-06-02T15:32:06.778522+0000","last_became_active":"2023-06-02T15:30:38.268863+0000","last_became_peered":"2023-06-02T15:30:38.268863+0000","last_unstale":"2023-06-02T15:32:06.778522+0000","last_undegraded":"2023-06-02T15:32:06.778522+0000","last_fullsized":"2023-06-02T15:32:06.778522+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:06.778176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:06.778176+0000","last_clean_scrub_stamp":"2023-06-02T15:32:06.778176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:26.094996+0000","scrub_duration":0.0036399050000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:33.344441+0000","last_change":"2023-06-02T15:32:33.344441+0000","last_active":"2023-06-02T15:32:33.344441+0000","last_peered":"2023-06-02T15:32:33.344441+0000","last_clean":"2023-06-02T15:32:33.344441+0000","last_became_active":"2023-06-02T15:30:42.711444+0000","last_became_peered":"2023-06-02T15:30:42.711444+0000","last_unstale":"2023-06-02T15:32:33.344441+0000","last_undegraded":"2023-06-02T15:32:33.344441+0000","last_fullsized":"2023-06-02T15:32:33.344441+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:33.344053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:33.344053+0000","last_clean_scrub_stamp":"2023-06-02T15:32:33.344053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:16:32.082771+0000","scrub_duration":0.0043976019999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:30.769731+0000","last_change":"2023-06-02T15:32:30.769731+0000","last_active":"2023-06-02T15:32:30.769731+0000","last_peered":"2023-06-02T15:32:30.769731+0000","last_clean":"2023-06-02T15:32:30.769731+0000","last_became_active":"2023-06-02T15:30:38.636160+0000","last_became_peered":"2023-06-02T15:30:38.636160+0000","last_unstale":"2023-06-02T15:32:30.769731+0000","last_undegraded":"2023-06-02T15:32:30.769731+0000","last_fullsized":"2023-06-02T15:32:30.769731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:30.769418+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:30.769418+0000","last_clean_scrub_stamp":"2023-06-02T15:32:30.769418+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:19:14.692332+0000","scrub_duration":0.0035215419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.525640+0000","last_change":"2023-06-02T15:31:45.525640+0000","last_active":"2023-06-02T15:31:45.525640+0000","last_peered":"2023-06-02T15:31:45.525640+0000","last_clean":"2023-06-02T15:31:45.525640+0000","last_became_active":"2023-06-02T15:30:38.276331+0000","last_became_peered":"2023-06-02T15:30:38.276331+0000","last_unstale":"2023-06-02T15:31:45.525640+0000","last_undegraded":"2023-06-02T15:31:45.525640+0000","last_fullsized":"2023-06-02T15:31:45.525640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.525308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.525308+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.525308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:22.228881+0000","scrub_duration":0.0032755190000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:18.292124+0000","last_change":"2023-06-02T15:32:18.292124+0000","last_active":"2023-06-02T15:32:18.292124+0000","last_peered":"2023-06-02T15:32:18.292124+0000","last_clean":"2023-06-02T15:32:18.292124+0000","last_became_active":"2023-06-02T15:30:42.696852+0000","last_became_peered":"2023-06-02T15:30:42.696852+0000","last_unstale":"2023-06-02T15:32:18.292124+0000","last_undegraded":"2023-06-02T15:32:18.292124+0000","last_fullsized":"2023-06-02T15:32:18.292124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:18.291730+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:18.291730+0000","last_clean_scrub_stamp":"2023-06-02T15:32:18.291730+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:37.608551+0000","scrub_duration":0.0039707090000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:27.822771+0000","last_change":"2023-06-02T15:32:27.822771+0000","last_active":"2023-06-02T15:32:27.822771+0000","last_peered":"2023-06-02T15:32:27.822771+0000","last_clean":"2023-06-02T15:32:27.822771+0000","last_became_active":"2023-06-02T15:30:38.639179+0000","last_became_peered":"2023-06-02T15:30:38.639179+0000","last_unstale":"2023-06-02T15:32:27.822771+0000","last_undegraded":"2023-06-02T15:32:27.822771+0000","last_fullsized":"2023-06-02T15:32:27.822771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:27.822452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:27.822452+0000","last_clean_scrub_stamp":"2023-06-02T15:32:27.822452+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:01:53.214163+0000","scrub_duration":0.003855701,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.682215+0000","last_change":"2023-06-02T15:31:57.682215+0000","last_active":"2023-06-02T15:31:57.682215+0000","last_peered":"2023-06-02T15:31:57.682215+0000","last_clean":"2023-06-02T15:31:57.682215+0000","last_became_active":"2023-06-02T15:30:38.273410+0000","last_became_peered":"2023-06-02T15:30:38.273410+0000","last_unstale":"2023-06-02T15:31:57.682215+0000","last_undegraded":"2023-06-02T15:31:57.682215+0000","last_fullsized":"2023-06-02T15:31:57.682215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:31:57.681867+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:31:57.681867+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.681867+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:09.331557+0000","scrub_duration":0.0066385239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:54.709526+0000","last_change":"2023-06-02T15:31:54.709526+0000","last_active":"2023-06-02T15:31:54.709526+0000","last_peered":"2023-06-02T15:31:54.709526+0000","last_clean":"2023-06-02T15:31:54.709526+0000","last_became_active":"2023-06-02T15:30:42.715920+0000","last_became_peered":"2023-06-02T15:30:42.715920+0000","last_unstale":"2023-06-02T15:31:54.709526+0000","last_undegraded":"2023-06-02T15:31:54.709526+0000","last_fullsized":"2023-06-02T15:31:54.709526+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:54.709024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:54.709024+0000","last_clean_scrub_stamp":"2023-06-02T15:31:54.709024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:34.309032+0000","scrub_duration":0.0044425330000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:10.905766+0000","last_change":"2023-06-02T15:32:10.905766+0000","last_active":"2023-06-02T15:32:10.905766+0000","last_peered":"2023-06-02T15:32:10.905766+0000","last_clean":"2023-06-02T15:32:10.905766+0000","last_became_active":"2023-06-02T15:30:38.650804+0000","last_became_peered":"2023-06-02T15:30:38.650804+0000","last_unstale":"2023-06-02T15:32:10.905766+0000","last_undegraded":"2023-06-02T15:32:10.905766+0000","last_fullsized":"2023-06-02T15:32:10.905766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:10.905480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:10.905480+0000","last_clean_scrub_stamp":"2023-06-02T15:32:10.905480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:19.827428+0000","scrub_duration":0.0033200590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:01.605705+0000","last_change":"2023-06-02T15:32:01.605705+0000","last_active":"2023-06-02T15:32:01.605705+0000","last_peered":"2023-06-02T15:32:01.605705+0000","last_clean":"2023-06-02T15:32:01.605705+0000","last_became_active":"2023-06-02T15:30:38.276772+0000","last_became_peered":"2023-06-02T15:30:38.276772+0000","last_unstale":"2023-06-02T15:32:01.605705+0000","last_undegraded":"2023-06-02T15:32:01.605705+0000","last_fullsized":"2023-06-02T15:32:01.605705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:01.605406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:01.605406+0000","last_clean_scrub_stamp":"2023-06-02T15:32:01.605406+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:32.053608+0000","scrub_duration":0.0036437890000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:53.682346+0000","last_change":"2023-06-02T15:31:53.682346+0000","last_active":"2023-06-02T15:31:53.682346+0000","last_peered":"2023-06-02T15:31:53.682346+0000","last_clean":"2023-06-02T15:31:53.682346+0000","last_became_active":"2023-06-02T15:30:42.692230+0000","last_became_peered":"2023-06-02T15:30:42.692230+0000","last_unstale":"2023-06-02T15:31:53.682346+0000","last_undegraded":"2023-06-02T15:31:53.682346+0000","last_fullsized":"2023-06-02T15:31:53.682346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:53.682012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:53.682012+0000","last_clean_scrub_stamp":"2023-06-02T15:31:53.682012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:32:04.841309+0000","scrub_duration":0.003995602,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.514954+0000","last_change":"2023-06-02T15:31:56.514954+0000","last_active":"2023-06-02T15:31:56.514954+0000","last_peered":"2023-06-02T15:31:56.514954+0000","last_clean":"2023-06-02T15:31:56.514954+0000","last_became_active":"2023-06-02T15:30:38.645046+0000","last_became_peered":"2023-06-02T15:30:38.645046+0000","last_unstale":"2023-06-02T15:31:56.514954+0000","last_undegraded":"2023-06-02T15:31:56.514954+0000","last_fullsized":"2023-06-02T15:31:56.514954+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:56.514662+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:56.514662+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.514662+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:51.622557+0000","scrub_duration":0.0037504259999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.132917+0000","last_change":"2023-06-02T15:31:57.132917+0000","last_active":"2023-06-02T15:31:57.132917+0000","last_peered":"2023-06-02T15:31:57.132917+0000","last_clean":"2023-06-02T15:31:57.132917+0000","last_became_active":"2023-06-02T15:30:38.281716+0000","last_became_peered":"2023-06-02T15:30:38.281716+0000","last_unstale":"2023-06-02T15:31:57.132917+0000","last_undegraded":"2023-06-02T15:31:57.132917+0000","last_fullsized":"2023-06-02T15:31:57.132917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:31:57.132631+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:31:57.132631+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.132631+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:42.965894+0000","scrub_duration":0.0071564879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:57.808081+0000","last_change":"2023-06-02T15:31:57.808081+0000","last_active":"2023-06-02T15:31:57.808081+0000","last_peered":"2023-06-02T15:31:57.808081+0000","last_clean":"2023-06-02T15:31:57.808081+0000","last_became_active":"2023-06-02T15:30:42.720439+0000","last_became_peered":"2023-06-02T15:30:42.720439+0000","last_unstale":"2023-06-02T15:31:57.808081+0000","last_undegraded":"2023-06-02T15:31:57.808081+0000","last_fullsized":"2023-06-02T15:31:57.808081+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:57.807733+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:57.807733+0000","last_clean_scrub_stamp":"2023-06-02T15:31:57.807733+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:27:43.640997+0000","scrub_duration":0.0037340979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:51.794000+0000","last_change":"2023-06-02T15:31:51.794000+0000","last_active":"2023-06-02T15:31:51.794000+0000","last_peered":"2023-06-02T15:31:51.794000+0000","last_clean":"2023-06-02T15:31:51.794000+0000","last_became_active":"2023-06-02T15:30:38.641408+0000","last_became_peered":"2023-06-02T15:30:38.641408+0000","last_unstale":"2023-06-02T15:31:51.794000+0000","last_undegraded":"2023-06-02T15:31:51.794000+0000","last_fullsized":"2023-06-02T15:31:51.794000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:51.793607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:51.793607+0000","last_clean_scrub_stamp":"2023-06-02T15:31:51.793607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:03.443296+0000","scrub_duration":0.0037644940000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"27'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.022508+0000","last_change":"2023-06-02T15:32:02.022508+0000","last_active":"2023-06-02T15:32:02.022508+0000","last_peered":"2023-06-02T15:32:02.022508+0000","last_clean":"2023-06-02T15:32:02.022508+0000","last_became_active":"2023-06-02T15:30:38.281602+0000","last_became_peered":"2023-06-02T15:30:38.281602+0000","last_unstale":"2023-06-02T15:32:02.022508+0000","last_undegraded":"2023-06-02T15:32:02.022508+0000","last_fullsized":"2023-06-02T15:32:02.022508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2023-06-02T15:32:02.022211+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2023-06-02T15:32:02.022211+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.022211+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:13.671901+0000","scrub_duration":0.0065549570000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.745565+0000","last_change":"2023-06-02T15:31:48.745565+0000","last_active":"2023-06-02T15:31:48.745565+0000","last_peered":"2023-06-02T15:31:48.745565+0000","last_clean":"2023-06-02T15:31:48.745565+0000","last_became_active":"2023-06-02T15:30:42.697131+0000","last_became_peered":"2023-06-02T15:30:42.697131+0000","last_unstale":"2023-06-02T15:31:48.745565+0000","last_undegraded":"2023-06-02T15:31:48.745565+0000","last_fullsized":"2023-06-02T15:31:48.745565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.745224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.745224+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.745224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:29.497528+0000","scrub_duration":0.0041717810000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.580802+0000","last_change":"2023-06-02T15:32:05.580802+0000","last_active":"2023-06-02T15:32:05.580802+0000","last_peered":"2023-06-02T15:32:05.580802+0000","last_clean":"2023-06-02T15:32:05.580802+0000","last_became_active":"2023-06-02T15:30:38.656650+0000","last_became_peered":"2023-06-02T15:30:38.656650+0000","last_unstale":"2023-06-02T15:32:05.580802+0000","last_undegraded":"2023-06-02T15:32:05.580802+0000","last_fullsized":"2023-06-02T15:32:05.580802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.580528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.580528+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.580528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:30.258580+0000","scrub_duration":0.0033003379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.048495+0000","last_change":"2023-06-02T15:32:03.048495+0000","last_active":"2023-06-02T15:32:03.048495+0000","last_peered":"2023-06-02T15:32:03.048495+0000","last_clean":"2023-06-02T15:32:03.048495+0000","last_became_active":"2023-06-02T15:30:38.282899+0000","last_became_peered":"2023-06-02T15:30:38.282899+0000","last_unstale":"2023-06-02T15:32:03.048495+0000","last_undegraded":"2023-06-02T15:32:03.048495+0000","last_fullsized":"2023-06-02T15:32:03.048495+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2023-06-02T15:32:03.048224+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2023-06-02T15:32:03.048224+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.048224+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:55.657274+0000","scrub_duration":0.0067757360000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:16.096164+0000","last_change":"2023-06-02T15:32:16.096164+0000","last_active":"2023-06-02T15:32:16.096164+0000","last_peered":"2023-06-02T15:32:16.096164+0000","last_clean":"2023-06-02T15:32:16.096164+0000","last_became_active":"2023-06-02T15:30:42.721825+0000","last_became_peered":"2023-06-02T15:30:42.721825+0000","last_unstale":"2023-06-02T15:32:16.096164+0000","last_undegraded":"2023-06-02T15:32:16.096164+0000","last_fullsized":"2023-06-02T15:32:16.096164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:16.095808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:16.095808+0000","last_clean_scrub_stamp":"2023-06-02T15:32:16.095808+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:55.854075+0000","scrub_duration":0.0041363069999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:19.325002+0000","last_change":"2023-06-02T15:32:19.325002+0000","last_active":"2023-06-02T15:32:19.325002+0000","last_peered":"2023-06-02T15:32:19.325002+0000","last_clean":"2023-06-02T15:32:19.325002+0000","last_became_active":"2023-06-02T15:30:42.713179+0000","last_became_peered":"2023-06-02T15:30:42.713179+0000","last_unstale":"2023-06-02T15:32:19.325002+0000","last_undegraded":"2023-06-02T15:32:19.325002+0000","last_fullsized":"2023-06-02T15:32:19.325002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:19.324579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:19.324579+0000","last_clean_scrub_stamp":"2023-06-02T15:32:19.324579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T02:59:22.673602+0000","scrub_duration":0.0040750339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'12","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.534507+0000","last_change":"2023-06-02T15:31:44.534507+0000","last_active":"2023-06-02T15:31:44.534507+0000","last_peered":"2023-06-02T15:31:44.534507+0000","last_clean":"2023-06-02T15:31:44.534507+0000","last_became_active":"2023-06-02T15:30:38.260956+0000","last_became_peered":"2023-06-02T15:30:38.260956+0000","last_unstale":"2023-06-02T15:31:44.534507+0000","last_undegraded":"2023-06-02T15:31:44.534507+0000","last_fullsized":"2023-06-02T15:31:44.534507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2023-06-02T15:31:44.534127+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2023-06-02T15:31:44.534127+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.534127+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:13.513282+0000","scrub_duration":0.010992052,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.800709+0000","last_change":"2023-06-02T15:32:05.800709+0000","last_active":"2023-06-02T15:32:05.800709+0000","last_peered":"2023-06-02T15:32:05.800709+0000","last_clean":"2023-06-02T15:32:05.800709+0000","last_became_active":"2023-06-02T15:30:38.656939+0000","last_became_peered":"2023-06-02T15:30:38.656939+0000","last_unstale":"2023-06-02T15:32:05.800709+0000","last_undegraded":"2023-06-02T15:32:05.800709+0000","last_fullsized":"2023-06-02T15:32:05.800709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.800386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.800386+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.800386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:14.722334+0000","scrub_duration":0.0038761970000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:30.683297+0000","last_change":"2023-06-02T15:32:30.683297+0000","last_active":"2023-06-02T15:32:30.683297+0000","last_peered":"2023-06-02T15:32:30.683297+0000","last_clean":"2023-06-02T15:32:30.683297+0000","last_became_active":"2023-06-02T15:30:42.704998+0000","last_became_peered":"2023-06-02T15:30:42.704998+0000","last_unstale":"2023-06-02T15:32:30.683297+0000","last_undegraded":"2023-06-02T15:32:30.683297+0000","last_fullsized":"2023-06-02T15:32:30.683297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:30.682913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:30.682913+0000","last_clean_scrub_stamp":"2023-06-02T15:32:30.682913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:16:29.421631+0000","scrub_duration":0.0040783460000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:54.070812+0000","last_change":"2023-06-02T15:31:54.070812+0000","last_active":"2023-06-02T15:31:54.070812+0000","last_peered":"2023-06-02T15:31:54.070812+0000","last_clean":"2023-06-02T15:31:54.070812+0000","last_became_active":"2023-06-02T15:30:38.282697+0000","last_became_peered":"2023-06-02T15:30:38.282697+0000","last_unstale":"2023-06-02T15:31:54.070812+0000","last_undegraded":"2023-06-02T15:31:54.070812+0000","last_fullsized":"2023-06-02T15:31:54.070812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:54.070524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:54.070524+0000","last_clean_scrub_stamp":"2023-06-02T15:31:54.070524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:06:33.670532+0000","scrub_duration":0.003366693,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.886495+0000","last_change":"2023-06-02T15:32:09.886495+0000","last_active":"2023-06-02T15:32:09.886495+0000","last_peered":"2023-06-02T15:32:09.886495+0000","last_clean":"2023-06-02T15:32:09.886495+0000","last_became_active":"2023-06-02T15:30:38.644614+0000","last_became_peered":"2023-06-02T15:30:38.644614+0000","last_unstale":"2023-06-02T15:32:09.886495+0000","last_undegraded":"2023-06-02T15:32:09.886495+0000","last_fullsized":"2023-06-02T15:32:09.886495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.886166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.886166+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.886166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:14.273734+0000","scrub_duration":0.003413995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:43.801035+0000","last_change":"2023-06-02T15:31:43.801035+0000","last_active":"2023-06-02T15:31:43.801035+0000","last_peered":"2023-06-02T15:31:43.801035+0000","last_clean":"2023-06-02T15:31:43.801035+0000","last_became_active":"2023-06-02T15:30:38.265017+0000","last_became_peered":"2023-06-02T15:30:38.265017+0000","last_unstale":"2023-06-02T15:31:43.801035+0000","last_undegraded":"2023-06-02T15:31:43.801035+0000","last_fullsized":"2023-06-02T15:31:43.801035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:43.800740+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:43.800740+0000","last_clean_scrub_stamp":"2023-06-02T15:31:43.800740+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:20.504313+0000","scrub_duration":0.0039374529999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.427459+0000","last_change":"2023-06-02T15:32:09.427459+0000","last_active":"2023-06-02T15:32:09.427459+0000","last_peered":"2023-06-02T15:32:09.427459+0000","last_clean":"2023-06-02T15:32:09.427459+0000","last_became_active":"2023-06-02T15:30:38.657724+0000","last_became_peered":"2023-06-02T15:30:38.657724+0000","last_unstale":"2023-06-02T15:32:09.427459+0000","last_undegraded":"2023-06-02T15:32:09.427459+0000","last_fullsized":"2023-06-02T15:32:09.427459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.427191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.427191+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.427191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:04.182383+0000","scrub_duration":0.0032371549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:31.729209+0000","last_change":"2023-06-02T15:32:31.729209+0000","last_active":"2023-06-02T15:32:31.729209+0000","last_peered":"2023-06-02T15:32:31.729209+0000","last_clean":"2023-06-02T15:32:31.729209+0000","last_became_active":"2023-06-02T15:30:42.705357+0000","last_became_peered":"2023-06-02T15:30:42.705357+0000","last_unstale":"2023-06-02T15:32:31.729209+0000","last_undegraded":"2023-06-02T15:32:31.729209+0000","last_fullsized":"2023-06-02T15:32:31.729209+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:31.728844+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:31.728844+0000","last_clean_scrub_stamp":"2023-06-02T15:32:31.728844+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T23:01:57.120555+0000","scrub_duration":0.0039777570000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"27'4","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:55.111052+0000","last_change":"2023-06-02T15:31:55.111052+0000","last_active":"2023-06-02T15:31:55.111052+0000","last_peered":"2023-06-02T15:31:55.111052+0000","last_clean":"2023-06-02T15:31:55.111052+0000","last_became_active":"2023-06-02T15:30:38.281352+0000","last_became_peered":"2023-06-02T15:30:38.281352+0000","last_unstale":"2023-06-02T15:31:55.111052+0000","last_undegraded":"2023-06-02T15:31:55.111052+0000","last_fullsized":"2023-06-02T15:31:55.111052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2023-06-02T15:31:55.110743+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2023-06-02T15:31:55.110743+0000","last_clean_scrub_stamp":"2023-06-02T15:31:55.110743+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:44:50.218637+0000","scrub_duration":0.0089042889999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:38.259845+0000","last_change":"2023-06-02T15:32:38.260189+0000","last_active":"2023-06-02T15:32:38.259845+0000","last_peered":"2023-06-02T15:32:38.259845+0000","last_clean":"2023-06-02T15:32:38.259845+0000","last_became_active":"2023-06-02T15:31:26.923733+0000","last_became_peered":"2023-06-02T15:31:26.923733+0000","last_unstale":"2023-06-02T15:32:38.259845+0000","last_undegraded":"2023-06-02T15:32:38.259845+0000","last_fullsized":"2023-06-02T15:32:38.259845+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:38.259747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:38.259747+0000","last_clean_scrub_stamp":"2023-06-02T15:32:38.259747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:19:22.182661+0000","scrub_duration":0.0040724389999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:12.439830+0000","last_change":"2023-06-02T15:32:12.439830+0000","last_active":"2023-06-02T15:32:12.439830+0000","last_peered":"2023-06-02T15:32:12.439830+0000","last_clean":"2023-06-02T15:32:12.439830+0000","last_became_active":"2023-06-02T15:30:42.697861+0000","last_became_peered":"2023-06-02T15:30:42.697861+0000","last_unstale":"2023-06-02T15:32:12.439830+0000","last_undegraded":"2023-06-02T15:32:12.439830+0000","last_fullsized":"2023-06-02T15:32:12.439830+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:12.439487+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:12.439487+0000","last_clean_scrub_stamp":"2023-06-02T15:32:12.439487+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:31.756307+0000","scrub_duration":0.0043436109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:00.568821+0000","last_change":"2023-06-02T15:32:00.568821+0000","last_active":"2023-06-02T15:32:00.568821+0000","last_peered":"2023-06-02T15:32:00.568821+0000","last_clean":"2023-06-02T15:32:00.568821+0000","last_became_active":"2023-06-02T15:30:38.637081+0000","last_became_peered":"2023-06-02T15:30:38.637081+0000","last_unstale":"2023-06-02T15:32:00.568821+0000","last_undegraded":"2023-06-02T15:32:00.568821+0000","last_fullsized":"2023-06-02T15:32:00.568821+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:00.568499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:00.568499+0000","last_clean_scrub_stamp":"2023-06-02T15:32:00.568499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:20.571924+0000","scrub_duration":0.003625372,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.740104+0000","last_change":"2023-06-02T15:32:09.740104+0000","last_active":"2023-06-02T15:32:09.740104+0000","last_peered":"2023-06-02T15:32:09.740104+0000","last_clean":"2023-06-02T15:32:09.740104+0000","last_became_active":"2023-06-02T15:30:38.654649+0000","last_became_peered":"2023-06-02T15:30:38.654649+0000","last_unstale":"2023-06-02T15:32:09.740104+0000","last_undegraded":"2023-06-02T15:32:09.740104+0000","last_fullsized":"2023-06-02T15:32:09.740104+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.739809+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.739809+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.739809+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:23:29.056629+0000","scrub_duration":0.0034772800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.809508+0000","last_change":"2023-06-02T15:31:48.809508+0000","last_active":"2023-06-02T15:31:48.809508+0000","last_peered":"2023-06-02T15:31:48.809508+0000","last_clean":"2023-06-02T15:31:48.809508+0000","last_became_active":"2023-06-02T15:30:38.637616+0000","last_became_peered":"2023-06-02T15:30:38.637616+0000","last_unstale":"2023-06-02T15:31:48.809508+0000","last_undegraded":"2023-06-02T15:31:48.809508+0000","last_fullsized":"2023-06-02T15:31:48.809508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.809212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.809212+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.809212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:08.812638+0000","scrub_duration":0.003422675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.713166+0000","last_change":"2023-06-02T15:31:48.713166+0000","last_active":"2023-06-02T15:31:48.713166+0000","last_peered":"2023-06-02T15:31:48.713166+0000","last_clean":"2023-06-02T15:31:48.713166+0000","last_became_active":"2023-06-02T15:30:38.657204+0000","last_became_peered":"2023-06-02T15:30:38.657204+0000","last_unstale":"2023-06-02T15:31:48.713166+0000","last_undegraded":"2023-06-02T15:31:48.713166+0000","last_fullsized":"2023-06-02T15:31:48.713166+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.712833+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.712833+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.712833+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:31:59.872130+0000","scrub_duration":0.0041090880000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.357932+0000","last_change":"2023-06-02T15:32:11.357932+0000","last_active":"2023-06-02T15:32:11.357932+0000","last_peered":"2023-06-02T15:32:11.357932+0000","last_clean":"2023-06-02T15:32:11.357932+0000","last_became_active":"2023-06-02T15:30:38.655983+0000","last_became_peered":"2023-06-02T15:30:38.655983+0000","last_unstale":"2023-06-02T15:32:11.357932+0000","last_undegraded":"2023-06-02T15:32:11.357932+0000","last_fullsized":"2023-06-02T15:32:11.357932+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.357659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.357659+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.357659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:58:36.035711+0000","scrub_duration":0.003466874,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.463479+0000","last_change":"2023-06-02T15:32:11.463479+0000","last_active":"2023-06-02T15:32:11.463479+0000","last_peered":"2023-06-02T15:32:11.463479+0000","last_clean":"2023-06-02T15:32:11.463479+0000","last_became_active":"2023-06-02T15:30:38.657819+0000","last_became_peered":"2023-06-02T15:30:38.657819+0000","last_unstale":"2023-06-02T15:32:11.463479+0000","last_undegraded":"2023-06-02T15:32:11.463479+0000","last_fullsized":"2023-06-02T15:32:11.463479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.463140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.463140+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.463140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:01:19.130250+0000","scrub_duration":0.0031256579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.405088+0000","last_change":"2023-06-02T15:32:02.405088+0000","last_active":"2023-06-02T15:32:02.405088+0000","last_peered":"2023-06-02T15:32:02.405088+0000","last_clean":"2023-06-02T15:32:02.405088+0000","last_became_active":"2023-06-02T15:30:38.641253+0000","last_became_peered":"2023-06-02T15:30:38.641253+0000","last_unstale":"2023-06-02T15:32:02.405088+0000","last_undegraded":"2023-06-02T15:32:02.405088+0000","last_fullsized":"2023-06-02T15:32:02.405088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.404814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.404814+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.404814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.054503+0000","scrub_duration":0.003729914,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:59.370686+0000","last_change":"2023-06-02T15:31:59.370686+0000","last_active":"2023-06-02T15:31:59.370686+0000","last_peered":"2023-06-02T15:31:59.370686+0000","last_clean":"2023-06-02T15:31:59.370686+0000","last_became_active":"2023-06-02T15:30:38.636208+0000","last_became_peered":"2023-06-02T15:30:38.636208+0000","last_unstale":"2023-06-02T15:31:59.370686+0000","last_undegraded":"2023-06-02T15:31:59.370686+0000","last_fullsized":"2023-06-02T15:31:59.370686+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:59.370409+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:59.370409+0000","last_clean_scrub_stamp":"2023-06-02T15:31:59.370409+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:23:19.373834+0000","scrub_duration":0.0039692160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:05.051651+0000","last_change":"2023-06-02T15:32:05.051651+0000","last_active":"2023-06-02T15:32:05.051651+0000","last_peered":"2023-06-02T15:32:05.051651+0000","last_clean":"2023-06-02T15:32:05.051651+0000","last_became_active":"2023-06-02T15:30:38.656666+0000","last_became_peered":"2023-06-02T15:30:38.656666+0000","last_unstale":"2023-06-02T15:32:05.051651+0000","last_undegraded":"2023-06-02T15:32:05.051651+0000","last_fullsized":"2023-06-02T15:32:05.051651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:05.051353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:05.051353+0000","last_clean_scrub_stamp":"2023-06-02T15:32:05.051353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:35.499555+0000","scrub_duration":0.0040453920000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.672704+0000","last_change":"2023-06-02T15:32:11.672704+0000","last_active":"2023-06-02T15:32:11.672704+0000","last_peered":"2023-06-02T15:32:11.672704+0000","last_clean":"2023-06-02T15:32:11.672704+0000","last_became_active":"2023-06-02T15:30:38.648298+0000","last_became_peered":"2023-06-02T15:30:38.648298+0000","last_unstale":"2023-06-02T15:32:11.672704+0000","last_undegraded":"2023-06-02T15:32:11.672704+0000","last_fullsized":"2023-06-02T15:32:11.672704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.672427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.672427+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.672427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:49:51.430694+0000","scrub_duration":0.0035935189999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:04.015903+0000","last_change":"2023-06-02T15:32:04.015903+0000","last_active":"2023-06-02T15:32:04.015903+0000","last_peered":"2023-06-02T15:32:04.015903+0000","last_clean":"2023-06-02T15:32:04.015903+0000","last_became_active":"2023-06-02T15:30:38.643082+0000","last_became_peered":"2023-06-02T15:30:38.643082+0000","last_unstale":"2023-06-02T15:32:04.015903+0000","last_undegraded":"2023-06-02T15:32:04.015903+0000","last_fullsized":"2023-06-02T15:32:04.015903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:04.015570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:04.015570+0000","last_clean_scrub_stamp":"2023-06-02T15:32:04.015570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:20:56.624619+0000","scrub_duration":0.0033126750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:09.056254+0000","last_change":"2023-06-02T15:32:09.056254+0000","last_active":"2023-06-02T15:32:09.056254+0000","last_peered":"2023-06-02T15:32:09.056254+0000","last_clean":"2023-06-02T15:32:09.056254+0000","last_became_active":"2023-06-02T15:30:38.656749+0000","last_became_peered":"2023-06-02T15:30:38.656749+0000","last_unstale":"2023-06-02T15:32:09.056254+0000","last_undegraded":"2023-06-02T15:32:09.056254+0000","last_fullsized":"2023-06-02T15:32:09.056254+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:09.055882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:09.055882+0000","last_clean_scrub_stamp":"2023-06-02T15:32:09.055882+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:11:13.443451+0000","scrub_duration":0.0037959309999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:56.888442+0000","last_change":"2023-06-02T15:31:56.888442+0000","last_active":"2023-06-02T15:31:56.888442+0000","last_peered":"2023-06-02T15:31:56.888442+0000","last_clean":"2023-06-02T15:31:56.888442+0000","last_became_active":"2023-06-02T15:30:38.638322+0000","last_became_peered":"2023-06-02T15:30:38.638322+0000","last_unstale":"2023-06-02T15:31:56.888442+0000","last_undegraded":"2023-06-02T15:31:56.888442+0000","last_fullsized":"2023-06-02T15:31:56.888442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:56.888166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:56.888166+0000","last_clean_scrub_stamp":"2023-06-02T15:31:56.888166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T21:33:27.336368+0000","scrub_duration":0.0032250339999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.801217+0000","last_change":"2023-06-02T15:31:37.801217+0000","last_active":"2023-06-02T15:31:37.801217+0000","last_peered":"2023-06-02T15:31:37.801217+0000","last_clean":"2023-06-02T15:31:37.801217+0000","last_became_active":"2023-06-02T15:30:38.637929+0000","last_became_peered":"2023-06-02T15:30:38.637929+0000","last_unstale":"2023-06-02T15:31:37.801217+0000","last_undegraded":"2023-06-02T15:31:37.801217+0000","last_fullsized":"2023-06-02T15:31:37.801217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.801043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.801043+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.801043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:46:43.999450+0000","scrub_duration":0.0034263620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:40.659256+0000","last_change":"2023-06-02T15:32:40.659256+0000","last_active":"2023-06-02T15:32:40.659256+0000","last_peered":"2023-06-02T15:32:40.659256+0000","last_clean":"2023-06-02T15:32:40.659256+0000","last_became_active":"2023-06-02T15:30:38.636098+0000","last_became_peered":"2023-06-02T15:30:38.636098+0000","last_unstale":"2023-06-02T15:32:40.659256+0000","last_undegraded":"2023-06-02T15:32:40.659256+0000","last_fullsized":"2023-06-02T15:32:40.659256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:40.658927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:40.658927+0000","last_clean_scrub_stamp":"2023-06-02T15:32:40.658927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:25:20.839380+0000","scrub_duration":0.003771178,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:03.005845+0000","last_change":"2023-06-02T15:32:03.005845+0000","last_active":"2023-06-02T15:32:03.005845+0000","last_peered":"2023-06-02T15:32:03.005845+0000","last_clean":"2023-06-02T15:32:03.005845+0000","last_became_active":"2023-06-02T15:30:38.638679+0000","last_became_peered":"2023-06-02T15:30:38.638679+0000","last_unstale":"2023-06-02T15:32:03.005845+0000","last_undegraded":"2023-06-02T15:32:03.005845+0000","last_fullsized":"2023-06-02T15:32:03.005845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:03.005544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:03.005544+0000","last_clean_scrub_stamp":"2023-06-02T15:32:03.005544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:54:14.655234+0000","scrub_duration":0.0031069069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:02.860193+0000","last_change":"2023-06-02T15:32:02.860193+0000","last_active":"2023-06-02T15:32:02.860193+0000","last_peered":"2023-06-02T15:32:02.860193+0000","last_clean":"2023-06-02T15:32:02.860193+0000","last_became_active":"2023-06-02T15:30:38.636129+0000","last_became_peered":"2023-06-02T15:30:38.636129+0000","last_unstale":"2023-06-02T15:32:02.860193+0000","last_undegraded":"2023-06-02T15:32:02.860193+0000","last_fullsized":"2023-06-02T15:32:02.860193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:02.859891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:02.859891+0000","last_clean_scrub_stamp":"2023-06-02T15:32:02.859891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:11.781839+0000","scrub_duration":0.0039529639999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:10.101069+0000","last_change":"2023-06-02T15:32:10.101069+0000","last_active":"2023-06-02T15:32:10.101069+0000","last_peered":"2023-06-02T15:32:10.101069+0000","last_clean":"2023-06-02T15:32:10.101069+0000","last_became_active":"2023-06-02T15:30:38.659051+0000","last_became_peered":"2023-06-02T15:30:38.659051+0000","last_unstale":"2023-06-02T15:32:10.101069+0000","last_undegraded":"2023-06-02T15:32:10.101069+0000","last_fullsized":"2023-06-02T15:32:10.101069+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:10.100721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:10.100721+0000","last_clean_scrub_stamp":"2023-06-02T15:32:10.100721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:12:19.022669+0000","scrub_duration":0.003560887,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.498607+0000","last_change":"2023-06-02T15:31:41.498607+0000","last_active":"2023-06-02T15:31:41.498607+0000","last_peered":"2023-06-02T15:31:41.498607+0000","last_clean":"2023-06-02T15:31:41.498607+0000","last_became_active":"2023-06-02T15:30:38.635825+0000","last_became_peered":"2023-06-02T15:30:38.635825+0000","last_unstale":"2023-06-02T15:31:41.498607+0000","last_undegraded":"2023-06-02T15:31:41.498607+0000","last_fullsized":"2023-06-02T15:31:41.498607+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.498234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.498234+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.498234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:22.250537+0000","scrub_duration":0.0032772719999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:41.762119+0000","last_change":"2023-06-02T15:31:41.762119+0000","last_active":"2023-06-02T15:31:41.762119+0000","last_peered":"2023-06-02T15:31:41.762119+0000","last_clean":"2023-06-02T15:31:41.762119+0000","last_became_active":"2023-06-02T15:30:38.645439+0000","last_became_peered":"2023-06-02T15:30:38.645439+0000","last_unstale":"2023-06-02T15:31:41.762119+0000","last_undegraded":"2023-06-02T15:31:41.762119+0000","last_fullsized":"2023-06-02T15:31:41.762119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:41.761771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:41.761771+0000","last_clean_scrub_stamp":"2023-06-02T15:31:41.761771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:10.202482+0000","scrub_duration":0.0033186510000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:45.714297+0000","last_change":"2023-06-02T15:31:45.714297+0000","last_active":"2023-06-02T15:31:45.714297+0000","last_peered":"2023-06-02T15:31:45.714297+0000","last_clean":"2023-06-02T15:31:45.714297+0000","last_became_active":"2023-06-02T15:30:38.644333+0000","last_became_peered":"2023-06-02T15:30:38.644333+0000","last_unstale":"2023-06-02T15:31:45.714297+0000","last_undegraded":"2023-06-02T15:31:45.714297+0000","last_fullsized":"2023-06-02T15:31:45.714297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:45.713996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:45.713996+0000","last_clean_scrub_stamp":"2023-06-02T15:31:45.713996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:22.417569+0000","scrub_duration":0.003800037,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:33:01.766258+0000","last_change":"2023-06-02T15:33:01.766258+0000","last_active":"2023-06-02T15:33:01.766258+0000","last_peered":"2023-06-02T15:33:01.766258+0000","last_clean":"2023-06-02T15:33:01.766258+0000","last_became_active":"2023-06-02T15:30:38.650629+0000","last_became_peered":"2023-06-02T15:30:38.650629+0000","last_unstale":"2023-06-02T15:33:01.766258+0000","last_undegraded":"2023-06-02T15:33:01.766258+0000","last_fullsized":"2023-06-02T15:33:01.766258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:33:01.765968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:33:01.765968+0000","last_clean_scrub_stamp":"2023-06-02T15:33:01.765968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T16:17:38.489531+0000","scrub_duration":0.0037323399999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:37.498112+0000","last_change":"2023-06-02T15:31:37.498112+0000","last_active":"2023-06-02T15:31:37.498112+0000","last_peered":"2023-06-02T15:31:37.498112+0000","last_clean":"2023-06-02T15:31:37.498112+0000","last_became_active":"2023-06-02T15:30:38.640050+0000","last_became_peered":"2023-06-02T15:30:38.640050+0000","last_unstale":"2023-06-02T15:31:37.498112+0000","last_undegraded":"2023-06-02T15:31:37.498112+0000","last_fullsized":"2023-06-02T15:31:37.498112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:37.497813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:37.497813+0000","last_clean_scrub_stamp":"2023-06-02T15:31:37.497813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:06.476968+0000","scrub_duration":0.0034432849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:38.779930+0000","last_change":"2023-06-02T15:31:38.779930+0000","last_active":"2023-06-02T15:31:38.779930+0000","last_peered":"2023-06-02T15:31:38.779930+0000","last_clean":"2023-06-02T15:31:38.779930+0000","last_became_active":"2023-06-02T15:30:38.638987+0000","last_became_peered":"2023-06-02T15:30:38.638987+0000","last_unstale":"2023-06-02T15:31:38.779930+0000","last_undegraded":"2023-06-02T15:31:38.779930+0000","last_fullsized":"2023-06-02T15:31:38.779930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:38.779654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:38.779654+0000","last_clean_scrub_stamp":"2023-06-02T15:31:38.779654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T17:06:07.220365+0000","scrub_duration":0.0031197170000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:07.505469+0000","last_change":"2023-06-02T15:32:07.505469+0000","last_active":"2023-06-02T15:32:07.505469+0000","last_peered":"2023-06-02T15:32:07.505469+0000","last_clean":"2023-06-02T15:32:07.505469+0000","last_became_active":"2023-06-02T15:30:38.647646+0000","last_became_peered":"2023-06-02T15:30:38.647646+0000","last_unstale":"2023-06-02T15:32:07.505469+0000","last_undegraded":"2023-06-02T15:32:07.505469+0000","last_fullsized":"2023-06-02T15:32:07.505469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:07.505132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:07.505132+0000","last_clean_scrub_stamp":"2023-06-02T15:32:07.505132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T01:27:05.339584+0000","scrub_duration":0.0034090029999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.084825+0000","last_change":"2023-06-02T15:32:11.084825+0000","last_active":"2023-06-02T15:32:11.084825+0000","last_peered":"2023-06-02T15:32:11.084825+0000","last_clean":"2023-06-02T15:32:11.084825+0000","last_became_active":"2023-06-02T15:30:38.659030+0000","last_became_peered":"2023-06-02T15:30:38.659030+0000","last_unstale":"2023-06-02T15:32:11.084825+0000","last_undegraded":"2023-06-02T15:32:11.084825+0000","last_fullsized":"2023-06-02T15:32:11.084825+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.084549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.084549+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.084549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:05.839740+0000","scrub_duration":0.0037808770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:42.739497+0000","last_change":"2023-06-02T15:32:42.739497+0000","last_active":"2023-06-02T15:32:42.739497+0000","last_peered":"2023-06-02T15:32:42.739497+0000","last_clean":"2023-06-02T15:32:42.739497+0000","last_became_active":"2023-06-02T15:30:38.639888+0000","last_became_peered":"2023-06-02T15:30:38.639888+0000","last_unstale":"2023-06-02T15:32:42.739497+0000","last_undegraded":"2023-06-02T15:32:42.739497+0000","last_fullsized":"2023-06-02T15:32:42.739497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:42.739181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:42.739181+0000","last_clean_scrub_stamp":"2023-06-02T15:32:42.739181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T03:16:59.479400+0000","scrub_duration":0.0038148140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:11.887491+0000","last_change":"2023-06-02T15:32:11.887491+0000","last_active":"2023-06-02T15:32:11.887491+0000","last_peered":"2023-06-02T15:32:11.887491+0000","last_clean":"2023-06-02T15:32:11.887491+0000","last_became_active":"2023-06-02T15:30:38.638471+0000","last_became_peered":"2023-06-02T15:30:38.638471+0000","last_unstale":"2023-06-02T15:32:11.887491+0000","last_undegraded":"2023-06-02T15:32:11.887491+0000","last_fullsized":"2023-06-02T15:32:11.887491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:11.887196+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:11.887196+0000","last_clean_scrub_stamp":"2023-06-02T15:32:11.887196+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T22:08:06.642387+0000","scrub_duration":0.003596793,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:48.546529+0000","last_change":"2023-06-02T15:31:48.546529+0000","last_active":"2023-06-02T15:31:48.546529+0000","last_peered":"2023-06-02T15:31:48.546529+0000","last_clean":"2023-06-02T15:31:48.546529+0000","last_became_active":"2023-06-02T15:30:38.636603+0000","last_became_peered":"2023-06-02T15:30:38.636603+0000","last_unstale":"2023-06-02T15:31:48.546529+0000","last_undegraded":"2023-06-02T15:31:48.546529+0000","last_fullsized":"2023-06-02T15:31:48.546529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:48.546224+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:48.546224+0000","last_clean_scrub_stamp":"2023-06-02T15:31:48.546224+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-04T00:08:29.298528+0000","scrub_duration":0.0036290509999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:32:45.754760+0000","last_change":"2023-06-02T15:32:45.754760+0000","last_active":"2023-06-02T15:32:45.754760+0000","last_peered":"2023-06-02T15:32:45.754760+0000","last_clean":"2023-06-02T15:32:45.754760+0000","last_became_active":"2023-06-02T15:30:38.641267+0000","last_became_peered":"2023-06-02T15:30:38.641267+0000","last_unstale":"2023-06-02T15:32:45.754760+0000","last_undegraded":"2023-06-02T15:32:45.754760+0000","last_fullsized":"2023-06-02T15:32:45.754760+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:32:45.754458+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:32:45.754458+0000","last_clean_scrub_stamp":"2023-06-02T15:32:45.754458+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:47:05.712913+0000","scrub_duration":0.003734781,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:38.480659+0000","last_change":"2023-06-02T15:31:38.480659+0000","last_active":"2023-06-02T15:31:38.480659+0000","last_peered":"2023-06-02T15:31:38.480659+0000","last_clean":"2023-06-02T15:31:38.480659+0000","last_became_active":"2023-06-02T15:30:38.650295+0000","last_became_peered":"2023-06-02T15:30:38.650295+0000","last_unstale":"2023-06-02T15:31:38.480659+0000","last_undegraded":"2023-06-02T15:31:38.480659+0000","last_fullsized":"2023-06-02T15:31:38.480659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:38.480329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:38.480329+0000","last_clean_scrub_stamp":"2023-06-02T15:31:38.480329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T20:07:15.183901+0000","scrub_duration":0.0035440649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-06-02T15:31:44.744656+0000","last_change":"2023-06-02T15:31:44.744656+0000","last_active":"2023-06-02T15:31:44.744656+0000","last_peered":"2023-06-02T15:31:44.744656+0000","last_clean":"2023-06-02T15:31:44.744656+0000","last_became_active":"2023-06-02T15:30:38.638658+0000","last_became_peered":"2023-06-02T15:30:38.638658+0000","last_unstale":"2023-06-02T15:31:44.744656+0000","last_undegraded":"2023-06-02T15:31:44.744656+0000","last_fullsized":"2023-06-02T15:31:44.744656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-06-02T15:31:44.744325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-06-02T15:31:44.744325+0000","last_clean_scrub_stamp":"2023-06-02T15:31:44.744325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-06-03T19:38:13.723480+0000","scrub_duration":0.0037133079999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":5686,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":11372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":70,"ondisk_log_size":70,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66726,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574883,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9284,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8896,"kb_avail":94362556,"statfs":{"total":96636764160,"available":96627257344,"internally_reserved":0,"allocated":389120,"data_stored":719524,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9109504},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.83699999999999997,"15min":0.83799999999999997},"min":{"1min":0.55600000000000005,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.83999999999999997,"15min":0.83199999999999996},"min":{"1min":0.58499999999999996,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.177,"5min":1.538,"15min":1.538},"last":0.84199999999999997}]},{"osd":1,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.875,"15min":0.86699999999999999},"min":{"1min":0.62,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.252,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.94099999999999995,"15min":0.94399999999999995},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.133,"5min":1.198,"15min":1.198},"last":0.99299999999999999}]},{"osd":2,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.85699999999999998,"15min":0.84599999999999997},"min":{"1min":0.78000000000000003,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.1679999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92900000000000005,"15min":0.93000000000000005},"min":{"1min":0.65000000000000002,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":1.0269999999999999}]},{"osd":3,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.90500000000000003,"15min":0.90900000000000003},"min":{"1min":0.72699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0549999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.008,"5min":1.0009999999999999,"15min":1},"min":{"1min":0.85199999999999998,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.95299999999999996}]},{"osd":4,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.92100000000000004,"15min":0.93100000000000005},"min":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.095,"5min":1.343,"15min":1.343},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.94199999999999995,"15min":0.94799999999999995},"min":{"1min":0.67000000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.202,"5min":1.649,"15min":1.649},"last":0.88900000000000001}]},{"osd":5,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.069,"15min":1.085},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.419,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.052,"5min":1.135,"15min":1.149},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.266,"5min":1.97,"15min":1.97},"last":1.1850000000000001}]},{"osd":6,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98799999999999999,"5min":1.0820000000000001,"15min":1.0980000000000001},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.2230000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":0.998,"5min":1.0700000000000001,"15min":1.0820000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.2889999999999999,"5min":1.722,"15min":1.722},"last":1.155}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.85799999999999998,"15min":0.85099999999999998},"min":{"1min":0.65500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.1539999999999999,"5min":1.252,"15min":1.252},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.84099999999999997,"15min":0.83799999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.04}]},{"osd":1,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.82299999999999995,"15min":0.81299999999999994},"min":{"1min":0.59299999999999997,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.127,"5min":1.165,"15min":1.165},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.92100000000000004,"15min":0.92000000000000004},"min":{"1min":0.65400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.141,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.79300000000000004}]},{"osd":2,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.63400000000000001,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.1899999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.93100000000000005,"15min":0.92400000000000004},"min":{"1min":0.69799999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1930000000000001,"5min":1.3109999999999999,"15min":1.3109999999999999},"last":0.88300000000000001}]},{"osd":3,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.89300000000000002,"15min":0.88100000000000001},"min":{"1min":0.73699999999999999,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.748},{"interface":"front","average":{"1min":0.91500000000000004,"5min":0.92100000000000004,"15min":0.92200000000000004},"min":{"1min":0.749,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1220000000000001,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.92300000000000004}]},{"osd":4,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.98599999999999999,"15min":1.0049999999999999},"min":{"1min":0.60299999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3979999999999999,"5min":1.3979999999999999,"15min":1.3979999999999999},"last":1.115},{"interface":"front","average":{"1min":0.96399999999999997,"5min":1.0109999999999999,"15min":1.0189999999999999},"min":{"1min":0.66400000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.97199999999999998}]},{"osd":5,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.97999999999999998,"15min":0.98599999999999999},"min":{"1min":0.70499999999999996,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1140000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.83799999999999997},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1080000000000001,"15min":1.109},"min":{"1min":0.85999999999999999,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3029999999999999,"5min":1.365,"15min":1.365},"last":1.1859999999999999}]},{"osd":7,"last update":"Fri Jun 2 15:32:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.115,"15min":1.1240000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.28,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.0920000000000001,"15min":1.097},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.3420000000000001,"5min":1.429,"15min":1.429},"last":1.0780000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574884,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8616,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94363224,"statfs":{"total":96636764160,"available":96627941376,"internally_reserved":0,"allocated":294912,"data_stored":123686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.86599999999999999,"15min":0.86199999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.133,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.83099999999999996,"15min":0.82199999999999995},"min":{"1min":0.61899999999999999,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":1.0189999999999999}]},{"osd":1,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.86299999999999999,"15min":0.85899999999999999},"min":{"1min":0.66400000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1140000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90000000000000002,"15min":0.89500000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.123,"5min":1.159,"15min":1.159},"last":0.85499999999999998}]},{"osd":2,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.90500000000000003,"15min":0.90700000000000003},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.1160000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.91100000000000003,"15min":0.91300000000000003},"min":{"1min":0.746,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.115,"5min":1.234,"15min":1.234},"last":0.88700000000000001}]},{"osd":3,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.94599999999999995,"15min":0.94999999999999996},"min":{"1min":0.71199999999999997,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.014,"15min":1.01},"min":{"1min":0.82399999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.2,"5min":1.3700000000000001,"15min":1.3700000000000001},"last":1.105}]},{"osd":4,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.012,"15min":1.026},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.216,"5min":2.2770000000000001,"15min":2.2770000000000001},"last":1.163},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.028,"15min":1.0429999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.2370000000000001,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.046}]},{"osd":6,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":1.046,"15min":1.0669999999999999},"min":{"1min":0.67700000000000005,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.1619999999999999,"5min":1.881,"15min":1.881},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.083,"15min":1.0980000000000001},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.175,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":7,"last update":"Fri Jun 2 15:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":1.056,"15min":1.073},"min":{"1min":0.73199999999999998,"5min":0.70999999999999996,"15min":0.70999999999999996},"max":{"1min":1.171,"5min":1.905,"15min":1.905},"last":1.234},{"interface":"front","average":{"1min":1.032,"5min":1.1299999999999999,"15min":1.1459999999999999},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.214,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.1519999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574884,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8764,"kb_used_data":308,"kb_used_omap":0,"kb_used_meta":8448,"kb_avail":94363076,"statfs":{"total":96636764160,"available":96627789824,"internally_reserved":0,"allocated":315392,"data_stored":128996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8650752},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.91600000000000004,"15min":0.91000000000000003},"min":{"1min":0.77100000000000002,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.204,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.80900000000000005,"15min":0.80500000000000005},"min":{"1min":0.59699999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.109,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.92500000000000004}]},{"osd":1,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.84799999999999998,"15min":0.85199999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.95699999999999996,"5min":0.92000000000000004,"15min":0.91400000000000003},"min":{"1min":0.622,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.167,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.70799999999999996}]},{"osd":2,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.88100000000000001,"15min":0.875},"min":{"1min":0.61199999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1779999999999999,"5min":1.198,"15min":1.198},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.88500000000000001,"15min":0.876},"min":{"1min":0.58799999999999997,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.95499999999999996}]},{"osd":3,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.89300000000000002,"15min":0.89900000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.0620000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.878},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.98199999999999998,"15min":0.97999999999999998},"min":{"1min":0.82399999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.236,"5min":1.379,"15min":1.379},"last":1.0600000000000001}]},{"osd":5,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":0.99199999999999999,"15min":1.002},"min":{"1min":0.67800000000000005,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1930000000000001,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.091},{"interface":"front","average":{"1min":0.82099999999999995,"5min":0.90500000000000003,"15min":0.91900000000000004},"min":{"1min":0.58799999999999997,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1719999999999999,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.80400000000000005}]},{"osd":6,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.97599999999999998,"15min":0.97999999999999998},"min":{"1min":0.64100000000000001,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.2649999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.03,"5min":1.0660000000000001,"15min":1.0720000000000001},"min":{"1min":0.73399999999999999,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.296,"5min":1.327,"15min":1.327},"last":1.0149999999999999}]},{"osd":7,"last update":"Fri Jun 2 15:32:31 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.999,"15min":1.0029999999999999},"min":{"1min":0.72699999999999998,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":1.036},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1200000000000001,"15min":1.1240000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.1279999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574885,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8680,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363160,"statfs":{"total":96636764160,"available":96627875840,"internally_reserved":0,"allocated":294912,"data_stored":124126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.55800000000000005,"15min":0.54600000000000004},"min":{"1min":0.311,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.61899999999999999,"15min":0.60499999999999998},"min":{"1min":0.29299999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.79900000000000004}]},{"osd":1,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.64200000000000002,"15min":0.64000000000000001},"min":{"1min":0.35099999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93500000000000005,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.64900000000000002,"15min":0.63200000000000001},"min":{"1min":0.29099999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.026}]},{"osd":2,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.73999999999999999,"15min":0.73199999999999998},"min":{"1min":0.438,"5min":0.25,"15min":0.25},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71899999999999997,"15min":0.70899999999999996},"min":{"1min":0.36899999999999999,"5min":0.314,"15min":0.314},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":0.64700000000000002}]},{"osd":4,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.89100000000000001,"15min":0.879},"min":{"1min":0.56999999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.997},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.97199999999999998,"15min":0.97299999999999998},"min":{"1min":0.67500000000000004,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.3480000000000001,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":1.0800000000000001}]},{"osd":5,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.65200000000000002,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.175,"5min":1.375,"15min":1.375},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":1.004,"15min":1.006},"min":{"1min":0.60899999999999999,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.387,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1599999999999999}]},{"osd":6,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":0.94899999999999995,"15min":0.93500000000000005},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.995,"5min":1.028,"15min":1.034},"min":{"1min":0.73599999999999999,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3089999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.95399999999999996}]},{"osd":7,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.052,"5min":1.0569999999999999,"15min":1.0580000000000001},"min":{"1min":0.76700000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.298,"5min":1.4390000000000001,"15min":1.4390000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.006,"5min":1.0409999999999999,"15min":1.0469999999999999},"min":{"1min":0.625,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3600000000000001,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":1.056}]}]},{"osd":2,"up_from":13,"seq":55834574884,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8548,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94363292,"statfs":{"total":96636764160,"available":96628011008,"internally_reserved":0,"allocated":290816,"data_stored":124036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.58199999999999996,"15min":0.57999999999999996},"min":{"1min":0.443,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.878,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.67000000000000004,"15min":0.66200000000000003},"min":{"1min":0.42499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.038,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.59599999999999997,"15min":0.58399999999999996},"min":{"1min":0.34200000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.69799999999999995,"15min":0.69399999999999995},"min":{"1min":0.46300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.94899999999999995,"5min":1.4550000000000001,"15min":1.4550000000000001},"last":0.82799999999999996}]},{"osd":3,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.70999999999999996,"15min":0.70099999999999996},"min":{"1min":0.40600000000000003,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.163,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.66900000000000004,"15min":0.65400000000000003},"min":{"1min":0.36199999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.748}]},{"osd":4,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.92400000000000004,"15min":0.92500000000000004},"min":{"1min":0.66600000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.1930000000000001,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.90600000000000003,"5min":0.93400000000000005,"15min":0.93799999999999994},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.093,"5min":1.266,"15min":1.266},"last":0.874}]},{"osd":5,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.95999999999999996,"15min":0.95299999999999996},"min":{"1min":0.71699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.331,"5min":1.337,"15min":1.337},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96299999999999997,"15min":0.96099999999999997},"min":{"1min":0.64400000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.2470000000000001,"5min":1.6040000000000001,"15min":1.6040000000000001},"last":1.0169999999999999}]},{"osd":6,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.96899999999999997,"15min":0.96299999999999997},"min":{"1min":0.72999999999999998,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0169999999999999,"15min":1.0129999999999999},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.296,"5min":1.4970000000000001,"15min":1.4970000000000001},"last":0.80800000000000005}]},{"osd":7,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.0669999999999999,"15min":1.0649999999999999},"min":{"1min":0.84999999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.347,"5min":1.6619999999999999,"15min":1.6619999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0289999999999999,"15min":1.0209999999999999},"min":{"1min":0.81100000000000005,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.373,"5min":1.4850000000000001,"15min":1.4850000000000001},"last":0.97999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9188,"kb_used_data":348,"kb_used_omap":0,"kb_used_meta":8832,"kb_avail":94362652,"statfs":{"total":96636764160,"available":96627355648,"internally_reserved":0,"allocated":356352,"data_stored":714404,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":9043968},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.57699999999999996,"15min":0.56299999999999994},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.92800000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.58599999999999997,"15min":0.57199999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97399999999999998,"5min":1.028,"15min":1.028},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.627,"15min":0.60599999999999998},"min":{"1min":0.39500000000000002,"5min":0.312,"15min":0.312},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56899999999999995}]},{"osd":3,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.69699999999999995,"15min":0.67900000000000005},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.0600000000000001,"5min":1.079,"15min":1.079},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.65000000000000002,"15min":0.63400000000000001},"min":{"1min":0.35099999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.82699999999999996,"15min":0.82499999999999996},"min":{"1min":0.59199999999999997,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.0609999999999999,"5min":1.266,"15min":1.266},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.018,"5min":0.91300000000000003,"15min":0.89500000000000002},"min":{"1min":0.78500000000000003,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":1.0109999999999999}]},{"osd":5,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.877,"15min":0.85999999999999999},"min":{"1min":0.68200000000000005,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90900000000000003,"15min":0.89900000000000002},"min":{"1min":0.82099999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.1739999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.94799999999999995,"15min":0.92800000000000005},"min":{"1min":0.63300000000000001,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.3280000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.93200000000000005,"15min":0.91400000000000003},"min":{"1min":0.70699999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":1.173}]},{"osd":7,"last update":"Fri Jun 2 15:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":0.96699999999999997,"15min":0.95599999999999996},"min":{"1min":0.73199999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.224,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.94999999999999996,"15min":0.94199999999999995},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.244,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.98099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574884,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8676,"kb_used_data":284,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94363164,"statfs":{"total":96636764160,"available":96627879936,"internally_reserved":0,"allocated":290816,"data_stored":123616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64500000000000002,"15min":0.65000000000000002},"min":{"1min":0.53100000000000003,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.94999999999999996,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.754},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.67600000000000005,"15min":0.67000000000000004},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":1.042,"5min":1.6100000000000001,"15min":1.6100000000000001},"last":0.80000000000000004}]},{"osd":2,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.69299999999999995,"15min":0.68500000000000005},"min":{"1min":0.60799999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.167,"5min":1.167,"15min":1.167},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.68500000000000005,"15min":0.67800000000000005},"min":{"1min":0.49299999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.57999999999999996}]},{"osd":3,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.61499999999999999,"15min":0.59899999999999998},"min":{"1min":0.53300000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78200000000000003,"15min":0.77800000000000002},"min":{"1min":0.58899999999999997,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.1479999999999999,"5min":1.216,"15min":1.216},"last":0.63100000000000001}]},{"osd":4,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.93500000000000005,"15min":0.93899999999999995},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0589999999999999,"5min":1.702,"15min":1.702},"last":1.2230000000000001},{"interface":"front","average":{"1min":0.90400000000000003,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.73699999999999999,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.155,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.79000000000000004,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0740000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.99199999999999999,"5min":1.03,"15min":1.036},"min":{"1min":0.70199999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.3160000000000001,"5min":1.573,"15min":1.573},"last":0.999}]},{"osd":6,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.0720000000000001,"15min":1.081},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.3919999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.99399999999999999,"5min":1.038,"15min":1.046},"min":{"1min":0.85199999999999998,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.28,"5min":2.0230000000000001,"15min":2.0230000000000001},"last":1.272}]},{"osd":7,"last update":"Fri Jun 2 15:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.091,"15min":1.101},"min":{"1min":0.78200000000000003,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.234,"5min":1.8080000000000001,"15min":1.8080000000000001},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.81200000000000006,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.2929999999999999,"5min":1.363,"15min":1.363},"last":0.77700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33363,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-06-02T15:33:20.478 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-06-02T15:33:20.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4cb2d6640 1 Processor -- start 2023-06-02T15:33:20.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4cb2d6640 1 -- start start 2023-06-02T15:33:20.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4cb2d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c406cfc0 0x7fe4c40718d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4cb2d6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe4c406c250 0x7fe4c4149660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4cb2d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c414d220 con 0x7fe4c40a59e0 2023-06-02T15:33:20.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4cb2d6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c40ba640 con 0x7fe4c406c250 2023-06-02T15:33:20.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4cb2d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c414cd30 con 0x7fe4c406cfc0 2023-06-02T15:33:20.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9072640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe4c40a59e0 0x7fe4c414f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44766/0 (socket says 172.21.15.78:44766) 2023-06-02T15:33:20.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9072640 1 -- 172.21.15.78:0/3220765467 learned_addr learned my addr 172.21.15.78:0/3220765467 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:33:20.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9873640 1 --2- 172.21.15.78:0/3220765467 >> v2:172.21.15.132:3300/0 conn(0x7fe4c406c250 0x7fe4c4149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c8871640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c406cfc0 0x7fe4c40718d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071939255 0 0) 0x7fe4c414d220 con 0x7fe4c40a59e0 2023-06-02T15:33:20.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b0003530 con 0x7fe4c40a59e0 2023-06-02T15:33:20.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3554644535 0 0) 0x7fe4b0003530 con 0x7fe4c40a59e0 2023-06-02T15:33:20.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c406cfc0 msgr2=0x7fe4c40718d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:20.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c406cfc0 0x7fe4c40718d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 >> v2:172.21.15.132:3300/0 conn(0x7fe4c406c250 msgr2=0x7fe4c4149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:20.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 --2- 172.21.15.78:0/3220765467 >> v2:172.21.15.132:3300/0 conn(0x7fe4c406c250 0x7fe4c4149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c40ba850 con 0x7fe4c40a59e0 2023-06-02T15:33:20.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7fe4b4001680 con 0x7fe4c40a59e0 2023-06-02T15:33:20.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 >> v1:172.21.15.78:6789/0 conn(0x7fe4c40a59e0 legacy=0x7fe4c414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4b00039f0 0x7fe4b0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c406cfc0 0x7fe4b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b0004d10 0x7fe4b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c40ba640 con 0x7fe4b0004d10 2023-06-02T15:33:20.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c414cd30 con 0x7fe4b00039f0 2023-06-02T15:33:20.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b000ba40 con 0x7fe4c406cfc0 2023-06-02T15:33:20.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9873640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b0004d10 0x7fe4b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c8871640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c406cfc0 0x7fe4b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9072640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4b00039f0 0x7fe4b0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9873640 1 -- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c406cfc0 msgr2=0x7fe4b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:20.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9873640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c406cfc0 0x7fe4b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9873640 1 -- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4b00039f0 msgr2=0x7fe4b0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:20.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9873640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4b00039f0 0x7fe4b0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9873640 1 -- 172.21.15.78:0/3220765467 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b0003530 con 0x7fe4b0004d10 2023-06-02T15:33:20.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.625+0000 7fe4c9072640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4b00039f0 0x7fe4b0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:33:20.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4c9873640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b0004d10 0x7fe4b0005180 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009fc0 tx=0x7fe4bc01cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b4ddfc6be21d5e server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:20.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0a5ad0 con 0x7fe4b0004d10 2023-06-02T15:33:20.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc00f040 con 0x7fe4b0004d10 2023-06-02T15:33:20.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4bbfff640 1 -- 172.21.15.78:0/3220765467 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc0a5e70 con 0x7fe4b0004d10 2023-06-02T15:33:20.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3220765467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b0004d10 msgr2=0x7fe4b0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4cb2d6640 1 --2- 172.21.15.78:0/3220765467 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4b0004d10 0x7fe4b0005180 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc009fc0 tx=0x7fe4bc01cac0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4c9873640 1 -- 172.21.15.78:0/3220765467 reap_dead start 2023-06-02T15:33:20.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3220765467 shutdown_connections 2023-06-02T15:33:20.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3220765467 >> 172.21.15.78:0/3220765467 conn(0x7fe4c40a2170 msgr2=0x7fe4c40a2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:20.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3220765467 shutdown_connections 2023-06-02T15:33:20.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3220765467 wait complete. 2023-06-02T15:33:20.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4cb2d6640 1 Processor -- start 2023-06-02T15:33:20.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.629+0000 7fe4cb2d6640 1 -- start start 2023-06-02T15:33:20.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4cb2d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c41df000 0x7fe4c41df3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4cb2d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40b88e0 0x7fe4c414d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4cb2d6640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c414db40 0x7fe4c4148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4cb2d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c414f030 con 0x7fe4c40b88e0 2023-06-02T15:33:20.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4cb2d6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c414f210 con 0x7fe4c41df000 2023-06-02T15:33:20.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4cb2d6640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c40b8d80 con 0x7fe4c414db40 2023-06-02T15:33:20.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c8871640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40b88e0 0x7fe4c414d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c8871640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40b88e0 0x7fe4c414d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59206/0 (socket says 172.21.15.78:59206) 2023-06-02T15:33:20.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c8871640 1 -- 172.21.15.78:0/3650720717 learned_addr learned my addr 172.21.15.78:0/3650720717 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:20.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c9072640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c41df000 0x7fe4c41df3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c9873640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c414db40 0x7fe4c4148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c8871640 1 -- 172.21.15.78:0/3650720717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c414db40 msgr2=0x7fe4c4148380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c8871640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c414db40 0x7fe4c4148380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c8871640 1 -- 172.21.15.78:0/3650720717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c41df000 msgr2=0x7fe4c41df3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c8871640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c41df000 0x7fe4c41df3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c8871640 1 -- 172.21.15.78:0/3650720717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c414ff50 con 0x7fe4c40b88e0 2023-06-02T15:33:20.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c8871640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40b88e0 0x7fe4c414d600 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0011600 tx=0x7fe4c0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:20.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4b9ffb640 1 -- 172.21.15.78:0/3650720717 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c000f8c0 con 0x7fe4c40b88e0 2023-06-02T15:33:20.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4b9ffb640 1 -- 172.21.15.78:0/3650720717 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c000fa20 con 0x7fe4c40b88e0 2023-06-02T15:33:20.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3650720717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c414cf40 con 0x7fe4c40b88e0 2023-06-02T15:33:20.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4b9ffb640 1 -- 172.21.15.78:0/3650720717 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c000fdd0 con 0x7fe4c40b88e0 2023-06-02T15:33:20.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3650720717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c40a5db0 con 0x7fe4c40b88e0 2023-06-02T15:33:20.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3650720717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c40b7d30 con 0x7fe4c40b88e0 2023-06-02T15:33:20.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4b9ffb640 1 -- 172.21.15.78:0/3650720717 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7fe4c0015460 con 0x7fe4c40b88e0 2023-06-02T15:33:20.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4b9ffb640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe4a8065bc0 0x7fe4a8068070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c9072640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe4a8065bc0 0x7fe4a8068070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4b9ffb640 1 -- 172.21.15.78:0/3650720717 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe4c0083e80 con 0x7fe4c40b88e0 2023-06-02T15:33:20.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.633+0000 7fe4c9072640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe4a8065bc0 0x7fe4a8068070 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4001060 tx=0x7fe4b4000bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:20.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.637+0000 7fe4b9ffb640 1 -- 172.21.15.78:0/3650720717 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7fe4c00513b0 con 0x7fe4c40b88e0 2023-06-02T15:33:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.777+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3650720717 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fe4c4073bc0 con 0x7fe4c40b88e0 2023-06-02T15:33:20.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.789+0000 7fe4b9ffb640 1 -- 172.21.15.78:0/3650720717 <== mon.0 v2:172.21.15.78:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe4c00513b0 con 0x7fe4c40b88e0 2023-06-02T15:33:20.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.789+0000 7fe4b9ffb640 1 -- 172.21.15.78:0/3650720717 <== mon.0 v2:172.21.15.78:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7fe4c00549d0 con 0x7fe4c40b88e0 2023-06-02T15:33:20.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3650720717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe4a8065bc0 msgr2=0x7fe4a8068070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe4a8065bc0 0x7fe4a8068070 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4001060 tx=0x7fe4b4000bd0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3650720717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40b88e0 msgr2=0x7fe4c414d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40b88e0 0x7fe4c414d600 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0011600 tx=0x7fe4c0011ac0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3650720717 shutdown_connections 2023-06-02T15:33:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7fe4c414db40 0x7fe4c4148380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7fe4a8065bc0 0x7fe4a8068070 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe4c40b88e0 0x7fe4c414d600 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 --2- 172.21.15.78:0/3650720717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c41df000 0x7fe4c41df3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3650720717 >> 172.21.15.78:0/3650720717 conn(0x7fe4c40a2170 msgr2=0x7fe4c40a3470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:20.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3650720717 shutdown_connections 2023-06-02T15:33:20.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.793+0000 7fe4cb2d6640 1 -- 172.21.15.78:0/3650720717 wait complete. 2023-06-02T15:33:20.812 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-06-02T15:33:20.812 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-02T15:33:20.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.921+0000 7f4ba3d30640 1 Processor -- start 2023-06-02T15:33:20.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.921+0000 7f4ba3d30640 1 -- start start 2023-06-02T15:33:20.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba3d30640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b9c149e00 0x7f4b9c0a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba3d30640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c0bb0e0 con 0x7f4b9c0ba880 2023-06-02T15:33:20.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba3d30640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c0a3810 con 0x7f4b9c14fe20 2023-06-02T15:33:20.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba3d30640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b9c14a1d0 con 0x7f4b9c149e00 2023-06-02T15:33:20.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba12cb640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4b9c0ba880 0x7f4b9c0a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44774/0 (socket says 172.21.15.78:44774) 2023-06-02T15:33:20.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba12cb640 1 -- 172.21.15.78:0/4267235267 learned_addr learned my addr 172.21.15.78:0/4267235267 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:33:20.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba1acc640 1 --2- 172.21.15.78:0/4267235267 >> v2:172.21.15.132:3300/0 conn(0x7f4b9c149e00 0x7f4b9c0a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270904748 0 0) 0x7f4b9c0bb0e0 con 0x7f4b9c0ba880 2023-06-02T15:33:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b88003530 con 0x7f4b9c0ba880 2023-06-02T15:33:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3428818429 0 0) 0x7f4b88003530 con 0x7f4b9c0ba880 2023-06-02T15:33:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 >> v2:172.21.15.132:3300/0 conn(0x7f4b9c149e00 msgr2=0x7f4b9c0a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 --2- 172.21.15.78:0/4267235267 >> v2:172.21.15.132:3300/0 conn(0x7f4b9c149e00 0x7f4b9c0a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 >> v1:172.21.15.132:6789/0 conn(0x7f4b9c14fe20 legacy=0x7f4b9c1502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c0a3af0 con 0x7f4b9c0ba880 2023-06-02T15:33:20.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f4b8c001680 con 0x7f4b9c0ba880 2023-06-02T15:33:20.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 >> v1:172.21.15.78:6789/0 conn(0x7f4b9c0ba880 legacy=0x7f4b9c0a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b88003980 0x7f4b88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b880047d0 0x7f4b88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c14a1d0 con 0x7f4b88005180 2023-06-02T15:33:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8800c000 con 0x7f4b880047d0 2023-06-02T15:33:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b8800c1c0 con 0x7f4b88003980 2023-06-02T15:33:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba22cd640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba1acc640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b88003980 0x7f4b88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba22cd640 1 -- 172.21.15.78:0/4267235267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b88003980 msgr2=0x7f4b88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:20.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba22cd640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b88003980 0x7f4b88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba12cb640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b880047d0 0x7f4b88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba22cd640 1 -- 172.21.15.78:0/4267235267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b880047d0 msgr2=0x7f4b88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:20.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba22cd640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b880047d0 0x7f4b88004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba22cd640 1 -- 172.21.15.78:0/4267235267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88003530 con 0x7f4b88005180 2023-06-02T15:33:20.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.925+0000 7f4ba1acc640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b88003980 0x7f4b88003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:33:20.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba22cd640 1 -- 172.21.15.78:0/4267235267 reap_dead start 2023-06-02T15:33:20.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba22cd640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b8800b990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4b94001e70 tx=0x7f4b9401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb5a7ed8174e881 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:20.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94003b80 con 0x7f4b88005180 2023-06-02T15:33:20.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4b94003d00 con 0x7f4b88005180 2023-06-02T15:33:20.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba0aca640 1 -- 172.21.15.78:0/4267235267 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94005280 con 0x7f4b88005180 2023-06-02T15:33:20.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- 172.21.15.78:0/4267235267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 msgr2=0x7f4b8800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b8800b990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4b94001e70 tx=0x7f4b9401c760 comp rx=0 tx=0).stop 2023-06-02T15:33:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- 172.21.15.78:0/4267235267 shutdown_connections 2023-06-02T15:33:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 --2- 172.21.15.78:0/4267235267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b8800b990 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- 172.21.15.78:0/4267235267 >> 172.21.15.78:0/4267235267 conn(0x7f4b9c0bcf50 msgr2=0x7f4b9c0bd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:20.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- 172.21.15.78:0/4267235267 shutdown_connections 2023-06-02T15:33:20.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- 172.21.15.78:0/4267235267 wait complete. 2023-06-02T15:33:20.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 Processor -- start 2023-06-02T15:33:20.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- start start 2023-06-02T15:33:20.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b9c14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b9c14ab80 0x7f4b9c1e1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b9c1e1860 0x7f4b9c070540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0a61d0 con 0x7f4b88005180 2023-06-02T15:33:20.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c14d100 con 0x7f4b9c1e1860 2023-06-02T15:33:20.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c1e21b0 con 0x7f4b9c14ab80 2023-06-02T15:33:20.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba1acc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b9c14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba1acc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b9c14a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59230/0 (socket says 172.21.15.78:59230) 2023-06-02T15:33:20.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba1acc640 1 -- 172.21.15.78:0/1104464552 learned_addr learned my addr 172.21.15.78:0/1104464552 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:20.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba12cb640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b9c14ab80 0x7f4b9c1e1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba1acc640 1 -- 172.21.15.78:0/1104464552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b9c14ab80 msgr2=0x7f4b9c1e1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba1acc640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b9c14ab80 0x7f4b9c1e1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba1acc640 1 -- 172.21.15.78:0/1104464552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b9c1e1860 msgr2=0x7f4b9c070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:20.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba1acc640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b9c1e1860 0x7f4b9c070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:20.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba1acc640 1 -- 172.21.15.78:0/1104464552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c0a5bd0 con 0x7f4b88005180 2023-06-02T15:33:20.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba12cb640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b9c14ab80 0x7f4b9c1e1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:33:20.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba1acc640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b9c14a640 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4b98010900 tx=0x7f4b98010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:20.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4b927fc640 1 -- 172.21.15.78:0/1104464552 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800ec20 con 0x7f4b88005180 2023-06-02T15:33:20.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4b927fc640 1 -- 172.21.15.78:0/1104464552 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4b9800ed80 con 0x7f4b88005180 2023-06-02T15:33:20.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- 172.21.15.78:0/1104464552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9c0a3dd0 con 0x7f4b88005180 2023-06-02T15:33:20.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4b927fc640 1 -- 172.21.15.78:0/1104464552 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98004280 con 0x7f4b88005180 2023-06-02T15:33:20.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.929+0000 7f4ba3d30640 1 -- 172.21.15.78:0/1104464552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c0a5d60 con 0x7f4b88005180 2023-06-02T15:33:20.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.933+0000 7f4ba3d30640 1 -- 172.21.15.78:0/1104464552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9c14cbf0 con 0x7f4b88005180 2023-06-02T15:33:20.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.933+0000 7f4b927fc640 1 -- 172.21.15.78:0/1104464552 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f4b98003620 con 0x7f4b88005180 2023-06-02T15:33:20.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.933+0000 7f4b927fc640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4b80065c00 0x7f4b800680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:20.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.933+0000 7f4ba12cb640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4b80065c00 0x7f4b800680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:20.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.933+0000 7f4b927fc640 1 -- 172.21.15.78:0/1104464552 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4b98083f80 con 0x7f4b88005180 2023-06-02T15:33:20.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.933+0000 7f4ba12cb640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4b80065c00 0x7f4b800680b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0be730 tx=0x7f4b8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:20.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:20.937+0000 7f4b927fc640 1 -- 172.21.15.78:0/1104464552 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f4b98051370 con 0x7f4b88005180 2023-06-02T15:33:21.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.121+0000 7f4ba3d30640 1 -- 172.21.15.78:0/1104464552 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b9c142820 con 0x7f4b88005180 2023-06-02T15:33:21.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.121+0000 7f4b927fc640 1 -- 172.21.15.78:0/1104464552 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3888 (secure 0 0 0) 0x7f4b98054990 con 0x7f4b88005180 2023-06-02T15:33:21.128 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:33:21.128 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/4074209272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4074209272},{"type":"v1","addr":"172.21.15.78:6836","nonce":4074209272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/987093145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":987093145},{"type":"v1","addr":"172.21.15.78:6837","nonce":987093145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-02T15:30:38.611635+0000","modified":"2023-06-02T15:30:54.737249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/3115859297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3115859297},{"type":"v1","addr":"172.21.15.132:6833","nonce":3115859297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-02T15:33:21.129 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-06-02T15:33:21.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 -- 172.21.15.78:0/1104464552 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4b80065c00 msgr2=0x7f4b800680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4b80065c00 0x7f4b800680b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c0be730 tx=0x7f4b8c009040 comp rx=0 tx=0).stop 2023-06-02T15:33:21.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 -- 172.21.15.78:0/1104464552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 msgr2=0x7f4b9c14a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b9c14a640 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4b98010900 tx=0x7f4b98010dc0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 -- 172.21.15.78:0/1104464552 shutdown_connections 2023-06-02T15:33:21.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b9c1e1860 0x7f4b9c070540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f4b9c14ab80 0x7f4b9c1e1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f4b80065c00 0x7f4b800680b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 --2- 172.21.15.78:0/1104464552 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4b88005180 0x7f4b9c14a640 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 -- 172.21.15.78:0/1104464552 >> 172.21.15.78:0/1104464552 conn(0x7f4b9c0bcf50 msgr2=0x7f4b9c150220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:21.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 -- 172.21.15.78:0/1104464552 shutdown_connections 2023-06-02T15:33:21.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.125+0000 7f4ba3d30640 1 -- 172.21.15.78:0/1104464552 wait complete. 2023-06-02T15:33:21.146 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-06-02T15:33:21.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.249+0000 7efcbc18d640 1 Processor -- start 2023-06-02T15:33:21.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.249+0000 7efcbc18d640 1 -- start start 2023-06-02T15:33:21.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcbc18d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efcb40c1380 0x7efcb40c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcbc18d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb414f3d0 con 0x7efcb40c1cf0 2023-06-02T15:33:21.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcbc18d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcb406be70 con 0x7efcb414ec20 2023-06-02T15:33:21.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcbc18d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcb40aa650 con 0x7efcb40c1380 2023-06-02T15:33:21.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcb9728640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efcb40c1380 0x7efcb40c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcb9728640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7efcb40c1380 0x7efcb40c17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59240/0 (socket says 172.21.15.78:59240) 2023-06-02T15:33:21.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcba72a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efcb40c1cf0 0x7efcb4158fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44784/0 (socket says 172.21.15.78:44784) 2023-06-02T15:33:21.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcb9728640 1 -- 172.21.15.78:0/1012982649 learned_addr learned my addr 172.21.15.78:0/1012982649 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:21.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcb9728640 1 -- 172.21.15.78:0/1012982649 >> v1:172.21.15.132:6789/0 conn(0x7efcb414ec20 legacy=0x7efcb40c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:21.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcb9728640 1 -- 172.21.15.78:0/1012982649 >> v1:172.21.15.78:6789/0 conn(0x7efcb40c1cf0 legacy=0x7efcb4158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcb9728640 1 -- 172.21.15.78:0/1012982649 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb406c0c0 con 0x7efcb40c1380 2023-06-02T15:33:21.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcb9728640 1 --2- 172.21.15.78:0/1012982649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb40c1380 0x7efcb40c17b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009e50 tx=0x7efcb001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d31e1e157040c0f server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:21.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcb8f27640 1 -- 172.21.15.78:0/1012982649 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00a57a0 con 0x7efcb40c1380 2023-06-02T15:33:21.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcb8f27640 1 -- 172.21.15.78:0/1012982649 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efcb00a5900 con 0x7efcb40c1380 2023-06-02T15:33:21.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcb8f27640 1 -- 172.21.15.78:0/1012982649 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcb00a5cb0 con 0x7efcb40c1380 2023-06-02T15:33:21.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcbc18d640 1 -- 172.21.15.78:0/1012982649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb40c1380 msgr2=0x7efcb40c17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.253+0000 7efcbc18d640 1 --2- 172.21.15.78:0/1012982649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb40c1380 0x7efcb40c17b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efcb0009e50 tx=0x7efcb001c9d0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- 172.21.15.78:0/1012982649 shutdown_connections 2023-06-02T15:33:21.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 --2- 172.21.15.78:0/1012982649 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb40c1380 0x7efcb40c17b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- 172.21.15.78:0/1012982649 >> 172.21.15.78:0/1012982649 conn(0x7efcb4071020 msgr2=0x7efcb4071420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:21.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- 172.21.15.78:0/1012982649 shutdown_connections 2023-06-02T15:33:21.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- 172.21.15.78:0/1012982649 wait complete. 2023-06-02T15:33:21.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 Processor -- start 2023-06-02T15:33:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- start start 2023-06-02T15:33:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcb40c1380 0x7efcb414fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcb40c1cf0 0x7efcb41524e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb414ec20 0x7efcb41e8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb40a6ea0 con 0x7efcb414ec20 2023-06-02T15:33:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb414bbb0 con 0x7efcb40c1380 2023-06-02T15:33:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcb41509e0 con 0x7efcb40c1cf0 2023-06-02T15:33:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcba72a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb414ec20 0x7efcb41e8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcba72a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb414ec20 0x7efcb41e8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59256/0 (socket says 172.21.15.78:59256) 2023-06-02T15:33:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcba72a640 1 -- 172.21.15.78:0/782570128 learned_addr learned my addr 172.21.15.78:0/782570128 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcba72a640 1 -- 172.21.15.78:0/782570128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcb40c1cf0 msgr2=0x7efcb41524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcba72a640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcb40c1cf0 0x7efcb41524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcba72a640 1 -- 172.21.15.78:0/782570128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcb40c1380 msgr2=0x7efcb414fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcba72a640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcb40c1380 0x7efcb414fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcba72a640 1 -- 172.21.15.78:0/782570128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcb0009b30 con 0x7efcb414ec20 2023-06-02T15:33:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcba72a640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb414ec20 0x7efcb41e8780 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efcac00c3c0 tx=0x7efcac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcaa7fc640 1 -- 172.21.15.78:0/782570128 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac0074e0 con 0x7efcb414ec20 2023-06-02T15:33:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcaa7fc640 1 -- 172.21.15.78:0/782570128 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efcac007640 con 0x7efcb414ec20 2023-06-02T15:33:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- 172.21.15.78:0/782570128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb40bec80 con 0x7efcb414ec20 2023-06-02T15:33:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcaa7fc640 1 -- 172.21.15.78:0/782570128 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcac004a50 con 0x7efcb414ec20 2023-06-02T15:33:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- 172.21.15.78:0/782570128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb40c20f0 con 0x7efcb414ec20 2023-06-02T15:33:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.257+0000 7efcbc18d640 1 -- 172.21.15.78:0/782570128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb40bee10 con 0x7efcb414ec20 2023-06-02T15:33:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.261+0000 7efcaa7fc640 1 -- 172.21.15.78:0/782570128 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7efcac004bb0 con 0x7efcb414ec20 2023-06-02T15:33:21.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.261+0000 7efcaa7fc640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efc98065c00 0x7efc980680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.261+0000 7efcaa7fc640 1 -- 172.21.15.78:0/782570128 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7efcac0830e0 con 0x7efcb414ec20 2023-06-02T15:33:21.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.261+0000 7efcb9f29640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efc98065c00 0x7efc980680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.261+0000 7efcb9f29640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efc98065c00 0x7efc980680b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efca4009670 tx=0x7efca4006bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:21.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.265+0000 7efcaa7fc640 1 -- 172.21.15.78:0/782570128 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7efcac0504f0 con 0x7efcb414ec20 2023-06-02T15:33:21.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.437+0000 7efcbc18d640 1 -- 172.21.15.78:0/782570128 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efcb4152a20 con 0x7efcb414ec20 2023-06-02T15:33:21.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcaa7fc640 1 -- 172.21.15.78:0/782570128 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+3888 (secure 0 0 0) 0x7efcac004e60 con 0x7efcb414ec20 2023-06-02T15:33:21.445 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:33:21.445 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4236,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/4074209272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":4074209272},{"type":"v1","addr":"172.21.15.78:6836","nonce":4074209272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/987093145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":987093145},{"type":"v1","addr":"172.21.15.78:6837","nonce":987093145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-06-02T15:30:38.611635+0000","modified":"2023-06-02T15:30:54.737249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4273},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4273":{"gid":4273,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/3115859297","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":3115859297},{"type":"v1","addr":"172.21.15.132:6833","nonce":3115859297}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-06-02T15:33:21.446 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-06-02T15:33:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 -- 172.21.15.78:0/782570128 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efc98065c00 msgr2=0x7efc980680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efc98065c00 0x7efc980680b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efca4009670 tx=0x7efca4006bd0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 -- 172.21.15.78:0/782570128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb414ec20 msgr2=0x7efcb41e8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb414ec20 0x7efcb41e8780 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7efcac00c3c0 tx=0x7efcac00c880 comp rx=0 tx=0).stop 2023-06-02T15:33:21.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 -- 172.21.15.78:0/782570128 shutdown_connections 2023-06-02T15:33:21.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7efc98065c00 0x7efc980680b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efcb414ec20 0x7efcb41e8780 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7efcb40c1cf0 0x7efcb41524e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 --2- 172.21.15.78:0/782570128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efcb40c1380 0x7efcb414fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 -- 172.21.15.78:0/782570128 >> 172.21.15.78:0/782570128 conn(0x7efcb4071020 msgr2=0x7efcb40c40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:21.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 -- 172.21.15.78:0/782570128 shutdown_connections 2023-06-02T15:33:21.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.441+0000 7efcbc18d640 1 -- 172.21.15.78:0/782570128 wait complete. 2023-06-02T15:33:21.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-06-02T15:33:21.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.561+0000 7f9b982b1640 1 Processor -- start 2023-06-02T15:33:21.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.561+0000 7f9b982b1640 1 -- start start 2023-06-02T15:33:21.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.561+0000 7f9b982b1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b90151ea0 0x7f9b9006bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.561+0000 7f9b982b1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b9006c0a0 0x7f9b900a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.561+0000 7f9b982b1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b9006a3c0 0x7f9b900a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.561+0000 7f9b982b1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b9006afd0 con 0x7f9b9006c0a0 2023-06-02T15:33:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.561+0000 7f9b982b1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b900aa3e0 con 0x7f9b90151ea0 2023-06-02T15:33:21.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.561+0000 7f9b982b1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900c3460 con 0x7f9b9006a3c0 2023-06-02T15:33:21.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9584c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b9006c0a0 0x7f9b900a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9584c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9b9006c0a0 0x7f9b900a3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59266/0 (socket says 172.21.15.78:59266) 2023-06-02T15:33:21.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9584c640 1 -- 172.21.15.78:0/296299050 learned_addr learned my addr 172.21.15.78:0/296299050 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9684e640 1 --2- 172.21.15.78:0/296299050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b9006a3c0 0x7f9b900a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9584c640 1 -- 172.21.15.78:0/296299050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b9006a3c0 msgr2=0x7f9b900a3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9604d640 1 --2- 172.21.15.78:0/296299050 >> v2:172.21.15.132:3300/0 conn(0x7f9b90151ea0 0x7f9b9006bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9584c640 1 --2- 172.21.15.78:0/296299050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b9006a3c0 0x7f9b900a3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9584c640 1 -- 172.21.15.78:0/296299050 >> v2:172.21.15.132:3300/0 conn(0x7f9b90151ea0 msgr2=0x7f9b9006bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:21.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9584c640 1 --2- 172.21.15.78:0/296299050 >> v2:172.21.15.132:3300/0 conn(0x7f9b90151ea0 0x7f9b9006bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9584c640 1 -- 172.21.15.78:0/296299050 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b900c3740 con 0x7f9b9006c0a0 2023-06-02T15:33:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9584c640 1 --2- 172.21.15.78:0/296299050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006c0a0 0x7f9b900a3a00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9b9006a180 tx=0x7f9b8001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87096a3fda198ae9 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9504b640 1 -- 172.21.15.78:0/296299050 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b800ac630 con 0x7f9b9006c0a0 2023-06-02T15:33:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9504b640 1 -- 172.21.15.78:0/296299050 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9b800ac790 con 0x7f9b9006c0a0 2023-06-02T15:33:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b9504b640 1 -- 172.21.15.78:0/296299050 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b800acb40 con 0x7f9b9006c0a0 2023-06-02T15:33:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b982b1640 1 -- 172.21.15.78:0/296299050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006c0a0 msgr2=0x7f9b900a3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b982b1640 1 --2- 172.21.15.78:0/296299050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006c0a0 0x7f9b900a3a00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f9b9006a180 tx=0x7f9b8001c500 comp rx=0 tx=0).stop 2023-06-02T15:33:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b982b1640 1 -- 172.21.15.78:0/296299050 shutdown_connections 2023-06-02T15:33:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b982b1640 1 --2- 172.21.15.78:0/296299050 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b9006a3c0 0x7f9b900a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b982b1640 1 --2- 172.21.15.78:0/296299050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006c0a0 0x7f9b900a3a00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b982b1640 1 --2- 172.21.15.78:0/296299050 >> v2:172.21.15.132:3300/0 conn(0x7f9b90151ea0 0x7f9b9006bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b982b1640 1 -- 172.21.15.78:0/296299050 >> 172.21.15.78:0/296299050 conn(0x7f9b900a6580 msgr2=0x7f9b900a6980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b982b1640 1 -- 172.21.15.78:0/296299050 shutdown_connections 2023-06-02T15:33:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.565+0000 7f9b982b1640 1 -- 172.21.15.78:0/296299050 wait complete. 2023-06-02T15:33:21.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 Processor -- start 2023-06-02T15:33:21.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 -- start start 2023-06-02T15:33:21.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006a3c0 0x7f9b901471a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b9006c0a0 0x7f9b900a7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b90151ea0 0x7f9b90144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b900a9790 con 0x7f9b9006a3c0 2023-06-02T15:33:21.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b901e79b0 con 0x7f9b90151ea0 2023-06-02T15:33:21.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b901e7ee0 con 0x7f9b9006c0a0 2023-06-02T15:33:21.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9604d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006a3c0 0x7f9b901471a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9604d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006a3c0 0x7f9b901471a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59270/0 (socket says 172.21.15.78:59270) 2023-06-02T15:33:21.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9604d640 1 -- 172.21.15.78:0/828342306 learned_addr learned my addr 172.21.15.78:0/828342306 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:21.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9584c640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b9006c0a0 0x7f9b900a7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9684e640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b90151ea0 0x7f9b90144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9604d640 1 -- 172.21.15.78:0/828342306 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b9006c0a0 msgr2=0x7f9b900a7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9604d640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b9006c0a0 0x7f9b900a7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9604d640 1 -- 172.21.15.78:0/828342306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b90151ea0 msgr2=0x7f9b90144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9604d640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b90151ea0 0x7f9b90144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9604d640 1 -- 172.21.15.78:0/828342306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b800094d0 con 0x7f9b9006a3c0 2023-06-02T15:33:21.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9604d640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006a3c0 0x7f9b901471a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00c7f0 tx=0x7f9b8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:21.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b86ffd640 1 -- 172.21.15.78:0/828342306 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c007820 con 0x7f9b9006a3c0 2023-06-02T15:33:21.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b86ffd640 1 -- 172.21.15.78:0/828342306 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9b8c007980 con 0x7f9b9006a3c0 2023-06-02T15:33:21.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 -- 172.21.15.78:0/828342306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9014eee0 con 0x7f9b9006a3c0 2023-06-02T15:33:21.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b86ffd640 1 -- 172.21.15.78:0/828342306 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c007d50 con 0x7f9b9006a3c0 2023-06-02T15:33:21.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 -- 172.21.15.78:0/828342306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b900c4750 con 0x7f9b9006a3c0 2023-06-02T15:33:21.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b982b1640 1 -- 172.21.15.78:0/828342306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9014f070 con 0x7f9b9006a3c0 2023-06-02T15:33:21.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b86ffd640 1 -- 172.21.15.78:0/828342306 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f9b8c0113f0 con 0x7f9b9006a3c0 2023-06-02T15:33:21.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b86ffd640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b74065c00 0x7f9b740680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b86ffd640 1 -- 172.21.15.78:0/828342306 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9b8c083950 con 0x7f9b9006a3c0 2023-06-02T15:33:21.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.569+0000 7f9b9584c640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b74065c00 0x7f9b740680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.573+0000 7f9b9584c640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b74065c00 0x7f9b740680b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b800ae000 tx=0x7f9b80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:21.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.573+0000 7f9b86ffd640 1 -- 172.21.15.78:0/828342306 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f9b8c050df0 con 0x7f9b9006a3c0 2023-06-02T15:33:21.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.725+0000 7f9b982b1640 1 -- 172.21.15.78:0/828342306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9b90073bc0 con 0x7f9b9006a3c0 2023-06-02T15:33:21.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.729+0000 7f9b86ffd640 1 -- 172.21.15.78:0/828342306 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+19689 (secure 0 0 0) 0x7f9b8c054410 con 0x7f9b9006a3c0 2023-06-02T15:33:21.735 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-06-02T15:33:21.736 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":27,"fsid":"9af8d860-9431-412c-b8a4-990228d6b597","created":"2023-06-02T15:30:20.752314+0000","modified":"2023-06-02T15:31:26.567542+0000","last_up_change":"2023-06-02T15:30:31.381228+0000","last_in_change":"2023-06-02T15:30:23.112370+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2023-06-02T15:30:31.844882+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2023-06-02T15:30:33.293644+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-06-02T15:30:36.277798+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-06-02T15:30:37.599884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-06-02T15:30:40.680165+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81de9701-ff04-401f-a4d6-385203d117fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":37134},{"type":"v1","addr":"172.21.15.78:6801","nonce":37134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":37134},{"type":"v1","addr":"172.21.15.78:6803","nonce":37134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":37134},{"type":"v1","addr":"172.21.15.78:6807","nonce":37134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":37134},{"type":"v1","addr":"172.21.15.78:6805","nonce":37134}]},"public_addr":"172.21.15.78:6801/37134","cluster_addr":"172.21.15.78:6803/37134","heartbeat_back_addr":"172.21.15.78:6807/37134","heartbeat_front_addr":"172.21.15.78:6805/37134","state":["exists","up"]},{"osd":1,"uuid":"81c04070-19f3-4cc4-9ee0-46ac7d200b49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":37135},{"type":"v1","addr":"172.21.15.78:6825","nonce":37135}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":37135},{"type":"v1","addr":"172.21.15.78:6827","nonce":37135}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":37135},{"type":"v1","addr":"172.21.15.78:6831","nonce":37135}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":37135},{"type":"v1","addr":"172.21.15.78:6829","nonce":37135}]},"public_addr":"172.21.15.78:6825/37135","cluster_addr":"172.21.15.78:6827/37135","heartbeat_back_addr":"172.21.15.78:6831/37135","heartbeat_front_addr":"172.21.15.78:6829/37135","state":["exists","up"]},{"osd":2,"uuid":"2a1911f4-0f97-4074-b1a2-1ad2b9698c8f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":37136},{"type":"v1","addr":"172.21.15.78:6817","nonce":37136}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":37136},{"type":"v1","addr":"172.21.15.78:6819","nonce":37136}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":37136},{"type":"v1","addr":"172.21.15.78:6823","nonce":37136}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":37136},{"type":"v1","addr":"172.21.15.78:6821","nonce":37136}]},"public_addr":"172.21.15.78:6817/37136","cluster_addr":"172.21.15.78:6819/37136","heartbeat_back_addr":"172.21.15.78:6823/37136","heartbeat_front_addr":"172.21.15.78:6821/37136","state":["exists","up"]},{"osd":3,"uuid":"c7b07679-693b-4ac9-84ff-71af0d08b77a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":37137},{"type":"v1","addr":"172.21.15.78:6809","nonce":37137}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":37137},{"type":"v1","addr":"172.21.15.78:6811","nonce":37137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":37137},{"type":"v1","addr":"172.21.15.78:6815","nonce":37137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":37137},{"type":"v1","addr":"172.21.15.78:6813","nonce":37137}]},"public_addr":"172.21.15.78:6809/37137","cluster_addr":"172.21.15.78:6811/37137","heartbeat_back_addr":"172.21.15.78:6815/37137","heartbeat_front_addr":"172.21.15.78:6813/37137","state":["exists","up"]},{"osd":4,"uuid":"fc9bae87-5c32-44b2-af2a-619f0a0339c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":37342},{"type":"v1","addr":"172.21.15.132:6817","nonce":37342}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":37342},{"type":"v1","addr":"172.21.15.132:6819","nonce":37342}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":37342},{"type":"v1","addr":"172.21.15.132:6823","nonce":37342}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":37342},{"type":"v1","addr":"172.21.15.132:6821","nonce":37342}]},"public_addr":"172.21.15.132:6817/37342","cluster_addr":"172.21.15.132:6819/37342","heartbeat_back_addr":"172.21.15.132:6823/37342","heartbeat_front_addr":"172.21.15.132:6821/37342","state":["exists","up"]},{"osd":5,"uuid":"6284d11a-8e31-42e9-a34b-787229a6bc92","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":37340},{"type":"v1","addr":"172.21.15.132:6809","nonce":37340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":37340},{"type":"v1","addr":"172.21.15.132:6811","nonce":37340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":37340},{"type":"v1","addr":"172.21.15.132:6815","nonce":37340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":37340},{"type":"v1","addr":"172.21.15.132:6813","nonce":37340}]},"public_addr":"172.21.15.132:6809/37340","cluster_addr":"172.21.15.132:6811/37340","heartbeat_back_addr":"172.21.15.132:6815/37340","heartbeat_front_addr":"172.21.15.132:6813/37340","state":["exists","up"]},{"osd":6,"uuid":"420898d9-6763-4c2e-ad6a-452179b91462","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":37341},{"type":"v1","addr":"172.21.15.132:6825","nonce":37341}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":37341},{"type":"v1","addr":"172.21.15.132:6827","nonce":37341}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":37341},{"type":"v1","addr":"172.21.15.132:6831","nonce":37341}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":37341},{"type":"v1","addr":"172.21.15.132:6829","nonce":37341}]},"public_addr":"172.21.15.132:6825/37341","cluster_addr":"172.21.15.132:6827/37341","heartbeat_back_addr":"172.21.15.132:6831/37341","heartbeat_front_addr":"172.21.15.132:6829/37341","state":["exists","up"]},{"osd":7,"uuid":"2c515b77-0cfc-4f0f-9254-642711cc3f19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":37343},{"type":"v1","addr":"172.21.15.132:6801","nonce":37343}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":37343},{"type":"v1","addr":"172.21.15.132:6803","nonce":37343}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":37343},{"type":"v1","addr":"172.21.15.132:6807","nonce":37343}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":37343},{"type":"v1","addr":"172.21.15.132:6805","nonce":37343}]},"public_addr":"172.21.15.132:6801/37343","cluster_addr":"172.21.15.132:6803/37343","heartbeat_back_addr":"172.21.15.132:6807/37343","heartbeat_front_addr":"172.21.15.132:6805/37343","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.558257+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.800978+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.765248+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.716867+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.718438+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.640630+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.695106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-06-02T15:30:28.414717+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.f","mappings":[{"from":1,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-06-02T15:33:21.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 -- 172.21.15.78:0/828342306 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b74065c00 msgr2=0x7f9b740680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b74065c00 0x7f9b740680b0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f9b800ae000 tx=0x7f9b80008040 comp rx=0 tx=0).stop 2023-06-02T15:33:21.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 -- 172.21.15.78:0/828342306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006a3c0 msgr2=0x7f9b901471a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006a3c0 0x7f9b901471a0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00c7f0 tx=0x7f9b8c00ccb0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 -- 172.21.15.78:0/828342306 shutdown_connections 2023-06-02T15:33:21.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b90151ea0 0x7f9b90144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9b9006c0a0 0x7f9b900a7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9b74065c00 0x7f9b740680b0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 --2- 172.21.15.78:0/828342306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9b9006a3c0 0x7f9b901471a0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 -- 172.21.15.78:0/828342306 >> 172.21.15.78:0/828342306 conn(0x7f9b900a6580 msgr2=0x7f9b9014b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:21.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 -- 172.21.15.78:0/828342306 shutdown_connections 2023-06-02T15:33:21.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.733+0000 7f9b982b1640 1 -- 172.21.15.78:0/828342306 wait complete. 2023-06-02T15:33:21.753 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-06-02T15:33:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f6480b90640 1 Processor -- start 2023-06-02T15:33:21.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f6480b90640 1 -- start start 2023-06-02T15:33:21.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f6480b90640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f647c070f80 0x7f647c152330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f6480b90640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c071600 con 0x7f647c0708d0 2023-06-02T15:33:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f6480b90640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f647c06ce50 con 0x7f647c14bb10 2023-06-02T15:33:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f6480b90640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f647c0718e0 con 0x7f647c070f80 2023-06-02T15:33:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f6479d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f647c0708d0 0x7f647c151c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44790/0 (socket says 172.21.15.78:44790) 2023-06-02T15:33:21.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f6479d9b640 1 -- 172.21.15.78:0/1325716864 learned_addr learned my addr 172.21.15.78:0/1325716864 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:33:21.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647ad9d640 1 --2- 172.21.15.78:0/1325716864 >> v2:172.21.15.132:3300/0 conn(0x7f647c070f80 0x7f647c152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3248792143 0 0) 0x7f647c071600 con 0x7f647c0708d0 2023-06-02T15:33:21.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6464003530 con 0x7f647c0708d0 2023-06-02T15:33:21.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2888555698 0 0) 0x7f6464003530 con 0x7f647c0708d0 2023-06-02T15:33:21.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 >> v2:172.21.15.132:3300/0 conn(0x7f647c070f80 msgr2=0x7f647c152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:21.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 --2- 172.21.15.78:0/1325716864 >> v2:172.21.15.132:3300/0 conn(0x7f647c070f80 0x7f647c152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 >> v1:172.21.15.132:6789/0 conn(0x7f647c14bb10 legacy=0x7f647c06a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c06d130 con 0x7f647c0708d0 2023-06-02T15:33:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f6470001680 con 0x7f647c0708d0 2023-06-02T15:33:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 >> v1:172.21.15.78:6789/0 conn(0x7f647c0708d0 legacy=0x7f647c151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 --2- 172.21.15.78:0/1325716864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f6464003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 --2- 172.21.15.78:0/1325716864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64640047d0 0x7f6464004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 --2- 172.21.15.78:0/1325716864 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6464005180 0x7f646400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646400c060 con 0x7f64640039f0 2023-06-02T15:33:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646400c1a0 con 0x7f64640047d0 2023-06-02T15:33:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646400c360 con 0x7f6464005180 2023-06-02T15:33:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647a59c640 1 --2- 172.21.15.78:0/1325716864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f6464003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f6479d9b640 1 --2- 172.21.15.78:0/1325716864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64640047d0 0x7f6464004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647a59c640 1 -- 172.21.15.78:0/1325716864 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6464005180 msgr2=0x7f646400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647a59c640 1 --2- 172.21.15.78:0/1325716864 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f6464005180 0x7f646400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647a59c640 1 -- 172.21.15.78:0/1325716864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64640047d0 msgr2=0x7f6464004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647a59c640 1 --2- 172.21.15.78:0/1325716864 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64640047d0 0x7f6464004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647a59c640 1 -- 172.21.15.78:0/1325716864 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6464003530 con 0x7f64640039f0 2023-06-02T15:33:21.874 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.861+0000 7f647ad9d640 1 -- 172.21.15.78:0/1325716864 reap_dead start 2023-06-02T15:33:21.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f647a59c640 1 --2- 172.21.15.78:0/1325716864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f6464003e00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f646c001780 tx=0x7f646c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=693cbe4200ec7945 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:21.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0052d0 con 0x7f64640039f0 2023-06-02T15:33:21.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f646c0a7050 con 0x7f64640039f0 2023-06-02T15:33:21.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f647959a640 1 -- 172.21.15.78:0/1325716864 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c003600 con 0x7f64640039f0 2023-06-02T15:33:21.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f6480b90640 1 -- 172.21.15.78:0/1325716864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 msgr2=0x7f6464003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f6480b90640 1 --2- 172.21.15.78:0/1325716864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f6464003e00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f646c001780 tx=0x7f646c01c3a0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f6480b90640 1 -- 172.21.15.78:0/1325716864 shutdown_connections 2023-06-02T15:33:21.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f6480b90640 1 --2- 172.21.15.78:0/1325716864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f6464003e00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f6480b90640 1 -- 172.21.15.78:0/1325716864 >> 172.21.15.78:0/1325716864 conn(0x7f647c0bd800 msgr2=0x7f647c0bdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:21.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f6480b90640 1 -- 172.21.15.78:0/1325716864 shutdown_connections 2023-06-02T15:33:21.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f6480b90640 1 -- 172.21.15.78:0/1325716864 wait complete. 2023-06-02T15:33:21.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.865+0000 7f6480b90640 1 Processor -- start 2023-06-02T15:33:21.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6480b90640 1 -- start start 2023-06-02T15:33:21.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6480b90640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f647c147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6480b90640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f647c143490 0x7f647c142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6480b90640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f647c1430a0 0x7f647c150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6480b90640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c1e6980 con 0x7f64640039f0 2023-06-02T15:33:21.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6480b90640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647c147860 con 0x7f647c143490 2023-06-02T15:33:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6480b90640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647c1e6bf0 con 0x7f647c1430a0 2023-06-02T15:33:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f647a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f647c147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f647a59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f647c147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59286/0 (socket says 172.21.15.78:59286) 2023-06-02T15:33:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f647a59c640 1 -- 172.21.15.78:0/3545277333 learned_addr learned my addr 172.21.15.78:0/3545277333 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6479d9b640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f647c143490 0x7f647c142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f647a59c640 1 -- 172.21.15.78:0/3545277333 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f647c1430a0 msgr2=0x7f647c150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f647a59c640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f647c1430a0 0x7f647c150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f647a59c640 1 -- 172.21.15.78:0/3545277333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f647c143490 msgr2=0x7f647c142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f647a59c640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f647c143490 0x7f647c142b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f647a59c640 1 -- 172.21.15.78:0/3545277333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c151db0 con 0x7f64640039f0 2023-06-02T15:33:21.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f647a59c640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f647c147320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f646c005040 tx=0x7f6464005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f646affd640 1 -- 172.21.15.78:0/3545277333 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c007230 con 0x7f64640039f0 2023-06-02T15:33:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f646affd640 1 -- 172.21.15.78:0/3545277333 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f647c06b110 con 0x7f64640039f0 2023-06-02T15:33:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6480b90640 1 -- 172.21.15.78:0/3545277333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f647c151c20 con 0x7f64640039f0 2023-06-02T15:33:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f646affd640 1 -- 172.21.15.78:0/3545277333 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f646c0075f0 con 0x7f64640039f0 2023-06-02T15:33:21.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6480b90640 1 -- 172.21.15.78:0/3545277333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f647c151f40 con 0x7f64640039f0 2023-06-02T15:33:21.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6480b90640 1 -- 172.21.15.78:0/3545277333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f647c073bc0 con 0x7f64640039f0 2023-06-02T15:33:21.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f646affd640 1 -- 172.21.15.78:0/3545277333 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f646c0067e0 con 0x7f64640039f0 2023-06-02T15:33:21.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f646affd640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f645c065c00 0x7f645c0680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:21.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6479d9b640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f645c065c00 0x7f645c0680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:21.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f646affd640 1 -- 172.21.15.78:0/3545277333 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f646c11d5c0 con 0x7f64640039f0 2023-06-02T15:33:21.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.869+0000 7f6479d9b640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f645c065c00 0x7f645c0680b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6470001210 tx=0x7f6470009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:21.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:21.877+0000 7f646affd640 1 -- 172.21.15.78:0/3545277333 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f646c0eaa60 con 0x7f64640039f0 2023-06-02T15:33:22.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.053+0000 7f6480b90640 1 -- 172.21.15.78:0/3545277333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f647c06ca90 con 0x7f64640039f0 2023-06-02T15:33:22.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.813+0000 7f646affd640 1 -- 172.21.15.78:0/3545277333 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f646c0ee080 con 0x7f64640039f0 2023-06-02T15:33:22.820 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-06-02T15:33:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.817+0000 7f6480b90640 1 -- 172.21.15.78:0/3545277333 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f645c065c00 msgr2=0x7f645c0680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.817+0000 7f6480b90640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f645c065c00 0x7f645c0680b0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6470001210 tx=0x7f6470009040 comp rx=0 tx=0).stop 2023-06-02T15:33:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.821+0000 7f6480b90640 1 -- 172.21.15.78:0/3545277333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 msgr2=0x7f647c147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.821+0000 7f6480b90640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f647c147320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f646c005040 tx=0x7f6464005800 comp rx=0 tx=0).stop 2023-06-02T15:33:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.821+0000 7f6480b90640 1 -- 172.21.15.78:0/3545277333 shutdown_connections 2023-06-02T15:33:22.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.821+0000 7f6480b90640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f647c1430a0 0x7f647c150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.821+0000 7f6480b90640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f647c143490 0x7f647c142b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.821+0000 7f6480b90640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f645c065c00 0x7f645c0680b0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.821+0000 7f6480b90640 1 --2- 172.21.15.78:0/3545277333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f64640039f0 0x7f647c147320 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.821+0000 7f6480b90640 1 -- 172.21.15.78:0/3545277333 >> 172.21.15.78:0/3545277333 conn(0x7f647c0bd800 msgr2=0x7f647c06fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:22.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.821+0000 7f6480b90640 1 -- 172.21.15.78:0/3545277333 shutdown_connections 2023-06-02T15:33:22.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.821+0000 7f6480b90640 1 -- 172.21.15.78:0/3545277333 wait complete. 2023-06-02T15:33:22.830 INFO:tasks.ceph.mds.b.smithi132.stderr: -5335> 2023-06-02T15:30:44.565+0000 7f07f33c6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-06-02T15:33:22.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-06-02T15:33:22.895 INFO:tasks.ceph.mds.b.smithi132.stdout:starting mds.b at 2023-06-02T15:33:22.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f120e0ce640 1 Processor -- start 2023-06-02T15:33:22.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f120e0ce640 1 -- start start 2023-06-02T15:33:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f120e0ce640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f12080bd3a0 0x7f120814e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f120e0ce640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120806cf80 con 0x7f120814ebf0 2023-06-02T15:33:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f120e0ce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f120806d1d0 con 0x7f120814bcc0 2023-06-02T15:33:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f120e0ce640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12080c0670 con 0x7f12080bd3a0 2023-06-02T15:33:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f1207fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f120814ebf0 0x7f1208158f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44794/0 (socket says 172.21.15.78:44794) 2023-06-02T15:33:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f1207fff640 1 -- 172.21.15.78:0/2975488646 learned_addr learned my addr 172.21.15.78:0/2975488646 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:33:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f1206ffd640 1 --2- 172.21.15.78:0/2975488646 >> v2:172.21.15.78:3300/0 conn(0x7f12080bd3a0 0x7f120814e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:22.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f12067fc640 1 -- 172.21.15.78:0/2975488646 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218762800 0 0) 0x7f120806cf80 con 0x7f120814ebf0 2023-06-02T15:33:22.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f12067fc640 1 -- 172.21.15.78:0/2975488646 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f0003530 con 0x7f120814ebf0 2023-06-02T15:33:22.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f1206ffd640 1 -- 172.21.15.78:0/2975488646 >> v1:172.21.15.132:6789/0 conn(0x7f120814bcc0 legacy=0x7f12080698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:22.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.965+0000 7f1206ffd640 1 -- 172.21.15.78:0/2975488646 >> v1:172.21.15.78:6789/0 conn(0x7f120814ebf0 legacy=0x7f1208158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:22.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f1206ffd640 1 -- 172.21.15.78:0/2975488646 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12080c0100 con 0x7f12080bd3a0 2023-06-02T15:33:22.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f1206ffd640 1 --2- 172.21.15.78:0/2975488646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12080bd3a0 0x7f120814e6b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0097c0 tx=0x7f11fc01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7273338008a920a4 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:22.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f12067fc640 1 -- 172.21.15.78:0/2975488646 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0a8930 con 0x7f12080bd3a0 2023-06-02T15:33:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f12067fc640 1 -- 172.21.15.78:0/2975488646 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f11fc0a8a90 con 0x7f12080bd3a0 2023-06-02T15:33:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f12067fc640 1 -- 172.21.15.78:0/2975488646 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0a8e40 con 0x7f12080bd3a0 2023-06-02T15:33:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f120e0ce640 1 -- 172.21.15.78:0/2975488646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12080bd3a0 msgr2=0x7f120814e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f120e0ce640 1 --2- 172.21.15.78:0/2975488646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12080bd3a0 0x7f120814e6b0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0097c0 tx=0x7f11fc01ec30 comp rx=0 tx=0).stop 2023-06-02T15:33:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f120e0ce640 1 -- 172.21.15.78:0/2975488646 shutdown_connections 2023-06-02T15:33:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f120e0ce640 1 --2- 172.21.15.78:0/2975488646 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f12080bd3a0 0x7f120814e6b0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f120e0ce640 1 -- 172.21.15.78:0/2975488646 >> 172.21.15.78:0/2975488646 conn(0x7f12080a3180 msgr2=0x7f12080a3580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f120e0ce640 1 -- 172.21.15.78:0/2975488646 shutdown_connections 2023-06-02T15:33:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f120e0ce640 1 -- 172.21.15.78:0/2975488646 wait complete. 2023-06-02T15:33:22.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f120e0ce640 1 Processor -- start 2023-06-02T15:33:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.969+0000 7f120e0ce640 1 -- start start 2023-06-02T15:33:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f120e0ce640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12080bd3a0 0x7f1208151520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f120e0ce640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120814bcc0 0x7f1208152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:22.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f120e0ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f120814ebf0 0x7f12081d7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f120e0ce640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1208150c40 con 0x7f120814bcc0 2023-06-02T15:33:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f120e0ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120814fa20 con 0x7f120814ebf0 2023-06-02T15:33:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f120e0ce640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12081528b0 con 0x7f12080bd3a0 2023-06-02T15:33:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1206ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120814bcc0 0x7f1208152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1206ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120814bcc0 0x7f1208152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59300/0 (socket says 172.21.15.78:59300) 2023-06-02T15:33:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1206ffd640 1 -- 172.21.15.78:0/1678639011 learned_addr learned my addr 172.21.15.78:0/1678639011 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f12077fe640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12080bd3a0 0x7f1208151520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1207fff640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f120814ebf0 0x7f12081d7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1206ffd640 1 -- 172.21.15.78:0/1678639011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12080bd3a0 msgr2=0x7f1208151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:22.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1206ffd640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12080bd3a0 0x7f1208151520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1206ffd640 1 -- 172.21.15.78:0/1678639011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f120814ebf0 msgr2=0x7f12081d7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1206ffd640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f120814ebf0 0x7f12081d7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1206ffd640 1 -- 172.21.15.78:0/1678639011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11fc009420 con 0x7f120814bcc0 2023-06-02T15:33:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1207fff640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f120814ebf0 0x7f12081d7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:33:22.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f1206ffd640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120814bcc0 0x7f1208152370 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0b3040 tx=0x7f11fc01b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:22.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f11effff640 1 -- 172.21.15.78:0/1678639011 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0b9630 con 0x7f120814bcc0 2023-06-02T15:33:22.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f11effff640 1 -- 172.21.15.78:0/1678639011 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f11fc0b97b0 con 0x7f120814bcc0 2023-06-02T15:33:22.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f120e0ce640 1 -- 172.21.15.78:0/1678639011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12080bfdd0 con 0x7f120814bcc0 2023-06-02T15:33:22.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f11effff640 1 -- 172.21.15.78:0/1678639011 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11fc0b9b80 con 0x7f120814bcc0 2023-06-02T15:33:22.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f120e0ce640 1 -- 172.21.15.78:0/1678639011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120806a000 con 0x7f120814bcc0 2023-06-02T15:33:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f120e0ce640 1 -- 172.21.15.78:0/1678639011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120814c090 con 0x7f120814bcc0 2023-06-02T15:33:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f11effff640 1 -- 172.21.15.78:0/1678639011 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f11fc0b7040 con 0x7f120814bcc0 2023-06-02T15:33:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f11effff640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f11f4065c30 0x7f11f40680e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f11effff640 1 -- 172.21.15.78:0/1678639011 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f11fc121710 con 0x7f120814bcc0 2023-06-02T15:33:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f12077fe640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f11f4065c30 0x7f11f40680e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.973+0000 7f12077fe640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f11f4065c30 0x7f11f40680e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1200004e30 tx=0x7f1200009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:22.977+0000 7f11effff640 1 -- 172.21.15.78:0/1678639011 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f11fc0eeb60 con 0x7f120814bcc0 2023-06-02T15:33:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.149+0000 7f120e0ce640 1 -- 172.21.15.78:0/1678639011 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f120814c090 con 0x7f120814bcc0 2023-06-02T15:33:23.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.821+0000 7f11effff640 1 -- 172.21.15.78:0/1678639011 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f11fc0f2180 con 0x7f120814bcc0 2023-06-02T15:33:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 -- 172.21.15.78:0/1678639011 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f11f4065c30 msgr2=0x7f11f40680e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:23.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f11f4065c30 0x7f11f40680e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1200004e30 tx=0x7f1200009040 comp rx=0 tx=0).stop 2023-06-02T15:33:23.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 -- 172.21.15.78:0/1678639011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120814bcc0 msgr2=0x7f1208152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:23.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120814bcc0 0x7f1208152370 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f11fc0b3040 tx=0x7f11fc01b9d0 comp rx=0 tx=0).stop 2023-06-02T15:33:23.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 -- 172.21.15.78:0/1678639011 shutdown_connections 2023-06-02T15:33:23.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f120814ebf0 0x7f12081d7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:23.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f11f4065c30 0x7f11f40680e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:23.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f120814bcc0 0x7f1208152370 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:23.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 --2- 172.21.15.78:0/1678639011 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f12080bd3a0 0x7f1208151520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:23.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 -- 172.21.15.78:0/1678639011 >> 172.21.15.78:0/1678639011 conn(0x7f12080a3180 msgr2=0x7f120814aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:23.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 -- 172.21.15.78:0/1678639011 shutdown_connections 2023-06-02T15:33:23.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.825+0000 7f120e0ce640 1 -- 172.21.15.78:0/1678639011 wait complete. 2023-06-02T15:33:23.850 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-06-02T15:33:23.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a34f1a640 1 Processor -- start 2023-06-02T15:33:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a34f1a640 1 -- start start 2023-06-02T15:33:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a34f1a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a3014bcb0 0x7f0a300b9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a34f1a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a300ba900 0x7f0a300a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a34f1a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3014ef00 con 0x7f0a300b9dc0 2023-06-02T15:33:23.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a34f1a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a30152000 con 0x7f0a300ba900 2023-06-02T15:33:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a34f1a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a3014e6a0 con 0x7f0a3014bcb0 2023-06-02T15:33:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a2dd9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a300ba900 0x7f0a300a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a2ed9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0a300b9dc0 0x7f0a3006c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53942/0 (socket says 172.21.15.78:53942) 2023-06-02T15:33:23.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a2dd9b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0a300ba900 0x7f0a300a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54554/0 (socket says 172.21.15.78:54554) 2023-06-02T15:33:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a2ed9d640 1 -- 172.21.15.78:0/2319803376 learned_addr learned my addr 172.21.15.78:0/2319803376 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:33:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a2e59c640 1 --2- 172.21.15.78:0/2319803376 >> v2:172.21.15.132:3300/0 conn(0x7f0a3014bcb0 0x7f0a300b9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/2319803376 >> v2:172.21.15.132:3300/0 conn(0x7f0a3014bcb0 msgr2=0x7f0a300b9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a2dd9b640 1 --2- 172.21.15.78:0/2319803376 >> v2:172.21.15.132:3300/0 conn(0x7f0a3014bcb0 0x7f0a300b9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/2319803376 >> v1:172.21.15.78:6789/0 conn(0x7f0a300b9dc0 legacy=0x7f0a3006c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:23.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.977+0000 7f0a2dd9b640 1 -- 172.21.15.78:0/2319803376 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30152bb0 con 0x7f0a300ba900 2023-06-02T15:33:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a2dd9b640 1 --2- 172.21.15.78:0/2319803376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a300ba900 0x7f0a300a17c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0a200097c0 tx=0x7f0a2001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc3b9104e496c00 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a2d59a640 1 -- 172.21.15.78:0/2319803376 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200ab610 con 0x7f0a300ba900 2023-06-02T15:33:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a2d59a640 1 -- 172.21.15.78:0/2319803376 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0a200ab770 con 0x7f0a300ba900 2023-06-02T15:33:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a2d59a640 1 -- 172.21.15.78:0/2319803376 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a200abb20 con 0x7f0a300ba900 2023-06-02T15:33:23.987 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a34f1a640 1 -- 172.21.15.78:0/2319803376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a300ba900 msgr2=0x7f0a300a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a34f1a640 1 --2- 172.21.15.78:0/2319803376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a300ba900 0x7f0a300a17c0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f0a200097c0 tx=0x7f0a2001c410 comp rx=0 tx=0).stop 2023-06-02T15:33:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a34f1a640 1 -- 172.21.15.78:0/2319803376 shutdown_connections 2023-06-02T15:33:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a34f1a640 1 --2- 172.21.15.78:0/2319803376 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a300ba900 0x7f0a300a17c0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a34f1a640 1 --2- 172.21.15.78:0/2319803376 >> v2:172.21.15.132:3300/0 conn(0x7f0a3014bcb0 0x7f0a300b9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:23.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a34f1a640 1 -- 172.21.15.78:0/2319803376 >> 172.21.15.78:0/2319803376 conn(0x7f0a300c04d0 msgr2=0x7f0a300c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:23.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a34f1a640 1 -- 172.21.15.78:0/2319803376 shutdown_connections 2023-06-02T15:33:23.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a34f1a640 1 -- 172.21.15.78:0/2319803376 wait complete. 2023-06-02T15:33:23.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a34f1a640 1 Processor -- start 2023-06-02T15:33:23.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.981+0000 7f0a34f1a640 1 -- start start 2023-06-02T15:33:23.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a34f1a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a300b9dc0 0x7f0a30140450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:23.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a34f1a640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a300ba900 0x7f0a3013c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:23.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a34f1a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3014bcb0 0x7f0a3014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:23.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a34f1a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3013d010 con 0x7f0a3014bcb0 2023-06-02T15:33:23.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a34f1a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a30140990 con 0x7f0a300b9dc0 2023-06-02T15:33:23.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a34f1a640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3013d260 con 0x7f0a300ba900 2023-06-02T15:33:23.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3014bcb0 0x7f0a3014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:23.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2ed9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3014bcb0 0x7f0a3014cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54568/0 (socket says 172.21.15.78:54568) 2023-06-02T15:33:23.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2ed9d640 1 -- 172.21.15.78:0/1660286831 learned_addr learned my addr 172.21.15.78:0/1660286831 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:23.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2e59c640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a300b9dc0 0x7f0a30140450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:23.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2dd9b640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a300ba900 0x7f0a3013c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2ed9d640 1 -- 172.21.15.78:0/1660286831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a300ba900 msgr2=0x7f0a3013c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2ed9d640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a300ba900 0x7f0a3013c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2ed9d640 1 -- 172.21.15.78:0/1660286831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a300b9dc0 msgr2=0x7f0a30140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2ed9d640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a300b9dc0 0x7f0a30140450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2ed9d640 1 -- 172.21.15.78:0/1660286831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a20009420 con 0x7f0a3014bcb0 2023-06-02T15:33:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2ed9d640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3014bcb0 0x7f0a3014cdb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800cb10 tx=0x7f0a2800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a1effd640 1 -- 172.21.15.78:0/1660286831 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2800ac70 con 0x7f0a3014bcb0 2023-06-02T15:33:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a1effd640 1 -- 172.21.15.78:0/1660286831 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f0a2800add0 con 0x7f0a3014bcb0 2023-06-02T15:33:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a34f1a640 1 -- 172.21.15.78:0/1660286831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a30151c90 con 0x7f0a3014bcb0 2023-06-02T15:33:23.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a1effd640 1 -- 172.21.15.78:0/1660286831 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28012620 con 0x7f0a3014bcb0 2023-06-02T15:33:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a34f1a640 1 -- 172.21.15.78:0/1660286831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a3014c080 con 0x7f0a3014bcb0 2023-06-02T15:33:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a34f1a640 1 -- 172.21.15.78:0/1660286831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a3014f370 con 0x7f0a3014bcb0 2023-06-02T15:33:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a1effd640 1 -- 172.21.15.78:0/1660286831 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f0a28007070 con 0x7f0a3014bcb0 2023-06-02T15:33:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a1effd640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0a10065c00 0x7f0a100680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a1effd640 1 -- 172.21.15.78:0/1660286831 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f0a28083670 con 0x7f0a3014bcb0 2023-06-02T15:33:23.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2e59c640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0a10065c00 0x7f0a100680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:23.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.985+0000 7f0a2e59c640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0a10065c00 0x7f0a100680b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0a2400b930 tx=0x7f0a24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:23.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:23.989+0000 7f0a1effd640 1 -- 172.21.15.78:0/1660286831 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f0a28050ac0 con 0x7f0a3014bcb0 2023-06-02T15:33:24.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.141+0000 7f0a34f1a640 1 -- 172.21.15.78:0/1660286831 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a3014ffa0 con 0x7f0a3014bcb0 2023-06-02T15:33:24.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.929+0000 7f0a1effd640 1 -- 172.21.15.78:0/1660286831 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0a3014ffa0 con 0x7f0a3014bcb0 2023-06-02T15:33:24.936 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-06-02T15:33:24.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.933+0000 7f0a34f1a640 1 -- 172.21.15.78:0/1660286831 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0a10065c00 msgr2=0x7f0a100680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:24.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.933+0000 7f0a34f1a640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0a10065c00 0x7f0a100680b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f0a2400b930 tx=0x7f0a24008040 comp rx=0 tx=0).stop 2023-06-02T15:33:24.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.933+0000 7f0a34f1a640 1 -- 172.21.15.78:0/1660286831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3014bcb0 msgr2=0x7f0a3014cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:24.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.933+0000 7f0a34f1a640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3014bcb0 0x7f0a3014cdb0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800cb10 tx=0x7f0a2800a060 comp rx=0 tx=0).stop 2023-06-02T15:33:24.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.933+0000 7f0a34f1a640 1 -- 172.21.15.78:0/1660286831 shutdown_connections 2023-06-02T15:33:24.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.933+0000 7f0a34f1a640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f0a10065c00 0x7f0a100680b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:24.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.933+0000 7f0a34f1a640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0a3014bcb0 0x7f0a3014cdb0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:24.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.933+0000 7f0a34f1a640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f0a300ba900 0x7f0a3013c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:24.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.933+0000 7f0a34f1a640 1 --2- 172.21.15.78:0/1660286831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a300b9dc0 0x7f0a30140450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:24.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.933+0000 7f0a34f1a640 1 -- 172.21.15.78:0/1660286831 >> 172.21.15.78:0/1660286831 conn(0x7f0a300c04d0 msgr2=0x7f0a3006c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:24.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.937+0000 7f0a34f1a640 1 -- 172.21.15.78:0/1660286831 shutdown_connections 2023-06-02T15:33:24.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:24.937+0000 7f0a34f1a640 1 -- 172.21.15.78:0/1660286831 wait complete. 2023-06-02T15:33:24.962 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-06-02T15:33:25.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f67a5dc2640 1 Processor -- start 2023-06-02T15:33:25.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f67a5dc2640 1 -- start start 2023-06-02T15:33:25.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f67a5dc2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a00bc830 0x7f67a00bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:25.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f67a5dc2640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a00baee0 con 0x7f67a00a2c90 2023-06-02T15:33:25.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f67a5dc2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a0153670 con 0x7f67a014ffa0 2023-06-02T15:33:25.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f67a5dc2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a00a1b30 con 0x7f67a00bc830 2023-06-02T15:33:25.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f6797fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f67a00a2c90 0x7f67a00bb370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53954/0 (socket says 172.21.15.78:53954) 2023-06-02T15:33:25.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f6797fff640 1 -- 172.21.15.78:0/254600039 learned_addr learned my addr 172.21.15.78:0/254600039 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:33:25.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679ffff640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a00bc830 0x7f67a00bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:25.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459051650 0 0) 0x7f67a00baee0 con 0x7f67a00a2c90 2023-06-02T15:33:25.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f678c003530 con 0x7f67a00a2c90 2023-06-02T15:33:25.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1978676424 0 0) 0x7f678c003530 con 0x7f67a00a2c90 2023-06-02T15:33:25.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a00bc830 msgr2=0x7f67a00bba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:25.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a00bc830 0x7f67a00bba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:25.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 >> v1:172.21.15.132:6789/0 conn(0x7f67a014ffa0 legacy=0x7f67a006c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:25.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a006d600 con 0x7f67a00a2c90 2023-06-02T15:33:25.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3790318792 0 0) 0x7f6788001680 con 0x7f67a00a2c90 2023-06-02T15:33:25.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 >> v1:172.21.15.78:6789/0 conn(0x7f67a00a2c90 legacy=0x7f67a00bb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:25.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a00bc830 0x7f678c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:25.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c003f30 0x7f678c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:25.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f678c004d10 0x7f678c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:25.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c00ba40 con 0x7f678c004d10 2023-06-02T15:33:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f678c00bbb0 con 0x7f678c003f30 2023-06-02T15:33:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f678c00bd70 con 0x7f67a00bc830 2023-06-02T15:33:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679ffff640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f678c004d10 0x7f678c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f6797fff640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c003f30 0x7f678c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:25.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679ffff640 1 -- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a00bc830 msgr2=0x7f678c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679f7fe640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a00bc830 0x7f678c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679ffff640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a00bc830 0x7f678c0039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679ffff640 1 -- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c003f30 msgr2=0x7f678c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679ffff640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c003f30 0x7f678c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:25.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f679ffff640 1 -- 172.21.15.78:0/254600039 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f678c003530 con 0x7f678c004d10 2023-06-02T15:33:25.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.085+0000 7f6797fff640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c003f30 0x7f678c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:33:25.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f678c004d10 0x7f678c005180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6798009f90 tx=0x7f679801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b17edbaf3918d0d7 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:25.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67980a5c30 con 0x7f678c004d10 2023-06-02T15:33:25.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f679800f040 con 0x7f678c004d10 2023-06-02T15:33:25.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679effd640 1 -- 172.21.15.78:0/254600039 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67980ad440 con 0x7f678c004d10 2023-06-02T15:33:25.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 -- 172.21.15.78:0/254600039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f678c004d10 msgr2=0x7f678c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:25.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 --2- 172.21.15.78:0/254600039 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f678c004d10 0x7f678c005180 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6798009f90 tx=0x7f679801cc20 comp rx=0 tx=0).stop 2023-06-02T15:33:25.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 -- 172.21.15.78:0/254600039 reap_dead start 2023-06-02T15:33:25.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 -- 172.21.15.78:0/254600039 shutdown_connections 2023-06-02T15:33:25.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 -- 172.21.15.78:0/254600039 >> 172.21.15.78:0/254600039 conn(0x7f67a00c04d0 msgr2=0x7f67a00c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:25.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 -- 172.21.15.78:0/254600039 shutdown_connections 2023-06-02T15:33:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 -- 172.21.15.78:0/254600039 wait complete. 2023-06-02T15:33:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 Processor -- start 2023-06-02T15:33:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 -- start start 2023-06-02T15:33:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c004d10 0x7f67a00a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:25.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a01eafa0 0x7f67a0155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a01eb3f0 0x7f67a01560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a006ee90 con 0x7f67a01eb3f0 2023-06-02T15:33:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a0071bb0 con 0x7f678c004d10 2023-06-02T15:33:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f67a5dc2640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a0156620 con 0x7f67a01eafa0 2023-06-02T15:33:25.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a01eb3f0 0x7f67a01560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:25.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a01eb3f0 0x7f67a01560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54598/0 (socket says 172.21.15.78:54598) 2023-06-02T15:33:25.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 -- 172.21.15.78:0/3744905912 learned_addr learned my addr 172.21.15.78:0/3744905912 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:25.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679f7fe640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c004d10 0x7f67a00a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:25.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 -- 172.21.15.78:0/3744905912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a01eafa0 msgr2=0x7f67a0155ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:25.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f6797fff640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a01eafa0 0x7f67a0155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:25.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a01eafa0 0x7f67a0155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:25.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 -- 172.21.15.78:0/3744905912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c004d10 msgr2=0x7f67a00a5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:25.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c004d10 0x7f67a00a5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:25.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 -- 172.21.15.78:0/3744905912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a006c720 con 0x7f67a01eb3f0 2023-06-02T15:33:25.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679f7fe640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c004d10 0x7f67a00a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-06-02T15:33:25.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.089+0000 7f679ffff640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a01eb3f0 0x7f67a01560e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6798009f90 tx=0x7f6798009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:25.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f679cff9640 1 -- 172.21.15.78:0/3744905912 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798003ba0 con 0x7f67a01eb3f0 2023-06-02T15:33:25.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f679cff9640 1 -- 172.21.15.78:0/3744905912 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6798003d00 con 0x7f67a01eb3f0 2023-06-02T15:33:25.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f67a5dc2640 1 -- 172.21.15.78:0/3744905912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a0153930 con 0x7f67a01eb3f0 2023-06-02T15:33:25.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f679cff9640 1 -- 172.21.15.78:0/3744905912 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67980adaa0 con 0x7f67a01eb3f0 2023-06-02T15:33:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f67a5dc2640 1 -- 172.21.15.78:0/3744905912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a0150370 con 0x7f67a01eb3f0 2023-06-02T15:33:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f67a5dc2640 1 -- 172.21.15.78:0/3744905912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a01ebd10 con 0x7f67a01eb3f0 2023-06-02T15:33:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f679cff9640 1 -- 172.21.15.78:0/3744905912 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f67980b4040 con 0x7f67a01eb3f0 2023-06-02T15:33:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f679cff9640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6780065c00 0x7f67800680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f679cff9640 1 -- 172.21.15.78:0/3744905912 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f679811d260 con 0x7f67a01eb3f0 2023-06-02T15:33:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f679f7fe640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6780065c00 0x7f67800680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.093+0000 7f679f7fe640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6780065c00 0x7f67800680b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6790000c10 tx=0x7f6790009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.097+0000 7f679cff9640 1 -- 172.21.15.78:0/3744905912 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f67980ea910 con 0x7f67a01eb3f0 2023-06-02T15:33:25.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.249+0000 7f67a5dc2640 1 -- 172.21.15.78:0/3744905912 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f67a004dd40 con 0x7f67a01eb3f0 2023-06-02T15:33:25.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.941+0000 7f679cff9640 1 -- 172.21.15.78:0/3744905912 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f67980edf30 con 0x7f67a01eb3f0 2023-06-02T15:33:25.946 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-06-02T15:33:25.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 -- 172.21.15.78:0/3744905912 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6780065c00 msgr2=0x7f67800680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:25.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6780065c00 0x7f67800680b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6790000c10 tx=0x7f6790009040 comp rx=0 tx=0).stop 2023-06-02T15:33:25.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 -- 172.21.15.78:0/3744905912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a01eb3f0 msgr2=0x7f67a01560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:25.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a01eb3f0 0x7f67a01560e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f6798009f90 tx=0x7f6798009750 comp rx=0 tx=0).stop 2023-06-02T15:33:25.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 -- 172.21.15.78:0/3744905912 shutdown_connections 2023-06-02T15:33:25.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f6780065c00 0x7f67800680b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:25.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f67a01eb3f0 0x7f67a01560e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:25.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f67a01eafa0 0x7f67a0155ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:25.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 --2- 172.21.15.78:0/3744905912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f678c004d10 0x7f67a00a5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:25.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 -- 172.21.15.78:0/3744905912 >> 172.21.15.78:0/3744905912 conn(0x7f67a00c04d0 msgr2=0x7f67a00a0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:25.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 -- 172.21.15.78:0/3744905912 shutdown_connections 2023-06-02T15:33:25.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:25.945+0000 7f67a5dc2640 1 -- 172.21.15.78:0/3744905912 wait complete. 2023-06-02T15:33:25.977 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-06-02T15:33:26.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a89d84640 1 Processor -- start 2023-06-02T15:33:26.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a89d84640 1 -- start start 2023-06-02T15:33:26.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a89d84640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9a840c11e0 0x7f9a840c15b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:26.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a89d84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a840bf150 0x7f9a840a9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:26.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a89d84640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a840c2a40 con 0x7f9a8406bcb0 2023-06-02T15:33:26.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a89d84640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a84152a20 con 0x7f9a840c11e0 2023-06-02T15:33:26.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a89d84640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84152710 con 0x7f9a840bf150 2023-06-02T15:33:26.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a837fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9a840c11e0 0x7f9a840c15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:26.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a82ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9a8406bcb0 0x7f9a840c0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53960/0 (socket says 172.21.15.78:53960) 2023-06-02T15:33:26.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a837fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9a840c11e0 0x7f9a840c15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54604/0 (socket says 172.21.15.78:54604) 2023-06-02T15:33:26.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.121+0000 7f9a82ffd640 1 -- 172.21.15.78:0/1910486909 learned_addr learned my addr 172.21.15.78:0/1910486909 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-06-02T15:33:26.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a827fc640 1 -- 172.21.15.78:0/1910486909 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989930933 0 0) 0x7f9a74001120 con 0x7f9a8406bcb0 2023-06-02T15:33:26.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a827fc640 1 -- 172.21.15.78:0/1910486909 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a6c003530 con 0x7f9a8406bcb0 2023-06-02T15:33:26.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a83fff640 1 --2- 172.21.15.78:0/1910486909 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a840bf150 0x7f9a840a9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:26.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a837fe640 1 -- 172.21.15.78:0/1910486909 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a840bf150 msgr2=0x7f9a840a9740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-06-02T15:33:26.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a837fe640 1 --2- 172.21.15.78:0/1910486909 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a840bf150 0x7f9a840a9740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:26.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a837fe640 1 -- 172.21.15.78:0/1910486909 >> v1:172.21.15.78:6789/0 conn(0x7f9a8406bcb0 legacy=0x7f9a840c0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:26.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a837fe640 1 -- 172.21.15.78:0/1910486909 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8406b870 con 0x7f9a840c11e0 2023-06-02T15:33:26.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a837fe640 1 --2- 172.21.15.78:0/1910486909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840c11e0 0x7f9a840c15b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9a780097c0 tx=0x7f9a7801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6220003ebe44ef server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:26.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a827fc640 1 -- 172.21.15.78:0/1910486909 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780a8970 con 0x7f9a840c11e0 2023-06-02T15:33:26.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a827fc640 1 -- 172.21.15.78:0/1910486909 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9a780a8ad0 con 0x7f9a840c11e0 2023-06-02T15:33:26.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a827fc640 1 -- 172.21.15.78:0/1910486909 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780a8e40 con 0x7f9a840c11e0 2023-06-02T15:33:26.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a89d84640 1 -- 172.21.15.78:0/1910486909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840c11e0 msgr2=0x7f9a840c15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:26.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a89d84640 1 --2- 172.21.15.78:0/1910486909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840c11e0 0x7f9a840c15b0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f9a780097c0 tx=0x7f9a7801ec70 comp rx=0 tx=0).stop 2023-06-02T15:33:26.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a89d84640 1 -- 172.21.15.78:0/1910486909 shutdown_connections 2023-06-02T15:33:26.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a89d84640 1 --2- 172.21.15.78:0/1910486909 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a840bf150 0x7f9a840a9740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:26.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a89d84640 1 --2- 172.21.15.78:0/1910486909 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840c11e0 0x7f9a840c15b0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:26.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a89d84640 1 -- 172.21.15.78:0/1910486909 >> 172.21.15.78:0/1910486909 conn(0x7f9a840c47d0 msgr2=0x7f9a840c4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:26.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a89d84640 1 -- 172.21.15.78:0/1910486909 shutdown_connections 2023-06-02T15:33:26.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.125+0000 7f9a89d84640 1 -- 172.21.15.78:0/1910486909 wait complete. 2023-06-02T15:33:26.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 Processor -- start 2023-06-02T15:33:26.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 -- start start 2023-06-02T15:33:26.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 --2- >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a8406bcb0 0x7f9a840a6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:26.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840bf150 0x7f9a840be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:26.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a840c11e0 0x7f9a841e72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:26.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840a70f0 con 0x7f9a840bf150 2023-06-02T15:33:26.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840a6560 con 0x7f9a840c11e0 2023-06-02T15:33:26.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 -- --> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840bb620 con 0x7f9a8406bcb0 2023-06-02T15:33:26.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a82ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840bf150 0x7f9a840be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:26.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a82ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840bf150 0x7f9a840be1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54610/0 (socket says 172.21.15.78:54610) 2023-06-02T15:33:26.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a82ffd640 1 -- 172.21.15.78:0/1816478283 learned_addr learned my addr 172.21.15.78:0/1816478283 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-06-02T15:33:26.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a837fe640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a8406bcb0 0x7f9a840a6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:26.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a82ffd640 1 -- 172.21.15.78:0/1816478283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a8406bcb0 msgr2=0x7f9a840a6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:26.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a82ffd640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a8406bcb0 0x7f9a840a6020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:26.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a82ffd640 1 -- 172.21.15.78:0/1816478283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a840c11e0 msgr2=0x7f9a841e72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:26.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a82ffd640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a840c11e0 0x7f9a841e72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:26.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a82ffd640 1 -- 172.21.15.78:0/1816478283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a78009420 con 0x7f9a840bf150 2023-06-02T15:33:26.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a82ffd640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840bf150 0x7f9a840be1a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400c400 tx=0x7f9a7400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:26.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a6bfff640 1 -- 172.21.15.78:0/1816478283 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74005cf0 con 0x7f9a840bf150 2023-06-02T15:33:26.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a6bfff640 1 -- 172.21.15.78:0/1816478283 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9a74005e70 con 0x7f9a840bf150 2023-06-02T15:33:26.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a6bfff640 1 -- 172.21.15.78:0/1816478283 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74007310 con 0x7f9a840bf150 2023-06-02T15:33:26.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 -- 172.21.15.78:0/1816478283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a840c26d0 con 0x7f9a840bf150 2023-06-02T15:33:26.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 -- 172.21.15.78:0/1816478283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a840aa540 con 0x7f9a840bf150 2023-06-02T15:33:26.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a89d84640 1 -- 172.21.15.78:0/1816478283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a840a9c80 con 0x7f9a840bf150 2023-06-02T15:33:26.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a6bfff640 1 -- 172.21.15.78:0/1816478283 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 84822+0+0 (secure 0 0 0) 0x7f9a74007470 con 0x7f9a840bf150 2023-06-02T15:33:26.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a6bfff640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9a70065c00 0x7f9a700680b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-06-02T15:33:26.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a6bfff640 1 -- 172.21.15.78:0/1816478283 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f9a74082730 con 0x7f9a840bf150 2023-06-02T15:33:26.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.129+0000 7f9a837fe640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9a70065c00 0x7f9a700680b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-06-02T15:33:26.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.133+0000 7f9a837fe640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9a70065c00 0x7f9a700680b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a780b2000 tx=0x7f9a780aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-06-02T15:33:26.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.133+0000 7f9a6bfff640 1 -- 172.21.15.78:0/1816478283 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169667 (secure 0 0 0) 0x7f9a74053a30 con 0x7f9a840bf150 2023-06-02T15:33:26.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.285+0000 7f9a89d84640 1 -- 172.21.15.78:0/1816478283 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9a840c2a40 con 0x7f9a840bf150 2023-06-02T15:33:26.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.945+0000 7f9a6bfff640 1 -- 172.21.15.78:0/1816478283 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7f9a840c2a40 con 0x7f9a840bf150 2023-06-02T15:33:26.949 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data_ec' removed 2023-06-02T15:33:26.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 -- 172.21.15.78:0/1816478283 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9a70065c00 msgr2=0x7f9a700680b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9a70065c00 0x7f9a700680b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a780b2000 tx=0x7f9a780aa070 comp rx=0 tx=0).stop 2023-06-02T15:33:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 -- 172.21.15.78:0/1816478283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840bf150 msgr2=0x7f9a840be1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-06-02T15:33:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840bf150 0x7f9a840be1a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400c400 tx=0x7f9a7400c8c0 comp rx=0 tx=0).stop 2023-06-02T15:33:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 -- 172.21.15.78:0/1816478283 shutdown_connections 2023-06-02T15:33:26.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a840c11e0 0x7f9a841e72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.78:6832/37044,v1:172.21.15.78:6833/37044] conn(0x7f9a70065c00 0x7f9a700680b0 secure :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a780b2000 tx=0x7f9a780aa070 comp rx=0 tx=0).stop 2023-06-02T15:33:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840bf150 0x7f9a840be1a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 --2- 172.21.15.78:0/1816478283 >> [v2:172.21.15.132:3301/0,v1:172.21.15.132:6790/0] conn(0x7f9a8406bcb0 0x7f9a840a6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-06-02T15:33:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 -- 172.21.15.78:0/1816478283 >> 172.21.15.78:0/1816478283 conn(0x7f9a840c47d0 msgr2=0x7f9a84151710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-06-02T15:33:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 -- 172.21.15.78:0/1816478283 shutdown_connections 2023-06-02T15:33:26.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-06-02T15:33:26.949+0000 7f9a89d84640 1 -- 172.21.15.78:0/1816478283 wait complete. 2023-06-02T15:33:26.975 INFO:teuthology.misc:Shutting down mds daemons... 2023-06-02T15:33:26.976 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-06-02T15:33:26.976 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:26.987 INFO:tasks.ceph.mds.a:Stopped 2023-06-02T15:33:26.987 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-06-02T15:33:26.987 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.041 INFO:tasks.ceph.mds.c:Stopped 2023-06-02T15:33:27.042 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-06-02T15:33:27.042 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.055 INFO:tasks.ceph.mds.b:Stopped 2023-06-02T15:33:27.055 INFO:teuthology.misc:Shutting down osd daemons... 2023-06-02T15:33:27.055 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-06-02T15:33:27.056 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.145 INFO:tasks.ceph.osd.0:Stopped 2023-06-02T15:33:27.146 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-06-02T15:33:27.146 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.231 INFO:tasks.ceph.osd.1:Stopped 2023-06-02T15:33:27.232 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-06-02T15:33:27.232 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.303 INFO:tasks.ceph.osd.2:Stopped 2023-06-02T15:33:27.304 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-06-02T15:33:27.304 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.363 INFO:tasks.ceph.osd.3:Stopped 2023-06-02T15:33:27.363 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-06-02T15:33:27.364 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.434 INFO:tasks.ceph.osd.4:Stopped 2023-06-02T15:33:27.435 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-06-02T15:33:27.435 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.530 INFO:tasks.ceph.osd.5:Stopped 2023-06-02T15:33:27.530 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-06-02T15:33:27.531 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.599 INFO:tasks.ceph.osd.6:Stopped 2023-06-02T15:33:27.600 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-06-02T15:33:27.601 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.671 INFO:tasks.ceph.osd.7:Stopped 2023-06-02T15:33:27.672 INFO:teuthology.misc:Shutting down mgr daemons... 2023-06-02T15:33:27.673 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-06-02T15:33:27.673 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.703 INFO:tasks.ceph.mgr.y:Stopped 2023-06-02T15:33:27.704 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-06-02T15:33:27.705 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.731 INFO:tasks.ceph.mgr.x:Stopped 2023-06-02T15:33:27.732 INFO:teuthology.misc:Shutting down mon daemons... 2023-06-02T15:33:27.732 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-06-02T15:33:27.733 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.763 INFO:tasks.ceph.mon.a:Stopped 2023-06-02T15:33:27.764 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-06-02T15:33:27.764 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.789 INFO:tasks.ceph.mon.b:Stopped 2023-06-02T15:33:27.789 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-06-02T15:33:27.790 INFO:teuthology.orchestra.run:waiting for 300 2023-06-02T15:33:27.849 INFO:tasks.ceph.mon.c:Stopped 2023-06-02T15:33:27.850 INFO:tasks.ceph:Checking cluster log for badness... 2023-06-02T15:33:27.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-06-02T15:33:27.868 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:33:27.869 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-06-02T15:33:28.064 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:33:28.065 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-06-02T15:33:28.288 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:33:28.289 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-06-02T15:33:28.428 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:33:28.429 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-06-02T15:33:28.563 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:33:28.564 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-06-02T15:33:28.943 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:33:28.944 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-06-02T15:33:29.190 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:33:29.190 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-06-02T15:33:29.366 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:33:29.367 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-06-02T15:33:29.549 INFO:tasks.ceph:Archiving mon data... 2023-06-02T15:33:29.550 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/data/mon.a.tgz 2023-06-02T15:33:29.550 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-06-02T15:33:29.557 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.fC9TmXAwJF 2023-06-02T15:33:29.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.fC9TmXAwJF 2023-06-02T15:33:29.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.fC9TmXAwJF 2023-06-02T15:33:29.733 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.fC9TmXAwJF is 279KB 2023-06-02T15:33:29.793 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.fC9TmXAwJF 2023-06-02T15:33:29.799 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/data/mon.b.tgz 2023-06-02T15:33:29.799 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-06-02T15:33:29.805 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.ZKFSsngh8t 2023-06-02T15:33:29.806 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.ZKFSsngh8t 2023-06-02T15:33:29.937 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.ZKFSsngh8t 2023-06-02T15:33:29.999 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.ZKFSsngh8t is 375KB 2023-06-02T15:33:30.016 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.ZKFSsngh8t 2023-06-02T15:33:30.021 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/data/mon.c.tgz 2023-06-02T15:33:30.022 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-06-02T15:33:30.067 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.YdjJX7iWOb 2023-06-02T15:33:30.068 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.YdjJX7iWOb 2023-06-02T15:33:30.199 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.YdjJX7iWOb 2023-06-02T15:33:30.259 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.YdjJX7iWOb is 376KB 2023-06-02T15:33:30.317 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.YdjJX7iWOb 2023-06-02T15:33:30.322 INFO:tasks.ceph:Cleaning ceph cluster... 2023-06-02T15:33:30.323 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-02T15:33:30.325 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-02T15:33:30.369 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-02T15:33:30.372 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-06-02T15:33:30.386 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-06-02T15:33:30.387 DEBUG:teuthology.orchestra.run.smithi078:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-02T15:33:30.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-02T15:33:30.408 INFO:teuthology.orchestra.run.smithi078.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-02T15:33:30.425 DEBUG:teuthology.orchestra.run.smithi150:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-02T15:33:30.428 DEBUG:teuthology.orchestra.run.smithi159:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-06-02T15:33:30.442 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-02T15:33:30.514 INFO:teuthology.orchestra.run.smithi159.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-02T15:33:30.572 INFO:teuthology.orchestra.run.smithi150.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-06-02T15:33:30.576 INFO:tasks.ceph:Archiving crash dumps... 2023-06-02T15:33:30.578 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi078/crash 2023-06-02T15:33:30.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-02T15:33:30.593 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi132/crash 2023-06-02T15:33:30.594 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-02T15:33:30.609 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi150/crash 2023-06-02T15:33:30.610 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-02T15:33:30.625 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi159/crash 2023-06-02T15:33:30.632 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-06-02T15:33:30.646 INFO:tasks.ceph:Shutting down logrotate 2023-06-02T15:33:30.647 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:30.649 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:30.657 DEBUG:teuthology.orchestra.run.smithi150:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:30.667 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:30.725 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:30.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:30.752 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:30.765 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-06-02T15:33:30.779 INFO:tasks.ceph:Compressing logs... 2023-06-02T15:33:30.780 DEBUG:teuthology.orchestra.run.smithi078:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-02T15:33:30.782 DEBUG:teuthology.orchestra.run.smithi132:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-02T15:33:30.797 DEBUG:teuthology.orchestra.run.smithi150:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-02T15:33:30.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-02T15:33:34.058 INFO:tasks.ceph:Archiving logs... 2023-06-02T15:33:34.059 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi078/log 2023-06-02T15:33:34.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-02T15:33:34.548 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi132/log 2023-06-02T15:33:34.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-02T15:33:34.830 DEBUG:teuthology.misc:Transferring archived files from smithi150:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi150/log 2023-06-02T15:33:34.831 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-02T15:33:34.848 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi159/log 2023-06-02T15:33:34.849 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2023-06-02T15:33:34.866 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-06-02T15:33:34.875 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2023-06-02T15:33:34.876 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-06-02T15:33:34.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-06-02T15:33:34.881 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-06-02T15:33:34.894 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2023-06-02T15:33:35.037 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-06-02T15:33:35.047 INFO:teuthology.task.clock:Checking final clock skew... 2023-06-02T15:33:35.047 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-02T15:33:35.051 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-02T15:33:35.054 DEBUG:teuthology.orchestra.run.smithi150:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-02T15:33:35.057 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-06-02T15:33:35.063 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2023-06-02T15:33:35.063 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2023-06-02T15:33:35.063 INFO:teuthology.orchestra.run.smithi078.stdout:*hv01.front.sepi 44.4.53.2 2 u 9 64 377 0.065 -0.026 0.739 2023-06-02T15:33:35.064 INFO:teuthology.orchestra.run.smithi078.stdout:+hv02.front.sepi 63.231.80.2 3 u 3 64 377 0.089 -0.024 1.025 2023-06-02T15:33:35.064 INFO:teuthology.orchestra.run.smithi078.stdout:+hv03.front.sepi 74.6.168.72 3 u 16 64 377 0.095 -2.356 0.827 2023-06-02T15:33:35.064 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:33:35.065 INFO:teuthology.orchestra.run.smithi132.stdout: remote refid st t when poll reach delay offset jitter 2023-06-02T15:33:35.066 INFO:teuthology.orchestra.run.smithi132.stdout:============================================================================== 2023-06-02T15:33:35.066 INFO:teuthology.orchestra.run.smithi132.stdout:*hv01.front.sepi 44.4.53.2 2 u 4 64 377 0.084 -0.641 1.051 2023-06-02T15:33:35.067 INFO:teuthology.orchestra.run.smithi132.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.160 +0.277 0.939 2023-06-02T15:33:35.067 INFO:teuthology.orchestra.run.smithi132.stdout:+hv03.front.sepi 74.6.168.72 3 u 12 64 377 0.115 -3.155 0.914 2023-06-02T15:33:35.068 INFO:teuthology.orchestra.run.smithi132.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:33:35.070 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2023-06-02T15:33:35.070 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2023-06-02T15:33:35.071 INFO:teuthology.orchestra.run.smithi150.stdout:*hv01.front.sepi 44.4.53.2 2 u 4 64 377 0.055 -2.360 1.551 2023-06-02T15:33:35.071 INFO:teuthology.orchestra.run.smithi150.stdout:+hv02.front.sepi 63.231.80.2 3 u 5 64 377 0.076 +0.529 1.436 2023-06-02T15:33:35.072 INFO:teuthology.orchestra.run.smithi150.stdout:+hv03.front.sepi 74.6.168.72 3 u 4 64 377 0.131 -4.880 1.525 2023-06-02T15:33:35.072 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:33:35.073 INFO:teuthology.orchestra.run.smithi159.stdout: remote refid st t when poll reach delay offset jitter 2023-06-02T15:33:35.073 INFO:teuthology.orchestra.run.smithi159.stdout:============================================================================== 2023-06-02T15:33:35.074 INFO:teuthology.orchestra.run.smithi159.stdout:*hv01.front.sepi 44.4.53.2 2 u 2 64 377 0.096 -0.087 1.319 2023-06-02T15:33:35.075 INFO:teuthology.orchestra.run.smithi159.stdout:+hv02.front.sepi 63.231.80.2 3 u 9 64 377 0.149 +0.840 1.353 2023-06-02T15:33:35.075 INFO:teuthology.orchestra.run.smithi159.stdout:+hv03.front.sepi 74.6.168.72 3 u 14 64 377 0.133 -2.633 1.408 2023-06-02T15:33:35.075 INFO:teuthology.orchestra.run.smithi159.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-06-02T15:33:35.076 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-06-02T15:33:35.088 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-06-02T15:33:35.089 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-06-02T15:33:35.112 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-06-02T15:33:35.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-06-02T15:33:35.216 INFO:teuthology.task.internal:Duration was 961.499188 seconds 2023-06-02T15:33:35.217 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-06-02T15:33:35.290 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-06-02T15:33:35.290 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-02T15:33:35.293 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-02T15:33:35.295 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-02T15:33:35.297 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-06-02T15:33:35.383 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-06-02T15:33:35.383 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2023-06-02T15:33:35.384 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-02T15:33:35.394 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2023-06-02T15:33:35.394 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-02T15:33:35.405 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi150.front.sepia.ceph.com 2023-06-02T15:33:35.406 DEBUG:teuthology.orchestra.run.smithi150:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-02T15:33:35.417 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2023-06-02T15:33:35.417 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-06-02T15:33:35.428 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-06-02T15:33:35.429 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-02T15:33:35.441 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-02T15:33:35.449 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-02T15:33:35.467 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-06-02T15:33:35.496 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-06-02T15:33:35.496 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-02T15:33:35.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-02T15:33:35.513 DEBUG:teuthology.orchestra.run.smithi150:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-02T15:33:35.530 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-06-02T15:33:35.586 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-06-02T15:33:35.599 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-06-02T15:33:35.600 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-02T15:33:35.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-02T15:33:35.625 DEBUG:teuthology.orchestra.run.smithi150:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-02T15:33:35.637 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-06-02T15:33:35.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-06-02T15:33:35.661 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-02T15:33:35.664 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-02T15:33:35.669 DEBUG:teuthology.orchestra.run.smithi150:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-02T15:33:35.674 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2023-06-02T15:33:35.678 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2023-06-02T15:33:35.682 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-06-02T15:33:35.690 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = core 2023-06-02T15:33:35.703 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2023-06-02T15:33:35.777 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-02T15:33:35.824 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:33:35.825 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-02T15:33:35.831 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:33:35.832 DEBUG:teuthology.orchestra.run.smithi150:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-02T15:33:35.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:33:35.838 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2023-06-02T15:33:35.843 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:33:35.844 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-06-02T15:33:35.859 INFO:teuthology.task.internal:Transferring archived files... 2023-06-02T15:33:35.860 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi078 2023-06-02T15:33:35.861 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-02T15:33:35.889 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi132 2023-06-02T15:33:35.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-02T15:33:35.906 DEBUG:teuthology.misc:Transferring archived files from smithi150:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi150 2023-06-02T15:33:35.907 DEBUG:teuthology.orchestra.run.smithi150:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-02T15:33:35.926 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361/remote/smithi159 2023-06-02T15:33:35.926 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-06-02T15:33:35.945 INFO:teuthology.task.internal:Removing archive directory... 2023-06-02T15:33:35.945 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-02T15:33:35.948 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-02T15:33:35.952 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-02T15:33:35.971 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2023-06-02T15:33:35.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-06-02T15:33:36.006 INFO:teuthology.task.internal:Not uploading archives. 2023-06-02T15:33:36.006 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-06-02T15:33:36.068 INFO:teuthology.task.internal:Tidying up after the test... 2023-06-02T15:33:36.069 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-02T15:33:36.072 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-02T15:33:36.076 DEBUG:teuthology.orchestra.run.smithi150:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-02T15:33:36.077 INFO:teuthology.orchestra.run.smithi078.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 15:33 /home/ubuntu/cephtest 2023-06-02T15:33:36.078 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-06-02T15:33:36.079 INFO:teuthology.orchestra.run.smithi132.stdout: 655472 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jun 2 15:33 /home/ubuntu/cephtest 2023-06-02T15:33:36.082 INFO:teuthology.orchestra.run.smithi150.stdout: 655472 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jun 2 15:33 /home/ubuntu/cephtest 2023-06-02T15:33:36.082 INFO:teuthology.orchestra.run.smithi150.stdout: 673539 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Jun 2 15:31 /home/ubuntu/cephtest/mdtest-1.9.3 2023-06-02T15:33:36.083 INFO:teuthology.orchestra.run.smithi150.stdout: 676822 8 -rwx------ 1 ubuntu ubuntu 6036 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/README 2023-06-02T15:33:36.083 INFO:teuthology.orchestra.run.smithi150.stdout: 676821 4 -rwx------ 1 ubuntu ubuntu 1859 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/Makefile 2023-06-02T15:33:36.083 INFO:teuthology.orchestra.run.smithi150.stdout: 676820 20 -rwx------ 1 ubuntu ubuntu 16962 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/COPYRIGHT 2023-06-02T15:33:36.083 INFO:teuthology.orchestra.run.smithi150.stdout: 676824 8 -rwx------ 1 ubuntu ubuntu 5282 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/mdtest.1 2023-06-02T15:33:36.083 INFO:teuthology.orchestra.run.smithi150.stdout: 676826 4 drwx------ 2 ubuntu ubuntu 4096 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts 2023-06-02T15:33:36.084 INFO:teuthology.orchestra.run.smithi150.stdout: 676835 8 -rwx------ 1 ubuntu ubuntu 6264 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/tester.py 2023-06-02T15:33:36.084 INFO:teuthology.orchestra.run.smithi150.stdout: 676832 4 -rwx------ 1 ubuntu ubuntu 3462 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/env_to_db.tcsh 2023-06-02T15:33:36.084 INFO:teuthology.orchestra.run.smithi150.stdout: 676836 4 -rwx------ 1 ubuntu ubuntu 1255 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/WRAPPER_README 2023-06-02T15:33:36.084 INFO:teuthology.orchestra.run.smithi150.stdout: 676833 20 -rwx------ 1 ubuntu ubuntu 19576 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/mdtest_wrapper.py 2023-06-02T15:33:36.084 INFO:teuthology.orchestra.run.smithi150.stdout: 676834 4 -rwx------ 1 ubuntu ubuntu 1059 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/paramCatch.py 2023-06-02T15:33:36.085 INFO:teuthology.orchestra.run.smithi150.stdout: 676823 8 -rwx------ 1 ubuntu ubuntu 7123 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/RELEASE_LOG 2023-06-02T15:33:36.085 INFO:teuthology.orchestra.run.smithi150.stdout: 676825 96 -rw-r--r-- 1 ubuntu ubuntu 95873 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/mdtest.c 2023-06-02T15:33:36.085 INFO:teuthology.orchestra.run.smithi159.stdout: 655472 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Jun 2 15:33 /home/ubuntu/cephtest 2023-06-02T15:33:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: 673372 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Jun 2 15:31 /home/ubuntu/cephtest/mdtest-1.9.3 2023-06-02T15:33:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: 676655 8 -rwx------ 1 ubuntu ubuntu 6036 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/README 2023-06-02T15:33:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: 676654 4 -rwx------ 1 ubuntu ubuntu 1859 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/Makefile 2023-06-02T15:33:36.086 INFO:teuthology.orchestra.run.smithi159.stdout: 673373 20 -rwx------ 1 ubuntu ubuntu 16962 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/COPYRIGHT 2023-06-02T15:33:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: 676657 8 -rwx------ 1 ubuntu ubuntu 5282 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/mdtest.1 2023-06-02T15:33:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: 676659 4 drwx------ 2 ubuntu ubuntu 4096 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts 2023-06-02T15:33:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: 676668 8 -rwx------ 1 ubuntu ubuntu 6264 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/tester.py 2023-06-02T15:33:36.087 INFO:teuthology.orchestra.run.smithi159.stdout: 676660 4 -rwx------ 1 ubuntu ubuntu 3462 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/env_to_db.tcsh 2023-06-02T15:33:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: 676669 4 -rwx------ 1 ubuntu ubuntu 1255 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/WRAPPER_README 2023-06-02T15:33:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: 676666 20 -rwx------ 1 ubuntu ubuntu 19576 Nov 27 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/mdtest_wrapper.py 2023-06-02T15:33:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: 676667 4 -rwx------ 1 ubuntu ubuntu 1059 Apr 16 2013 /home/ubuntu/cephtest/mdtest-1.9.3/scripts/paramCatch.py 2023-06-02T15:33:36.088 INFO:teuthology.orchestra.run.smithi159.stdout: 676656 8 -rwx------ 1 ubuntu ubuntu 7123 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/RELEASE_LOG 2023-06-02T15:33:36.089 INFO:teuthology.orchestra.run.smithi159.stdout: 676658 96 -rw-r--r-- 1 ubuntu ubuntu 95873 Dec 23 2013 /home/ubuntu/cephtest/mdtest-1.9.3/mdtest.c 2023-06-02T15:33:36.089 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-06-02T15:33:36.090 INFO:teuthology.orchestra.run.smithi150.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-06-02T15:33:36.090 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_62814aba234085f597115b9ba9bdc56af117de9e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi150 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-06-02T15:33:36.098 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-06-02T15:33:36.115 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-06-02T15:33:36.131 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi150 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-06-02T15:33:36.131 INFO:teuthology.nuke:Checking targets against current locks 2023-06-02T15:33:36.133 INFO:teuthology.orchestra.run.smithi159.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-06-02T15:33:36.168 DEBUG:teuthology.nuke:shortname: smithi078 2023-06-02T15:33:36.168 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-02T15:33:36.194 DEBUG:teuthology.nuke:shortname: smithi132 2023-06-02T15:33:36.194 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-02T15:33:36.198 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-02 15:03:30.842257', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIAZR0uL9ylfTMCrHWJ2m9yZdwI7Zs0LYSXD8l/NhaQns'} 2023-06-02T15:33:36.221 DEBUG:teuthology.nuke:shortname: smithi150 2023-06-02T15:33:36.221 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-02T15:33:36.225 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-02 15:03:30.837689', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBObGrJhjSuegxyHezZeD992nLJv7Hn5SJHoi2yHJeEdDuey7WOBYRxui7li76nOCu/nlybVywM+zD+tvT5rBJn0='} 2023-06-02T15:33:36.248 DEBUG:teuthology.nuke:shortname: smithi159 2023-06-02T15:33:36.248 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-06-02T15:33:36.253 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi150.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-02 15:03:30.841275', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGdJOZSiX3+K3xurw+9W23izImR/2D8F1yD/nSBGZfyx5WupTuX/8co3hwAW4CQD0ajhkff2cnpJ4Ib+BMVYdNk='} 2023-06-02T15:33:36.261 INFO:teuthology.orchestra.console:Power off smithi078 2023-06-02T15:33:36.262 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-02T15:33:36.287 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:36.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-06-02_15:02:25-fs-reef-release-distro-default-smithi/7294361', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-06-02 15:03:30.840253', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA1/IRWm6AhkuqdkiWvx+BHPj6Kp6XrE4bGIu6bnFC6tAPc1BI/ngr5Frv6LIns5CFXMAL2CqqRhTeDemDZq25E='} 2023-06-02T15:33:36.320 INFO:teuthology.orchestra.console:Power off smithi132 2023-06-02T15:33:36.321 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-02T15:33:36.344 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:36.372 INFO:teuthology.orchestra.console:Power off smithi150 2023-06-02T15:33:36.373 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-02T15:33:36.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:36.422 INFO:teuthology.orchestra.console:Power off smithi159 2023-06-02T15:33:36.423 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-06-02T15:33:36.451 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:40.336 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:40.389 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:40.436 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:40.477 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:44.450 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:44.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:44.550 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:44.593 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:44.805 INFO:teuthology.orchestra.console:Power off for smithi159 completed 2023-06-02T15:33:48.564 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:48.615 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:48.664 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-06-02T15:33:48.776 INFO:teuthology.orchestra.console:Power off for smithi078 completed 2023-06-02T15:33:48.828 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2023-06-02T15:33:48.876 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2023-06-02T15:33:48.981 INFO:teuthology.run:Summary data: description: fs/multiclient/{begin/{0-install 1-ceph 2-logrotate} clusters/1-mds-2-client conf/{client mds mon osd} distros/ubuntu_latest mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down} tasks/mdtest} duration: 961.4991879463196 failure_reason: 'Command failed on smithi150 with status 2: ''TESTDIR=/home/ubuntu/cephtest bash -s''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=08d3f33250bd43efb2d97b32984398d9 status: fail success: false 2023-06-02T15:33:48.982 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-06-02T15:33:49.067 INFO:teuthology.run:FAIL